Job with config.yaml as input

[dolfim-ibm]

The docling-jobkit package installs the docling-ray-job CLI, which orchestrate the conversion job.

We look for the possibility to launch the job as

ray job submit --no-wait -- docling-ray-job -c myjob.yaml

The file myjob.yaml should be parsed with a pydantic datatype. The format should be similar to the payload of the docling-serve endpoints https://github.com/DS4SD/docling-serve/blob/feat-async-api/docling_serve/datamodel/requests.py#L60.

For example:

options:
  do_ocr: true
  # ...
s3_sources:
  # ...