Skip to content

Latest commit

 

History

History
10 lines (8 loc) · 535 Bytes

transform-runtimes.md

File metadata and controls

10 lines (8 loc) · 535 Bytes

Transform Runtimes

Runtimes provide a mechanism to run a transform over a set of input files to produce a set of output files. Each runtime is started using a launcher.
The available runtimes are as follows:

  • Python runtime - provides single process running of a transform.
  • Ray runtime - provides running transforms across multiple Ray workers to achieve highly scalable processing.
  • Spark runtime - provides running spark-based transforms in a spark cluster.