Production Batch Jobs and Serverless Functions

Back to modules
Course progress0%
article

Batch job operations

Run scripts on cloud hardware with observable inputs and outputs.

Batch Job Operations

Batch jobs turn scripts into repeatable cloud operations. The script may be simple, but the operational contract should be explicit.

Job contract

  • input location,
  • output location,
  • VM type and region,
  • environment,
  • retries,
  • owner,
  • success signal.

CLI-shaped example

coiled batch run --memory 64GB --region us-west-2 python jobs/build_features.py

Production habit

Every recurring job should answer: what did it read, what did it write, how long did it take, and who gets paged if it fails?

Batch job operations

Batch operations