Cloud Architecture

Batch Processing with AWS Batch and S3

Cloud Architecture diagram · made in Skemio

Workflow diagram from Raw S3 Bucket to SQS Queue, AWS Batch scheduler, ECS Spot Workers, and output Curated S3 Bucket.
Workflow diagram from Raw S3 Bucket to SQS Queue, AWS Batch scheduler, ECS Spot Workers, and output Curated S3 Bucket.
Open it in SkemioMake your own

What it shows

  • S3 event notifications push metadata to SQS to decouple ingestion from compute.
  • AWS Batch provisions ECS Spot instances on demand, reducing cost by up to 90%.
  • Workers process files in parallel and flush results back to S3 automatically.

The takeaway

Event-driven orchestration paired with Spot compute eliminates idle spend for bulk processing.

More cloud architecture diagrams