Throughput
ConceptsThroughput is the rate at which documents or operations are processed—for example, documents per minute or extraction jobs per hour. Higher throughput means more work completed per unit time. Batch processing improves throughput by handling many documents together.
Trade-offs
- Latency — Faster individual responses may reduce batch throughput
- Rate limits — API limits cap throughput; workflows can pace requests
- Async processing — Background jobs allow high throughput without blocking
Related Concepts
Throughput matters for batch processing, document ingestion, and extraction pipelines. Latency and rate limits constrain throughput. Webhooks notify when jobs complete so you can scale processing.