Workers & Pools

​

What Are Workers?

​

How Workers Stay Warm

1. Start when you deploy
2. Handle requests one at a time
3. Stay alive between requests
4. Only die when idle too long

​

Worker Pool

• min_workers: Always keep this many ready
• max_workers: Never exceed this many

scaling:
  min_workers: 1   # Always 1 warm
  max_workers: 10  # Scale up to 10

​

Worker Lifecycle

Deploy → Create Pool → Spawn min_workers
                              ↓
Request → Queue → Worker picks up → Execute → Return to pool
                              ↓
Idle timeout → Remove worker (down to min_workers)

​

Check Worker Status

orpheus stats my-agent

• current: How many workers running
• healthy: How many ready for requests
• queue.depth: Requests waiting

​

When Workers Scale

• Scale up: Queue building up (more requests than workers can handle)
• Scale down: Workers idle (no requests for a while)