Sessions

Documentation Index

Fetch the complete documentation index at: https://docs.orpheus.run/llms.txt

Use this file to discover all available pages before exploring further.

​

What Sessions Do

# Both hit the same worker
orpheus run agent '{}' --session user-123
orpheus run agent '{}' --session user-123

​

Why Use Sessions

• Loaded models stay loaded
• Conversation context persists
• Caches remain warm

​

How It Works

1. Request arrives with session_id
2. Orpheus checks which worker last handled that session
3. Routes to that worker (if available)
4. Falls back to any worker if busy

​

Best-Effort

• If preferred worker is busy → another handles it
• If worker dies → new worker, fresh state

​

When to Use