MultiTurnRoute gives built-in and custom routers a shared interface for choosing an LLM at each turn. Our router, Chain-of-Route, predicts quality from dialogue history and estimates cost from reusable prefixes. MultiTurnRoute Arena evaluates routers on recorded and interactive conversations.

git clone https://github.com/loopleap-lab/MultiTurnRoutecd MultiTurnRoute && pip install -e ".[serve]"In a session, the right model for a turn depends on the turns before it.
of held-out turns had a quality score at least 3 points lower on the 1–10 scale when prior turns were removed (paper, Section 4).
| Input | $0.20 |
| Cached input | $0.04 |
Your app sends each turn and a router picks the model. MultiTurnRoute keeps the state of each session.
All plug in the same way and can be submitted to MultiTurnRoute Arena.
Click Next turn to send the next message of a simulated session, and see which model the router picks, what it costs, and why.
Install, start the gateway with the example config, and send a session’s turns through it. No GPU, data or API keys needed.