OrcaRouter introduced the launch of Routing DSL, a programmable routing framework that offers builders full management over how AI requests are evaluated, routed, mixed, and optimized throughout fashions.
In contrast to static mannequin choice, Routing DSL permits groups to outline routing logic utilizing easy YAML and CEL expressions, making it doable to dynamically select fashions based mostly on immediate complexity, process sort, latency necessities, value targets, security insurance policies, and customized enterprise guidelines.
With Routing DSL, builders can construct subtle routing methods comparable to:
- Route easy requests to environment friendly open-source fashions
- Escalate tough prompts to frontier fashions
- Run a number of fashions in parallel and merge outcomes
- Configure fallback chains and reliability insurance policies
- Apply guardrails and governance guidelines earlier than execution
- Optimize for value, high quality, latency, or customized goals
Routing DSL is constructed instantly into OrcaRouter’s AI Gateway and works throughout greater than 200 main AI fashions via a single OpenAI-compatible endpoint.
Additionally Learn: AiThority Interview with Matej Bukovinski, Chief Expertise Officer at Nutrient
Fable 5-Class Intelligence By way of Programmable Routing
Early inside evaluations present that rigorously designed Routing DSL methods can obtain efficiency akin to frontier fashions comparable to Claude Fable 5 whereas considerably lowering inference prices.
As an alternative of counting on a single costly mannequin for each request, Routing DSL permits builders to mix specialised fashions and parallel execution methods, allocating compute solely the place it delivers measurable high quality enhancements.
The result’s a brand new strategy to AI infrastructure:
Higher intelligence via orchestration, not simply bigger fashions.
A New Layer within the AI Stack
As AI programs change into more and more agentic, routing selections are evolving from easy mannequin choice right into a core a part of utility logic.
Routing DSL introduces a programmable management aircraft for AI workloads, enabling groups to specific how intelligence ought to be assembled, ruled, and optimized in manufacturing.
Mixed with OrcaRouter’s adaptive routing engine, observability platform, guardrails, governance controls, and Agent Firewall, Routing DSL gives organizations with a unified option to construct dependable and cost-efficient AI programs at scale.
Additionally Learn: AI programs – Interoperable AI programs: Connecting fashions throughout platforms
[To share your insights with us, please write to psen@itechseries.com ]
