DEV Community

Julien Simon
Julien Simon

Posted on • Originally published at julsimon.Medium on

Model routing with Open WebUI and Arcee Conductor

Limited offer: sign up for Conductor and get $200 of free inference credits!

In the rapidly evolving landscape of artificial intelligence, the choice of models for specific tasks can significantly impact performance and cost. Arcee AI has introduced Conductor, an innovative inference platform that automatically routes each prompt to the most suitable model — whether it’s a small, cost-effective model or a large, powerful language model (LLM). This ensures that users get the best results while optimizing resource usage and budget.

In this video, we’ll walk through the process of integrating Conductor with Open Web UI , a popular open-source chat interface. By following these steps, you’ll be able to leverage the full power of Conductor, including its cost-effective model routing and the advanced features of Open Web UI, such as file attachments and retrieval-augmented generation (RAG).

Top comments (0)

Hot sauce if you're wrong - web dev trivia for staff engineers

Hot sauce if you're wrong · web dev trivia for staff engineers (Chris vs Jeremy, Leet Heat S1.E4)

  • Shipping Fast: Test your knowledge of deployment strategies and techniques
  • Authentication: Prove you know your OAuth from your JWT
  • CSS: Demonstrate your styling expertise under pressure
  • Acronyms: Decode the alphabet soup of web development
  • Accessibility: Show your commitment to building for everyone

Contestants must answer rapid-fire questions across the full stack of modern web development. Get it right, earn points. Get it wrong? The spice level goes up!

Watch Video 🌶️🔥