I believe that cracking model routing is *the* next big challenge with LLMs. If you are developing any service on top of an LLM you probably need Not Diamond and should check it out
Removing the constraint of having to switch between models for different tasks is crucial, and this is how it should be done. Awesome stuff!
In a world with many different models, it makes a *ton* of sense to have a really good LLM router to pick the best model for a given task.
So glad to finally have a steerable model router out there!
If you use the same model for all your requests, you'll probably need a highly capable model and overpay (cost/latency) for your simpler requests.
Been having fun using Not Diamond for request routing, results are impressive. Awesome tool.
Not Diamond is the much needed LLM router to automatically route to the best LLM.
With so many LLMs and updates every other day it’s so hard to keep track and update applications. This has been so helpful for cutting through the noise.
Incredible work, no longer have to wonder "which model do I use" for this AI project. The team at NotDiamond are among some of the best developers I have ever met. Good work team! 🔥