MLFlow – engineering platform to debug, evaluate, monitor, and optimize AI applications – https://github.com/mlflow/mlflow
LangSmith from LangChain – https://smith.langchain.com/
OctoTools from Stanford Univ. – https://octotools.github.io/
Poetiq – https://poetiq.ai/
Agno – Framework x multi-agent systems – https://github.com/agno-agi/agno – https://github.com/agno-agi/agno
Building agents with Google Gemini and open source frameworks
Open Source LLM Agent handbook – https://www.freecodecamp.org/news/the-open-source-llm-agent-handbook/
OpenAI agents SDK – https://openai.github.io/openai-agents-python/
Building agents with Gemini using open source frameworks – https://developers.googleblog.com/en/building-agents-google-gemini-open-source-frameworks/
LiteLLM – API translator – https://docs.litellm.ai/docs/