Langfuse Roadmap

Langfuse is open source and we want to be fully transparent what we’re working on and what’s next. This roadmap is a living document and we’ll update it as we make progress.

🚀 Released

10 most recent changelog items:

• Amazon Bedrock support for LLM Playground and Evaluations(Oct 11, 2024)
• Langfuse Evals now supports any (tool-calling) LLM(Oct 11, 2024)
• Annotation Queues(Oct 10, 2024)
• Aggregated and Color-coded Latency and Costs on Traces(Oct 10, 2024)
• Documentation now integrates with GitHub Discussions (Support and Feature Requests)(Sep 23, 2024)
• Langfuse on AWS Marketplace(Sep 20, 2024)
• DSPy Integration Example(Sep 20, 2024)
• Link prompts to Langchain executions(Sep 17, 2024)
• Custom Base Path for Self-Hosted Deployments(Sep 13, 2024)
• Token/cost tracking for OpenAI's o1 models(Sep 13, 2024)

🚧 In progress

• Langfuse v3.0: preparing Langfuse for the next level of scale using an OLAP database, a queue and another container. Parts of it are already available in Langfuse Cloud and once migration is complete, self-hosting will be upgraded as well. Learn more in this GitHub Discussion.
• Export traces and sessions from Langfuse dashboard (CSV, JSON)
• Improved tables across the Langfuse UI to display all relevant information and be more user-friendly.
• Move to SDK references generated from docstrings to improve the developer experience (Intellisense) and reduce the risk of errors.
• Annotation queue to assign annotations to team members.
• Improve cost tracking of multi-modal LLMs and more complex pricing models (e.g. Anthropic/Google Context Caching, Google Vertex pricing)
• In-UI prompt and model evaluation/benchmarking based on Langfuse-managed custom evaluators.

🔮 Planned

• Webhooks to subscribe to changes within your Langfuse project.
• Datasets: make them usable in CI (e.g GitHub Actions).
• Comments on prompt versions.
• Improved datasets UI/UX.
• Add non-LLM evaluators to online evaluation within Langfuse UI.
• Revamped context-aware JS integration to to remove the need for nesting of tracing calls, similar to Python decorator.
• Better support for multi-modal traces that use base64 encoded images.

⚠️ Upcoming breaking changes

• Self-hosting: Langfuse v3.0 will add additional containers and database for improve scalability. Learn more in this GitHub Discussion. We will provide a migration path. Scheduled for August/September 2024.
• OpenAI integration, dropping support of openai < 1.0.0 to greatly simplify the integration and improve the developer experience of everyone on openai >= 1. No timeline on this yet as many libraries still depend on the old version.

🙏 Feature requests and bug reports

The best way to support Langfuse is to share your feedback, report bugs, and upvote on ideas suggested by others.

Feature requests

Bug reports