Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Blog: LangSmith alternatives - added a faq #2623

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Blog: LangSmith alternatives - added a faq #2623

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
9b94010
added a faq
LinaLam Sep 13, 2024
ccfa2b6
added internal linking
LinaLam Sep 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 43 additions & 2 deletions bifrost/app/blog/blogs/best-langsmith-alternatives/src.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,8 @@ Companies that are highly responsive to market changes or opportunities often us
If you need something that "just works" so you can get back to shipping features, Helicone has the core functionality to help you get started instantly.


**→ <a href="https://www.helicone.ai/" target="_blank">Start for free</a>**
- **<a href="https://www.helicone.ai/" target="_blank">Start for free</a>**
- **<a href="https://www.helicone.ai/langsmith" target="_blank">Detailed comparison: LangSmith vs. Helicone</a>**

---

Expand Down Expand Up @@ -317,4 +318,44 @@ OpenLLMetry aims to standardize the collection of mission-critical LLM metrics,

Traceloop focuses on evaluation and the pricing reflects that, thus can become expensive as your application scale to log more traces.

#### So, which LangSmith alternatives suits you better?
---

## Frequently Asked Questions

### Q: Which LangSmith alternative is best for open-source and self-hosting?

Helicone and Langfuse are both open-source and offer self-hosting options, giving you full control over your data and infrastructure.

### Q: How do these tools handle data privacy and security?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also SOC2 compliance. Privacy terms

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would also love some wording suggestions here

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Link to our privacy policy https://us.helicone.ai/privacy, mentioning SOC2 compliance, ability to omit log bodies from longer-term storage, and then for more extreme measures, open-source and scalable self-hosting capabilities

- **Helicone**: Being open-source and self-hostable, Helicone allows you to keep all data within your infrastructure, enhancing security.
- **Langfuse**: Also open-source and self-hostable, offering similar security advantages.
- **Phoenix by Arize AI**: Offers enterprise-grade security features but is not self-hostable.
- **HoneyHive**: Does not offer self-hosting; review their privacy policies for data handling practices.
- **OpenLLMetry by Traceloop**: Open-source but not self-hosted; integration with observability platforms may affect data control.

### Q: Are there free options available among these tools?

- **Helicone**: Offers a free tier with up to 100,000 requests per month.
- **Langfuse**: Free to start with flexible pricing options.
- **Phoenix by Arize AI**: May offer free trials; pricing details should be confirmed on their website.
- **HoneyHive**: Flexible pricing with possible free tiers.
- **OpenLLMetry by Traceloop**: Open-source but may incur costs as you scale.

### Q: Do these tools support LangChain integration?

Yes, all the mentioned tools offer integration with LangChain, facilitating seamless incorporation into your existing workflows.

### Q: Are there limitations on payload sizes or types?

Helicone stands out by supporting both text and image inputs and outputs without payload limitations. Other tools may have restrictions, so it's important to review their documentation for specifics.

### Q: Which Tool is Best for ML Engineers and MLOps Teams?

Phoenix by Arize AI is specifically designed for ML engineers and MLOps teams, focusing on model monitoring and explainability.

---

### So, which LangSmith alternatives suits you better?


Loading