-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add Langtrace to the "How to" docs for CrewAI Agent Observability (#634)
* Add files via upload * Create Langtrace-Observability.md * Rename crewai-agentops-stats.png to crewai-langtrace-stats.png
- Loading branch information
1 parent
bf40956
commit ea89343
Showing
3 changed files
with
44 additions
and
0 deletions.
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,44 @@ | ||
--- | ||
title: CrewAI Agent Monitoring with Langtrace | ||
description: How to monitor cost, latency and performance of CrewAI Agents using Langtrace. | ||
--- | ||
|
||
# Langtrace Overview | ||
Langtrace is an open-source tool that helps you set up observability and evaluations for LLMs, LLM frameworks and VectorDB. With Langtrace, you can get deep visibility into the cost, latency and performance of your CrewAI Agents. Additionally, you can log the hyperparameters and monitor for any performance regressions and set up a process to continuously improve your Agents. | ||
|
||
## Setup Instructions | ||
|
||
1. Sign up for [Langtrace](https://langtrace.ai/) by going to [https://langtrace.ai/signup](https://langtrace.ai/signup). | ||
2. Create a project and generate an API key. | ||
3. Install Langtrace in your code using the following commands. | ||
**Note**: For detailed instructions on integrating Langtrace, you can check out the official docs from [here](https://docs.langtrace.ai/supported-integrations/llm-frameworks/crewai). | ||
|
||
``` | ||
# Install the SDK | ||
pip install langtrace-python-sdk | ||
# Import it into your project | ||
from langtrace_python_sdk import langtrace # Must precede any llm module imports | ||
langtrace.init(api_key = '<LANGTRACE_API_KEY>') | ||
``` | ||
|
||
### Features | ||
- **LLM Token and Cost tracking** | ||
- **Trace graph showing detailed execution steps with latency and logs** | ||
- **Dataset curation using manual annotation** | ||
- **Prompt versioning and management** | ||
- **Prompt Playground with comparison views between models** | ||
- **Testing and Evaluations** | ||
|
||
![Langtrace Cost and Usage Tracking](..%2Fassets%2Fcrewai-langtrace-stats.png) | ||
![Langtrace Span Graph and Logs Dashboard](..%2Fassets%2Fcrewai-langtrace-spans.png) | ||
|
||
#### Extra links | ||
|
||
<a href="https://x.com/langtrace_ai">🐦 Twitter</a> | ||
<span> • </span> | ||
<a href="https://discord.com/invite/EaSATwtr4t">📢 Discord</a> | ||
<span> • </span> | ||
<a href="https://langtrace.ai/">🖇 Website</a> | ||
<span> • </span> | ||
<a href="https://docs.langtrace.ai/introduction">📙 Documentation</a> |