Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Langfuse client is disabled #7948

Open
hugobritobh opened this issue Jan 23, 2025 · 0 comments
Open

Langfuse client is disabled #7948

hugobritobh opened this issue Jan 23, 2025 · 0 comments

Comments

@hugobritobh
Copy link

hugobritobh commented Jan 23, 2025

I use version ( Litellm v1.59.5 and Latest version of the Helm chart langfuse-0.12.1.tgz )

I'm following this tutorial to have two teams sending data to two different Langfuse instances: https://docs.litellm.ai/docs/proxy/team_logging

In the ConfigMap, I included the two variables related to Langfuse.

apiVersion: v1
kind: ConfigMap
metadata:
  name: config
data:
  config.yaml: |
    model_list:
      - model_name: yyyyyyy
        litellm_params:
          model: yyyyyyyyyyyyy-v1:0
          aws_access_key_id: os.environ/CUSTOM_AWS_ACCESS_KEY_ID
          aws_secret_access_key: os.environ/CUSTOM_AWS_SECRET_ACCESS_KEY   
          aws_region_name: os.environ/CUSTOM_AWS_REGION_NAME
        model_info:
          team_id: "api"
      - model_name: xxxxxxxx
        litellm_params:
          model: xxxxxxxx-v1:0
          aws_access_key_id: os.environ/CUSTOM_AWS_ACCESS_KEY_ID
          aws_secret_access_key: os.environ/CUSTOM_AWS_SECRET_ACCESS_KEY   
          aws_region_name: os.environ/CUSTOM_AWS_REGION_NAME
        model_info:
          team_id: "api2"
    litellm_settings:
      default_team_settings:
        - team_id: "api"
          success_callback: ["langfuse"]
          langfuse_public_key: yyyyy
          langfuse_secret: yyyyyy
          langfuse_host: yyyyy
        - team_id: "api2"
          success_callback: ["langfuse"]
          langfuse_public_xxxx
          langfuse_secret: xxxxxx
          langfuse_host: xxxxx
    general_settings: 
      default_team_disabled: false 

However, when I start the LiteLLM pod, the following issue occurs:
Langfuse client is disabled since no public_key was provided as a parameter or environment variable 'LANGFUSE_PUBLIC_KEY'. See our docs: https://langfuse.com/docs/sdk/python/low-level-sdk#initialize-client

I ran a test by adding the required variable directly in the Deployment. However, LiteLLM did not switch configurations based on the team and only sent data using the variables defined in the Deployment, completely ignoring the ConfigMap.

Why is this error occurring if the variables are in the ConfigMap and there are two separate configurations depending on the team?

How can this issue be resolved?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant