Dashboard: split prompt/completion/total tokens #3558
marcklingen
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Describe the feature or potential improvement
The model overview table currently reports total tokens. Given the split between input/output + additional new types (cached, reasoning), it is necessary to split the token types in this dashboard.
Additional information
No response
Beta Was this translation helpful? Give feedback.
All reactions