Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add token utils to count the total tokens utilized #49

Merged
merged 6 commits into from
Sep 30, 2023
Merged

feat: add token utils to count the total tokens utilized #49

merged 6 commits into from
Sep 30, 2023

Conversation

K-A-I-L-A-S-H
Copy link
Contributor

No description provided.

@Goldziher
Copy link
Member

Looks good

Goldziher
Goldziher reviewed Sep 28, 2023
View reviewed changes
Copy link
Member

@Goldziher Goldziher left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tests are a bit slim.

Goldziher
Goldziher reviewed Sep 29, 2023
View reviewed changes
go.mod Outdated Show resolved Hide resolved
Goldziher
Goldziher reviewed Sep 29, 2023
View reviewed changes
shared/go/tokenutils/tokenutils.go Outdated Show resolved Hide resolved
services/api-gateway/connectors/openai/utils.go Outdated Show resolved Hide resolved
@Goldziher Goldziher merged commit 214918e into main Sep 30, 2023
3 checks passed
@Goldziher Goldziher deleted the tokenizer-util branch September 30, 2023 15:23
@K-A-I-L-A-S-H K-A-I-L-A-S-H linked an issue Oct 14, 2023 that may be closed by this pull request
feat: add prompt token calculation to API-gateway #42
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Goldziher Goldziher Goldziher approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

feat: add prompt token calculation to API-gateway
2 participants
@K-A-I-L-A-S-H @Goldziher