Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve speed of flashcard/quiz/compendium/RagChat generation #116

Open
SverreNystad opened this issue May 14, 2024 · 0 comments
Open

Improve speed of flashcard/quiz/compendium/RagChat generation #116

SverreNystad opened this issue May 14, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@SverreNystad
Copy link
Member

SverreNystad commented May 14, 2024

To mimic the effect seen in ChatGPT where the text is returned iteratively, we should set the stream parameter to true.

https://platform.openai.com/docs/api-reference/authentication#chat/create-stream

@SverreNystad SverreNystad added the enhancement New feature or request label May 14, 2024
@SverreNystad SverreNystad self-assigned this May 14, 2024
@SverreNystad SverreNystad changed the title Improve speed of feedback to user Improve speed of flashcard/quiz/compendium/RagChat generation May 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant