Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wont track time when LLM uses multiple Think states #387

Open
CoffeeMethod opened this issue Feb 2, 2025 · 1 comment
Open

Wont track time when LLM uses multiple Think states #387

CoffeeMethod opened this issue Feb 2, 2025 · 1 comment

Comments

@CoffeeMethod
Copy link

Which version of LM Studio?
LM Studio 0.3.6 (build 4)

Which operating system?
Windows 11 pro (10.0.22631 Build 22631)

What is the bug?
The bug is when a model re enters a think state LM studio loses track of when it enters and exits think state and shows its indefinitely processing.

Screenshots

Image
Image

To Reproduce
Steps to reproduce the behavior:

In the Advanced Configurator set the system prompt to:
before you answer type <think> and think about everything your going to do to get an answer and compute it in your head then type </think> to give the final answer the user ( the user cannot see what you think so you have to exit your think state to answer. (exit with </think> to answer the prompt) you are encouraged to use the think state whenever necessary and when you find something important you may exit your think state to tell the user then reenter your think state)

Then prompt it:
can you go in and out of < think> so I can test my software

Then as it goes in and out of its state the time that its in the think state wont be tracked.

@yagil
Copy link
Member

yagil commented Feb 2, 2025

The additional <think> tags are probably confusing the UI. Can you try without this system prompt? Note that the model is trained to use <think> / </think> without you having to tell to do it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants