Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add prodigy optimiser with full bf16 support #1294

Merged
merged 1 commit into from
Jan 22, 2025

Conversation

bghira
Copy link
Owner

@bghira bghira commented Jan 22, 2025

can use --prodigy_steps to set the adjustment cap though it tends to stop adjusting early anyway.

@bghira
Copy link
Owner Author

bghira commented Jan 22, 2025

image

@bghira bghira merged commit b73d4eb into main Jan 22, 2025
1 check passed
@bghira bghira deleted the feature/prodigy-schedulefree-bf16 branch January 22, 2025 22:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant