Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: [sparse_weights] get for predict #4651

Merged
merged 25 commits into from
Nov 17, 2023

Conversation

bassmang
Copy link
Member

No description provided.

@@ -6021,7 +6021,7 @@
{
"id": 465,
"desc": "cb_explore_adf with epsilon-greedy exploration using --sparse_weights and saving model",
"vw_command": "--cb_explore_adf --epsilon 0.1 -d train-sets/cb_test.ldf --noconstant --sparse_weights -f standard_sparse_model.vw",
"vw_command": "--cb_explore_adf --epsilon 0.1 -d train-sets/cb_test.ldf --noconstant --sparse_weights -f standard_sparse_model.vw -q::",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there's a total of 3 tests using --sparse_weights, might be the opportunity to beef it up - maybe unit tests?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

apart from that, would be cool to add some sparse benchmarks to master and see if they are affected by this change

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

benchmarks added, tests can be added in a separate PR

@bassmang bassmang changed the title refactor: [sparse_weights] use std::map and get for predict refactor: [sparse_weights] get for predict Oct 16, 2023
@rajan-chari
Copy link
Member

The one change that makes this PR side effect free is specialization of get for random init. In that case, insert something in the map.

@rajan-chari
Copy link
Member

Based on latency tests done so far, this is definitely desirable.

@bassmang bassmang merged commit 2849b3b into VowpalWabbit:master Nov 17, 2023
115 checks passed
@bassmang bassmang deleted the gd_get branch November 17, 2023 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants