Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

260 require data input #55

Merged
merged 48 commits into from
Dec 19, 2024
Merged

260 require data input #55

merged 48 commits into from
Dec 19, 2024

Conversation

peterc-yuma
Copy link
Collaborator

No description provided.

@peterc-yuma
added upload data to miner hf utils. Add upload data whenever miner r…
0eadc3b 
…ecieves a request.
@peterc-yuma
update challenge to accept a decrytion key. Data should now be encrypted
d1d98ce
@peterc-yuma
decrypt data and upload to foundryservices dataset
fe7701a
@peterc-yuma
update decrypt_data
8e6cdcd
@peterc-yuma
update decryption_key to be bytes
3fcae57
@peterc-yuma
fix deserialization of decription key
06dfca4
@peterc-yuma
updated path for decryption to be the full path to the miners encrypt…
17b7af8 
…ed hf data
@peterc-yuma
ensure that decryption works from hf path
418294d
@peterc-yuma
add logging
b1f10fe
@peterc-yuma
ensure proper format for repo_id when downloading from huggingface
246de6e
@peterc-yuma
Update forward.py to decrypt data properly
5203abd
@peterc-yuma
add logging for key
ac72f53
@peterc-yuma
add decryption and upload for 146
752fdc6
@peterc-yuma
add decryption and upload for 146
2f4f488
@peterc-yuma
add logging to forward
c51e0d6
@peterc-yuma
more logging
47b920f
@peterc-yuma
try to get correct path for downloading hf data
f7c07a2
@peterc-yuma
more logging
30e4334
@peterc-yuma
hopefully can actually download data from miner repo
a94910a
@peterc-yuma
update store_data
c720675
@peterc-yuma
update temporary file creation
970b25b
@peterc-yuma
updated dataset manager to use hfapi only
ba197fa
@peterc-yuma
add hotkey to dataset file structure
24b19d4
@peterc-yuma
remove nested folder
ada6812
@peterc-yuma
generalize the data decryption and upload
74bf79d
@peterc-yuma peterc-yuma self-assigned this Dec 16, 2024
@peterc-yuma peterc-yuma marked this pull request as ready for review December 19, 2024 14:41
matt-yuma
matt-yuma reviewed Dec 19, 2024
View reviewed changes
snp_oracle/neurons/miner.py Show resolved Hide resolved
snp_oracle/predictionnet/utils/dataset_manager.py Outdated Show resolved Hide resolved
snp_oracle/predictionnet/utils/dataset_manager.py Show resolved Hide resolved
snp_oracle/predictionnet/utils/dataset_manager.py Outdated Show resolved Hide resolved
snp_oracle/predictionnet/utils/dataset_manager.py Show resolved Hide resolved
snp_oracle/predictionnet/utils/miner_hf.py Show resolved Hide resolved
snp_oracle/predictionnet/utils/miner_hf.py Show resolved Hide resolved
snp_oracle/predictionnet/utils/miner_hf.py Outdated Show resolved Hide resolved
snp_oracle/predictionnet/utils/miner_hf.py Show resolved Hide resolved
@matt-yuma matt-yuma merged commit a2e21e3 into dev Dec 19, 2024
6 checks passed
@matt-yuma matt-yuma deleted the 260-require-data-input branch December 20, 2024 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@matt-yuma matt-yuma matt-yuma approved these changes

@hayden-yuma hayden-yuma Awaiting requested review from hayden-yuma

Assignees

@peterc-yuma peterc-yuma

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@peterc-yuma @matt-yuma