Skip to content

Public Dataset #327

Draft
okradze wants to merge 8 commits intodevelopfrom
feat/dataset
Draft

Public Dataset #327
okradze wants to merge 8 commits intodevelopfrom
feat/dataset

Conversation

@okradze
Copy link
Copy Markdown
Contributor

@okradze okradze commented Apr 6, 2026

  • Use HuggingFace datasets for questions
  • Use subtensor commitments for sharing seed between validators
  • Deterministically split queries between validators in scoring window
  • Add bucket storage to store miner responses and score same response in validators
  • Refactor some parts of validator and reorganize
  • Replace dataset with custom Desearch dataset once ready

okradze added 7 commits March 28, 2026 00:26
- Added validator_uid and validator_hotkey to ScoringAssignment.
- Implemented build_validator_ownership function to assign validators to miners.
- Updated build_scoring_assignments to utilize validator ownership.
- Refactored ScoringStore to handle responses with validator information.
- Introduced ObjectStorage interface and implementations for local and Hugging Face storage.
- Added bucket commitment handling in seed_commitment module.
- Created tests for scoring store and seed commitment functionalities.
@okradze okradze changed the title Dataset Public Dataset Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant