Skip to content

Release v4.0.0
Compare
Choose a tag to compare
@cryptal-mc cryptal-mc released this 06 Aug 16:48
· 163 commits to main since this release
v4.0.0
e81f1d0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Announcing Release v4.0.0

Subnet-9 now supports multiple concurrent competitions.

Changes

  • This version implements multi-competition support and a programmed launch for the 700M model competition in parallel with the current 7B model competition. It also contains the 3B competition constraints ready for scheduling.

  • The validator version shipped with this release is bumped 3.0.0. This mean that the validator state will be erased and evaluation for all models will be restarted from scratch.

  • All submitted models for 7B will be automatically attributed to the 7B sub-competition with a default competition ID of 0.

  • Past submissions for 772M models and less will be ignored, even after the launch of the 700M competition on Thursday.

  • Miner weights and model losses will be logged to wandb along with the competition ID for each miner: https://wandb.ai/macrocosmos/pretraining-validators?nw=nwusercloudops

  • Related discord announcement: https://discord.com/channels/799672011265015819/1162768567821930597/1270164103125663807

  • Allowed models list has been adjusted to include new model types:

    • Gemma2ForCausalLM
    • StableLmForCausalLM
    • Phi3ForCausalLM
    • Qwen2ForCausalLM

  • The flag --competition_id should now be used with the scripts/upload_model.py script to specify the competition the miner is willing to submit their model to.

  • No change to the validator launch command.

Assets 2
Loading