From 4f356323b67c70566b13794e10e615ba495e81af Mon Sep 17 00:00:00 2001 From: Shane A Date: Mon, 15 Apr 2024 10:46:25 -0700 Subject: [PATCH] Update CHANGELOG for hybrid sharding model replicas --- CHANGELOG.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 8617f2f90..9f4bf369a 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -14,6 +14,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 - Makes it possible to read from http/https the same way we read from s3/r2. - Added MMLU multiple choice (A/B/C/D) 5-shot variant downstream tasks - Tokenizer patch +- Added option to specify number of model replicas when using hybrid sharding. ### Changed @@ -35,7 +36,6 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 - Fixed the size calculation for qk layer norm - Fixed pipeline test failure that occurs due to a bug in transformers version 4.39.1 - ## [v0.2.5](https://github.com/allenai/OLMo/releases/tag/v0.2.5) - 2024-03-06 ### Fixed