Skip to content

Pull requests: mosaicml/llm-foundry

New pull request New
26 Open 1,380 Closed
26 Open 1,380 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update datasets requirement from <3.4,>=3.3.2 to >=3.3.2,<3.6 dependencies Pull requests that update a dependency file python Pull requests that update python code
#1807 opened Apr 28, 2025 by dependabot bot Loading…
Update numpy requirement from <2 to <3 dependencies Pull requests that update a dependency file python Pull requests that update python code
#1806 opened Apr 28, 2025 by dependabot bot Loading…
Update torch requirement from <2.6.1,>=2.6.0 to >=2.6.0,<2.7.1 dependencies Pull requests that update a dependency file python Pull requests that update python code
#1805 opened Apr 28, 2025 by dependabot bot Loading…
Update transformer-engine[pytorch] requirement from <2.0,>=1.13.0 to >=1.13.0,<3.0 dependencies Pull requests that update a dependency file python Pull requests that update python code
#1804 opened Apr 28, 2025 by dependabot bot Loading…
Update setuptools requirement from <80.0.0 to <81.0.0 dependencies Pull requests that update a dependency file python Pull requests that update python code
#1803 opened Apr 28, 2025 by dependabot bot Loading…
Support interleaving dense and moe
#1802 opened Apr 23, 2025 by ShashankMosaicML • Draft
Adding support for nope positional encoding in block overrides.
#1794 opened Apr 17, 2025 by ShashankMosaicML Loading…
10
Adding temperature tuning in attention
#1793 opened Apr 17, 2025 by ShashankMosaicML • Draft
Add user error to data prep script
#1729 opened Mar 1, 2025 by milocress Loading…
5
[WIP] Support for reusing the input to W_k and W_v
#1710 opened Jan 13, 2025 by ShashankMosaicML • Draft
fix retry crash loop
#1696 opened Dec 9, 2024 by milocress Loading…
2
Catch bad split regex
#1691 opened Dec 8, 2024 by milocress Loading…
1
Add ability to log model instead of saving to folder
#1683 opened Dec 2, 2024 by irenedea Loading…
11
Add pre-tokenized Delta to MDS conversion script
#1680 opened Nov 30, 2024 by mattyding Loading…
11
Add support for Flex Attention
#1675 opened Nov 27, 2024 by ShashankMosaicML • Draft
Put extra arg test back
#1641 opened Nov 5, 2024 by XiaohanZhangCMU Loading…
2
[WIP] Add sliding window warmup callback
#1589 opened Oct 13, 2024 by ShashankMosaicML • Draft
1
Throw error when tokenization fails due to mistyped dataset entries.
#1529 opened Sep 16, 2024 by milocress Loading…
2
Byod/data validation
#1456 opened Aug 15, 2024 by XiaohanZhangCMU • Draft
draft PR for validation notebook
#1454 opened Aug 14, 2024 by XiaohanZhangCMU • Draft
Upgrade to v0.10.0
#1427 opened Aug 5, 2024 by hlahkar Loading…
@abhi-mosaic
new python file to upload mosaic-bert to hf
#1109 opened Apr 12, 2024 by Patchwork53 Loading…
Enable HF SpeedMonitor
#997 opened Feb 26, 2024 by rlrs Loading…
4
Validation
#844 opened Jan 8, 2024 by XiaohanZhangCMU Loading…
13
add transformer engine fp8 attention
#803 opened Dec 13, 2023 by cli99 • Draft
ProTip! Updated in the last three days: updated:>2025-04-24.