Skip to content

Commit

Permalink
Fix spelling
Browse files Browse the repository at this point in the history
  • Loading branch information
DouglasOrr committed Sep 30, 2024
1 parent 87f7203 commit 011c8a2
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -22,10 +22,10 @@ We're pleased to share four papers from different domains: LLM self-correction,

1. DeepMind researchers explain how _conditioning on the wrong distribution_ during supervised fine-tuning for self-correction is harmful but can be overcome using RL.
2. A novel Smooth-SwiGLU activation _"conditions" the numerics_ by inserting a scaling factor in just the right place, preventing late-training instability in FP8.
3. The GenMS architecture generates crystal structures for materials _conditions on high-level textual and low-level structural information_ for high-quality generation.
3. The GenMS architecture that generates crystal structures for materials _conditions on high-level textual and low-level structural information_ for high-quality generation.
4. SOAP is an evolution of Shampoo, with conditioners in the name and _preconditioners forming the eigenbasis_ for optimisation.

You can be the judge of how tenuous the connection is, but I'd encourage you to check out the summaries first or despite this.
You can be the judge of how tenuous the connection is, but we'd encourage you to check out the summaries first or despite this.

_I hope you enjoy these as much as we did. Tell us we're wrong; tell us we're right [@GCResearchTeam](https://x.com/GCResearchTeam)._

Expand Down

0 comments on commit 011c8a2

Please sign in to comment.