diff --git a/_posts/papers-of-the-month/2024-09/2024-09-30-proper-conditioning.md b/_posts/papers-of-the-month/2024-09/2024-09-30-proper-conditioning.md index 7f8bb89..aaac5b4 100644 --- a/_posts/papers-of-the-month/2024-09/2024-09-30-proper-conditioning.md +++ b/_posts/papers-of-the-month/2024-09/2024-09-30-proper-conditioning.md @@ -22,10 +22,10 @@ We're pleased to share four papers from different domains: LLM self-correction, 1. DeepMind researchers explain how _conditioning on the wrong distribution_ during supervised fine-tuning for self-correction is harmful but can be overcome using RL. 2. A novel Smooth-SwiGLU activation _"conditions" the numerics_ by inserting a scaling factor in just the right place, preventing late-training instability in FP8. -3. The GenMS architecture generates crystal structures for materials _conditions on high-level textual and low-level structural information_ for high-quality generation. +3. The GenMS architecture that generates crystal structures for materials _conditions on high-level textual and low-level structural information_ for high-quality generation. 4. SOAP is an evolution of Shampoo, with conditioners in the name and _preconditioners forming the eigenbasis_ for optimisation. -You can be the judge of how tenuous the connection is, but I'd encourage you to check out the summaries first or despite this. +You can be the judge of how tenuous the connection is, but we'd encourage you to check out the summaries first or despite this. _I hope you enjoy these as much as we did. Tell us we're wrong; tell us we're right [@GCResearchTeam](https://x.com/GCResearchTeam)._