Skip to content

Commit

Permalink
Update index.html
Browse files Browse the repository at this point in the history
  • Loading branch information
entslscheia authored Dec 11, 2024
1 parent d436fb2 commit c69ef8a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion index.html
Original file line number Diff line number Diff line change
Expand Up @@ -384,7 +384,7 @@ <h2>About</h2>
<br><br>
As an AI researcher in general, I’m a fan of <i>compression is intelligence</i>, but <b>NOT</b> a fan of <i>scaling laws</i>. To achieve better compression, the following questions have to be answered.
</p>
<ul class="bullet-list">
<ul>
<li>What’s the alternative to scaling laws for achieving better compression? Should we combine weights-based compression with symbol-based compression (<i>e.g.</i>, language)? And how?</li>
<li>Closely related to the first question, what tasks are interpolative, and what are not? Our understanding of this question is constantly evolving (<i>e.g.</i>, how many people considered learning natural language grammar an interpolative task a decade ago?). Fortunately, I believe most agent tasks today are still viewed as non-interpolative, which motivates us to explore solutions beyond scaling laws using agent tasks as testbeds.</li>
</ul>
Expand Down

0 comments on commit c69ef8a

Please sign in to comment.