Skip to content

Commit

Permalink
Update lite
Browse files Browse the repository at this point in the history
  • Loading branch information
carlosejimenez committed Mar 19, 2024
1 parent 85970b3 commit eb5d495
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions lite.html
Original file line number Diff line number Diff line change
Expand Up @@ -116,12 +116,12 @@ <h3>A Canonical Subset for Efficient Evaluation of Language Models as Software E
</div>
</div>
<br/>
<img src="img/swebench-Lite-pie.png" style="width: 50%; max-width: 400px; margin: auto; display: block;"/>
<img src="img/swebench-lite-pie.png" style="width: 50%; max-width: 400px; margin: auto; display: block;"/>
<p class="text-content" style="width: 50%; margin: auto; text-align: center;">
SWE-bench Lite distribution across repositories. Compare to the full SWE-bench in Figure 3 of the <a href="https://arxiv.org/abs/2310.06770">SWE-bench paper</a>.
</p>
</br>
<img src="img/swe-bench_Lite_results.png" style="width: 50%; max-width: 400px; margin: auto; display: block;"/>
<img src="img/swe-bench_lite_results.png" style="width: 50%; max-width: 400px; margin: auto; display: block;"/>
<p class="text-content" style="width: 50%; margin: auto; text-align: center;">
SWE-bench Lite performance for our baselines. Compare to the full SWE-bench baseline performance in Table 5 of the <a href="https://arxiv.org/abs/2310.06770">SWE-bench paper</a>.
</p>
Expand Down

0 comments on commit eb5d495

Please sign in to comment.