Skip to content

Commit

Permalink
copy
Browse files Browse the repository at this point in the history
  • Loading branch information
paul-gauthier committed Dec 19, 2023
1 parent d36c18f commit 7028a53
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/unified-diffs.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,6 @@

![robot flowchart](../assets/benchmarks-udiff.svg)


Aider now asks GPT-4 Turbo to use
[unified diffs](#choose-a-familiar-editing-format)
to edit your code.
Expand All @@ -29,9 +28,10 @@ This new laziness benchmark produced the following results with `gpt-4-1106-prev
- **Aider's new unified diff edit format raised the score to 61%**. Using this format reduced laziness by 3X, with GPT-4 Turbo only using lazy comments on 4 of the tasks.
- **It's worse to add a prompt that the user is blind, has no hands, will tip $2000 and fears truncated code trauma.**

The widely circulated "blind with no hands" type of folk remedies
performed worse on the benchmark when added to the system prompt.
The benchmark scores dropped
These widely circulated "emotional appeal" folk remedies
produced worse benchmark scores.
Adding *all* of these claims to the system prompt
resulted in worse benchmark scores
for the baseline SEARCH/REPLACE and new unified diff editing formats.
These prompts did somewhat reduce the amount of laziness when used
with the SEARCH/REPLACE edit format,
Expand Down

0 comments on commit 7028a53

Please sign in to comment.