You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While I don't have updated benchmarks to share yet, the response time on many questions is quite a bit faster. The agent will now re-use functions that are human-validated vs. re-generating new functions all of the time. I've also reduced the number of messages required to answer a question.
For example, note this took ~5 seconds vs 40+ seconds:
time llm "average ec2 cpu utilization"
The average CPU utilization of your EC2 instances over the past hour is approximately 5.20%.
llm "average ec2 cpu utilization" 0.22s user 0.07s system 5% cpu 4.935 total
Currently the CLI has a response time of ~40 sec when answering an AWS-related question.
Look into options for improving the performance.
The text was updated successfully, but these errors were encountered: