Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Autogen integration #142

Merged
merged 50 commits into from
Apr 9, 2024
Merged

Autogen integration #142

merged 50 commits into from
Apr 9, 2024

Conversation

nerfZael
Copy link
Contributor

@nerfZael nerfZael commented Apr 4, 2024 •
edited
Loading

Autogen framework integration

@nerfZael
Copy link
Contributor Author

nerfZael commented Apr 4, 2024

/workflows/benchmarks agents/token 10

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 4, 2024 •
edited
Loading

Finished benchmarks

Test Run Summary

  • Run from: ./autotx/tests/agents/token
  • Iterations: 10
  • Total Success Rate: 85.50%

Detailed Results

Test Name Success Rate Passes Fails Avg Time
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_eth 80% 8 2 41s
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_erc20 70% 7 3 41s
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_eth_sequential 90% 9 1 1.19m
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_erc20_parallel 80% 8 2 55s
autotx/tests/agents/token/send/test_send_with_tasks.py::test_send_tokens_agent 100% 10 0 23s
autotx/tests/agents/token/send/test_send_with_tasks.py::test_send_tokens_agent_with_check_eth 90% 9 1 27s
autotx/tests/agents/token/send/test_send_with_tasks.py::test_send_tokens_agent_with_check_erc20 90% 9 1 28s
autotx/tests/agents/token/test_swap.py::test_auto_tx_swap_with_non_default_token 80% 8 2 1.18m
autotx/tests/agents/token/test_swap.py::test_auto_tx_swap_eth 100% 10 0 60s
autotx/tests/agents/token/test_swap.py::test_auto_tx_swap_multiple 90% 9 1 50s
autotx/tests/agents/token/test_swap_and_send.py::test_auto_tx_swap_and_send_simple 40% 4 6 53s
autotx/tests/agents/token/test_swap_and_send.py::test_auto_tx_swap_and_send_complex 50% 5 5 1.13m
autotx/tests/agents/token/test_token_research.py::test_price_change_information 100% 10 0 14s
autotx/tests/agents/token/test_token_research.py::test_token_general_information 90% 9 1 27s
autotx/tests/agents/token/test_token_research.py::test_get_token_exchanges 100% 10 0 15s
autotx/tests/agents/token/test_token_research.py::test_check_liquidity 80% 8 2 18s
autotx/tests/agents/token/test_token_research.py::test_get_top_5_tokens_from_base 100% 10 0 31s
autotx/tests/agents/token/test_token_research.py::test_get_top_5_most_traded_tokens_from_l1 100% 10 0 27s
autotx/tests/agents/token/test_token_research.py::test_get_top_5_memecoins 100% 10 0 26s
autotx/tests/agents/token/test_token_research.py::test_get_top_5_memecoins_in_optimism 80% 8 2 25s

Total run time: 128.52 minutes

@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@nerfZael
Copy link
Contributor Author

nerfZael commented Apr 5, 2024

/workflows/benchmarks agents/token 10

@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 5, 2024 •
edited
Loading

Finished benchmarks

Test Run Summary

  • Run from: ./autotx/tests/agents/token
  • Iterations: 10
  • Total Success Rate: 83.33%

Detailed Results

Test Name Success Rate Passes Fails Avg Time
autotx/tests/agents/token/research/test_research.py::test_price_change_information 80% 8 2 18s
autotx/tests/agents/token/research/test_research.py::test_get_token_exchanges 100% 10 0 16s
autotx/tests/agents/token/research/test_research.py::test_check_liquidity 70% 7 3 17s
autotx/tests/agents/token/research/test_research.py::test_get_top_5_tokens_from_base 100% 10 0 30s
autotx/tests/agents/token/research/test_research.py::test_get_top_5_most_traded_tokens_from_l1 100% 10 0 29s
autotx/tests/agents/token/research/test_research.py::test_get_top_5_memecoins 100% 10 0 26s
autotx/tests/agents/token/research/test_research.py::test_get_top_5_memecoins_in_optimism 100% 10 0 25s
autotx/tests/agents/token/research/test_research_and_swap.py::test_auto_tx_research_and_swap_meme_token 100% 10 0 26s
autotx/tests/agents/token/research/test_research_and_swap.py::test_auto_tx_research_swap_and_send_governance_token 0% 0 10 34s
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_eth 100% 10 0 17s
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_erc20 100% 10 0 19s
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_eth_sequential 100% 10 0 27s
autotx/tests/agents/token/send/test_send.py::test_auto_tx_send_erc20_parallel 100% 10 0 27s
autotx/tests/agents/token/test_swap.py::test_auto_tx_swap_with_non_default_token 0% 0 10 15s
autotx/tests/agents/token/test_swap.py::test_auto_tx_swap_eth 100% 10 0 16s
autotx/tests/agents/token/test_swap.py::test_auto_tx_swap_multiple 100% 10 0 21s
autotx/tests/agents/token/test_swap_and_send.py::test_auto_tx_swap_and_send_simple 100% 10 0 22s
autotx/tests/agents/token/test_swap_and_send.py::test_auto_tx_swap_and_send_complex 50% 5 5 32s

Total run time: 69.65 minutes

@nerfZael nerfZael changed the title [WIP] Autogen integration Autogen integration Apr 5, 2024
@nerfZael nerfZael requested review from cbrzn and dOrgJelli and removed request for cbrzn April 5, 2024 18:32
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
@agentcoinorg agentcoinorg deleted a comment from github-actions bot Apr 5, 2024
nerfZael and others added 23 commits April 8, 2024 16:52
@nerfZael
removed extra web3
79e7132
@cbrzn
fix: weth swap
1156e57
@nerfZael
Merge pull request #152 from polywrap/fix/weth-swap
7b99724 
fix: weth swap
@cbrzn
chore: handle failed tx executions
d84a817
@nerfZael
cleaner logs and verbose mode added
7fefd84
@nerfZael
updated logging
aff4a90
@cbrzn
chore: improve .env.example and add default infura api key
2f579d0
@cbrzn
chore: add color to error message
13431b9
@cbrzn
chore: merge with latest changes
89cb0da
@nerfZael
Merge pull request #148 from polywrap/nerfzael/individual-benchmark-t…
d66dad9 
…ests

Run multiple individual paths in benchmarks
@nerfZael
Merge pull request #154 from polywrap/nerfzael/cleaner-logs
912781b 
Cleaner logs and verbose mode
@nerfZael
Merge remote-tracking branch 'origin/nerfzael/autogen' into nerfzael/…
e079ba0 
…prompt-as-argument
@nerfZael
Merge pull request #151 from polywrap/nerfzael/prompt-as-argument
12c953b 
Prompt can now be added as an argument
@nerfZael
Merge pull request #150 from polywrap/chore/coingecko-api-optional
0190f42 
chore: coingecko api env variable is optional
@nerfZael
Merge pull request #153 from polywrap/chore/handle-failed-transactions
bfb916e 
chore: handle failed tx execution
@cbrzn
Merge branch 'nerfzael/autogen' into fix/env-example
4a71e25
@nerfZael
cleaned up agent and tool definitions
923fac9
@nerfZael
Merge pull request #155 from polywrap/fix/env-example
10087e6 
chore: improve `.env.example` and add default infura api key
@dOrgJelli
Merge pull request #156 from polywrap/nerfzael/clean-agent-definitions
48b9b89 
Cleaned up agent and tool definitions
@dOrgJelli
chores: imports, example agent, typos
feff473
@dOrgJelli
chore: .env.example touchup
ae36e49
@dOrgJelli
chore: fix example agent name + env loading
08fb250
@dOrgJelli
chore: add AutoTx to root index file
7750228
dOrgJelli
dOrgJelli approved these changes Apr 9, 2024
View reviewed changes
autotx/utils/ethereum/uniswap/swap.py Show resolved Hide resolved
autotx/AutoTx.py
)
manager = GroupChatManager(groupchat=groupchat, llm_config=self.get_llm_config())

if silent:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

While this turns everything off, I'd like to find a way for our agents to log important information to the user. If you ask purely informational questions of the agent, it won't print anything informative. For example, "What's the price of ETH?" doesn't print anything when run without --verbose.

This is something we can improve in a future PR.

@dOrgJelli dOrgJelli merged commit 5ef1d24 into main Apr 9, 2024
This was referenced Apr 9, 2024
Closed
Closed
Closed
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cbrzn cbrzn cbrzn approved these changes

@dOrgJelli dOrgJelli dOrgJelli approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@nerfZael @dOrgJelli @cbrzn