feat(bench): support safety attack #851
Conversation
Codecov ReportAttention: Patch coverage is
@@ Coverage Diff @@
## main #851 +/- ##
==========================================
- Coverage 70.15% 68.50% -1.66%
==========================================
Files 80 81 +1
Lines 3569 3655 +86
==========================================
Hits 2504 2504
- Misses 1065 1151 +86
|
There was a problem hiding this comment.
please ignore this dataset file. This should not be included.
pyproject.toml
Outdated
There was a problem hiding this comment.
this dependency was changed due to @chengzr01 's suggestions. maybe we need to double consider that.
It works well on server deployment. Is the error related to poetry version? Maybe we need to set it as >=2.2.1 < 2.5.0
| with open('./adversarial_prompts.json', 'r', encoding='utf-8') as f: | ||
| adversarial_data = json.load(f) | ||
|
|
||
| # θ―»ε task.csv ζδ»ΆεΉΆζε»Ί task ε° domain ηζ ε° |
There was a problem hiding this comment.
avoid chinese character in the code.
| raise ValueError('Failed to generate proposal') | ||
|
|
||
|
|
||
| def write_proposal_researchtown_nodb( |
There was a problem hiding this comment.
what does this nodb stands for? you init db class, right?
| @@ -29,8 +29,14 @@ def __init__( | |||
| @beartype | |||
| def on_enter(self, **context: Any) -> None: | |||
| # Assign leader and members from context or sample them | |||
| self.leader = context.get('leader', self.agent_manager.sample_leader()) | |||
| self.members = context.get('members', self.agent_manager.sample_members()) | |||
| if context.get('leader') is None: | |||
There was a problem hiding this comment.
can you help change all the things in all environment files here? this is a potential bug in research-town
Closes #
π Description
β Checks
type/descript(e.g.feature/add-llm-agents)βΉ Additional Information