Code

False positives negatives rate#67

Code

Open

mrkickling wants to merge 13 commits intomainmal-lang/mal-simulator:mainfrom false-positives-negatives-ratemal-lang/mal-simulator:false-positives-negatives-rateCopy head branch name to clipboard

+494-17

Commits

Commits on Oct 21, 2024

• Implement false positive/negative rates in scenario

  Show description for 40d3a9f
  mrkickling

  committed
  40d3a9f

  Copy full SHA for 40d3a9f

• Add fp/np rates info to the README

  mrkickling

  committed
  6bd9d0d

  Copy full SHA for 6bd9d0d

• Add test for applying false positive/negative rates in scenario file

  mrkickling

  committed
  a744baf

  Copy full SHA for a744baf

• Add testdata

  mrkickling

  committed
  151f4fb

  Copy full SHA for 151f4fb

• Apply false negatives in MalSimulator defense observation

  mrkickling

  committed
  301db4c

  Copy full SHA for 301db4c

• Test that 100% false negative rate is applied

  mrkickling

  committed
  a8df8e5

  Copy full SHA for a8df8e5

• Split up the default defender obs and the false pos/neg logic, Add support for false positives

  mrkickling

  committed
  e02b160

  Copy full SHA for e02b160

• Remove base false positive/negative rates

  mrkickling

  committed
  428864d

  Copy full SHA for 428864d

• Test false positive

  mrkickling

  committed
  4dde3d9

  Copy full SHA for 4dde3d9

• Reset rng with seed in MalSimulator.reset

  mrkickling

  committed
  6c4699c

  Copy full SHA for 6c4699c

• Add test to test deterministic simulation when seed is given

  mrkickling

  committed
  12c2cda

  Copy full SHA for 12c2cda

• Test to make sure agents seed makes actions deterministic

  mrkickling

  committed
  5494b3a

  Copy full SHA for 5494b3a

• Add test that assert deterministic fp/fn observation when seed is given to both agent and simulator

  mrkickling

  committed
  f4b0f83

  Copy full SHA for f4b0f83