Elastic Weight Consolidation

In collaboration with Warren Sunada-Wong.

This repo replicates Elastic Weight Consolidation (EWC), as defined in Kirkpatrick et al.'s "Overcoming catastrophic forgetting in neural networks". Run experiments via python runner.py. See python runner.py -h for params.

Results

Task 0 Test Accuracy	Task 1 Test Accuracy	Task 2 Test Accuracy

Citation

@article{kirkpatrick2017overcoming,
  title={Overcoming catastrophic forgetting in neural networks},
  author={Kirkpatrick, James and Pascanu, Razvan and Rabinowitz, Neil and Veness, Joel and Desjardins, Guillaume and Rusu, Andrei A and Milan, Kieran and Quan, John and Ramalho, Tiago and Grabska-Barwinska, Agnieszka and others},
  journal={Proceedings of the national academy of sciences},
  volume={114},
  number={13},
  pages={3521--3526},
  year={2017},
  publisher={National Acad Sciences}
}