Task Logs

Tasks

• [] Address the OOD issues with data sharing
• [] Implement and test FedCurv and FedFish
• [] Run the Modular sharing scheme and potentially implement other add-on method

Now, adopt the simplest setting that uses global labels, and contrastive learning (?)

New Tasks

• Sanity check Recv and Sender data sharing. Weak baselines: rand_send and rand_query.
• TODO: add monitoring, and use recv data during training struct as well for modular network. Currently, experiencing catrastrophic forgetting on old task due to the domination of new task (prolly?)
• Run large-scale sanity check experiments for module sharing using task similarity.
• Revisit contrastive learning for CIFAR-100.