Keep track of handles of all active tasks in a task factory

Keep track of handles of all active tasks in a task factory #339