Better handling of leftover tasks in a (potentially large) task queue

[tomreitz]

This thread includes discussion of how to restructure the processing of task queues in batches so that we don't have to include a final block to process any leftover tasks in the queue. @johncmerfeld proposed a way to do that but @tomreitz pointed out possible memory impact of his solution - opening this issue so we don't forget to consider better solutions.