Reduce memory usage in reinforcement learning (#485)

Reduce memory usage in reinforcement learning (#485) #1522