Beam Search

ToDo

• Read the paper and summarize decoder implementation part
  • 1.Read the paper
• Understand more about LSTM about how it outputs. Once I understand it, I think I can know where to implement beam search in decoder.
  • 2.LSTM decode detail
• Read the paper and summarize beam search
  • 3.Understand Beam Search
• Read the implementation and confirm the understanding above is right
  • 4.Visit seq2seq implmentation
• Revisit Beam Search Discussion again.
  • 5.Revisit Beam Search Discussion
• How we get probabilities from each step of beam search?
  • 6.How to get probabilities
• 7.Implement Beam Search on Python side
• Revisit the discussion again and see if there's anything reusable
  • 8.Revisit Beam Search Discussion Again
• 9.Debug attention_decoder
• 10.Debug-beam_search=True