streamparse 2.1.0

Features

• Added back an updated version of the pre-2.0 BatchingBolt that did not rely on tick tuples called TicklessBatchingBolt. This is useful in cases where you know your spout will not replay tuples after a topology shutdown. Because Storm is not guaranteed to continue to send tick tuples when the topology is shutting down, the standard BatchingBolt may have a batch of tuples waiting to be processed (that were never ACKed) sitting in it when the topology shuts down. When you resubmit and start it back up, those tuples will be lost unless the spout saves state between runs (which is pretty uncommon). With the TicklessBatchingBolt this is much less likely to happen because we use a timer thread which is independent of Storm, which will continue to execute even while the topology is shutting down. As long as the time you give Storm to shutdown is greater than the time it takes to process the last batch, your last batch will always be fully processed. (PR #191)
• Can now specify virtualenv command-line arguments in config.json via virtualenv_flags (issue #94, PR #159)
• Added support for pulling out source->stream->fields mapping with Storm 0.10.0+ (commit 61f163d)

Bug fixes

• Restored --version argument to sparse that was accidentally removed in previous release. (commit 48b6de7)
• Fixed missing comma in setup.py (issue #160, commit bde3cc3)
• Fixed issue where an empty tasks.py file (for invoke) was necessary to make fabric pre-submit hooks work. (issue #157, commit a10c478)
• Fixed issue where run and submit couldn't parse email addresses and git hashes properly (PR #189, thanks @eric7j, commit 8670e3f)
• Fixed issue where fabric env wasn't being populated when use_virtualenv was False (commit a10c478)
• Fixed issue where updating virtualenvs would hang when VCS path changed. (commits e923a3c and 3e27cf0)

Documentation

• Added documentation that explains how parallelism and workers work in Storm and streamparse. (issue #163, PR #165)
• Added documentation about tuple routing and direct streams. (issue #162, commit fff05a0)
• Fixed some inconsistencies in the capitalization of Bolt and Spout in our docs (issue #164, PR #166)
• Embedded PyCon 2015 presentation video in docs. (PR #161)
• Added some more FAQs to docs. (PR #88, thanks @konarkmodi)

Depedencies

• simplejson is now a required dependency instead of just recommended (commit 08ef3d4)
• Updated invoke requirements to now require 0.8 or later (commit 360128c)
• Updated requirements to specify six >= 1.5 specifically to avoid issues for OS X users (issues #113 and #190, commit a0c1309)