Release v-0.20.0-incubating-candidate-2

• Remove icomoon usage from tools/ui (#2999)
• Move license header in react dom components (#3003)
• chmodcicheck (#3002)
• fixunit (#3001)
• fixunit (#3000)
• enablebypassintegrationtests (#2997)
• Fix the handling of container number in api server (#2995)
• Nwang/make spout/bolt compatible to storm 1.x (#2993)
• get back newParallelism ifelse branch (#2992)
• Add gitattributes to remove website directory from archive (#2996)
• remove crreal BUILD file (#2988)
• Chmod travis ci.sh (#2991)
• Revert mode change in sh files (#2990)
• Nwang/clean trailing white space (#2989)
• Yaoli/test (#2987)
• use cereal lib configured in WORKSPACE (#2986)
• Extending update command to allow number of containers to be modified at runtime (#2980)
• Metrics added to measure the rate at which tuples are added to the queue at spout gateway (#2981)
• Nwang/add missing licenses (#2984)
• Docker Ubuntu tweaks (#2975)
• update license information (#2977)
• [healthmgr] fix style (#2983)
• fixsimportimport (#2982)
• [healthmgr] refactor physicalplanprovider and topologyprovider (#2979)
• Adding average Serialization/Deserialization time per tuple (#2976)
• Update error message in RuntimeManagerMain when an exception is catched (#2974)
• Fixed Spelling. (#2971)
• package c++ .h and .a files (#2961)
• spill state to local disk when configured (#2967)
• fix metrics name (#2970)
• fixing download issue in Nomad scheduler (#2969)
• Upgrade to the latest Dhalion (#2968)
• (Ok To Merge) updating docker scripts (#2963)
• Fix supervisor installation in Centos 7 Dockerfile (#2966)
• add integration test for instance state in stateful processing (#2956)
• joshfischer/update k8s docs (#2960)
• Counting pending tuples (#2951)
• Make checkpoint manager's ram configurable (#2958)
• Added endpoint to tracker to fetch packing plan. (#2959)
• [aurora] add metadata support for aurora (#2934)
• Refactor StatefulStorage API (#2891)
• Add log in Bolt/Spout instances after persisting state (#2954)
• Nwang/fix negative index caused by hash mod (#2953)
• Counting pending tuples (#2945)
• Revert the latest version number change of scala rules (#2943)
• [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy (#2923)
• Universal heronpy (#2948)
• added S3 uploader configuration in Helm chart (#2939)
• modify travis ci to enable integration topology test (#2940)
• add tmaster physical plan endpoint (#2941)
• add integration topology test (#2938)
• Add component config in heron UI and Tracker (#2860)
• Make TopologyBuilder less permissive (#2929)
• Clean up website gen + website python docs (#2928)
• make EvitionContext extend Serializable (#2935)
• Clean up remaining dead references to Twitter (#2930)
• Upgrade to Bazel 0.14.1 (#2932)
• Fix code when submitting a toplogy file without an known extension (#2933)
• Update governance.md and clean up Twitter related content (#2926)
• Add JDK/JAVA_HOME to bazel_configure.py (#2921)
• Fix integer types to avoid warnings (#2922)
• Correct case of acronyms (#2920)
• Add permissive licence to libunwind (#2914)
• Add DISCLAIMER file required by Apache policy (#2916)
• make LocalFSStorage clean checkpoints before store (#2910)
• refactor healthmgr build (#2912)
• refactor downlaoder build (#2911)
• reorder (#2908)
• log the object when it cannot be serialized when emitting tuples (#2905)
• Making emit, ack, and fail thread safe (#2692)
• add .htaccess and index.html [https://github.com//issues/2758] (#2872)
• Make MetricsManager.java a target so that it can be customized (#2902)
• cleaning removed directory (#2903)
• Refactor CheckpointManager to move initialization code out of constructor (#2901)
• Add extra info when failed to create new instance of class (#2870)
• add documentation about nomad consul integration (#2898)
• add src export (#2899)
• submit topology file by uri (#2886)
• move downloader registry map to yaml (#2884)
• Nwang/update license in other files (#2895)
• fixing test (#2894)
• Refactoring Nomad documentation and add documentation on running heron via docker on Nomad (#2876)
• Update license text in py files (#2889)
• pull yaml cpp for official release page (#2893)
• check checkpoint file exists before deleting it (#2883)
• remove thrift and scribe to prepare for apache release (#2879)
• Update license text in yaml files (#2887)
• Update license text in scala files (#2888)
• Update license text in H files (#2885)
• Update license text in java files (#2881)
• Update license text in cpp files (#2882)
• Update NOTICE file (#2878)
• Scala Streamlet API Documentation is being added (#2871)
• add .htaccess and index.html [https://github.com//issues/2758] (#2869)
• Fix kryo factor config (#2868)
• Add extra info when failed to create new instance of class (#2867)
• improving nomad launch script (#2862)
• k8s ensure response body is closed after reading an error. (#2863)
• [Streamlet Scala API] Add Scala Streamlet Integration Tests Part II (#2861)
• fix healthmgr metrics (#2839)
• Integrate runtime config and rate limit (#2846)
• package rename and related fixes (#2853)
• Align MetricsCacheMgr location discovery in Stmgr (#2797)
• Update Dhalion dependency version (#2821)
• [Streamlet Scala API] Add Scala Streamlet Integration Tests Part I (#2826)
• Rate limit needs to be disabled before the bufferevent_free call (#2848)
• Add sha256 checksums for all http_archives (#2856)
• expose heron metrics as a service in Nomad (#2859)
• Add two backup urls for zookeeper (#2857)
• Joshfischer/eco stateful topology (#2851)
• Eco for heron topologies (#2849)
• Add json format for dry-run (#2842)
• add config for apiserver overrides (#2845)
• While emitting in spout, adhere to the batch size limit (#2798)
• avoid make install for libunwind (#2844)
• Heron JavaDoc and Documentation Fixes (#2838)
• removed glog/gperftools/libevent/libunwind/zookeeper tar.gz from source (#2833)

Release v-0.20.0-incubating-candidate-1

• Docker Ubuntu tweaks (#2975)
• update license information (#2977)
• [healthmgr] fix style (#2983)
• fixsimportimport (#2982)
• [healthmgr] refactor physicalplanprovider and topologyprovider (#2979)
• Adding average Serialization/Deserialization time per tuple (#2976)
• Update error message in RuntimeManagerMain when an exception is catched (#2974)
• Fixed Spelling. (#2971)
• package c++ .h and .a files (#2961)
• spill state to local disk when configured (#2967)
• fix metrics name (#2970)
• fixing download issue in Nomad scheduler (#2969)
• Upgrade to the latest Dhalion (#2968)
• (Ok To Merge) updating docker scripts (#2963)
• Fix supervisor installation in Centos 7 Dockerfile (#2966)
• add integration test for instance state in stateful processing (#2956)
• joshfischer/update k8s docs (#2960)
• Counting pending tuples (#2951)
• Make checkpoint manager's ram configurable (#2958)
• Added endpoint to tracker to fetch packing plan. (#2959)
• [aurora] add metadata support for aurora (#2934)
• Refactor StatefulStorage API (#2891)
• Add log in Bolt/Spout instances after persisting state (#2954)
• Nwang/fix negative index caused by hash mod (#2953)
• Counting pending tuples (#2945)
• Revert the latest version number change of scala rules (#2943)
• [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy (#2923)
• Universal heronpy (#2948)
• added S3 uploader configuration in Helm chart (#2939)
• modify travis ci to enable integration topology test (#2940)
• add tmaster physical plan endpoint (#2941)
• add integration topology test (#2938)
• Add component config in heron UI and Tracker (#2860)
• Make TopologyBuilder less permissive (#2929)
• Clean up website gen + website python docs (#2928)
• make EvitionContext extend Serializable (#2935)
• Clean up remaining dead references to Twitter (#2930)
• Upgrade to Bazel 0.14.1 (#2932)
• Fix code when submitting a toplogy file without an known extension (#2933)
• Update governance.md and clean up Twitter related content (#2926)
• Add JDK/JAVA_HOME to bazel_configure.py (#2921)
• Fix integer types to avoid warnings (#2922)
• Correct case of acronyms (#2920)
• Add permissive licence to libunwind (#2914)
• Add DISCLAIMER file required by Apache policy (#2916)
• make LocalFSStorage clean checkpoints before store (#2910)
• refactor healthmgr build (#2912)
• refactor downlaoder build (#2911)
• reorder (#2908)
• log the object when it cannot be serialized when emitting tuples (#2905)
• Making emit, ack, and fail thread safe (#2692)
• add .htaccess and index.html [https://github.com//issues/2758] (#2872)
• Make MetricsManager.java a target so that it can be customized (#2902)
• cleaning removed directory (#2903)
• Refactor CheckpointManager to move initialization code out of constructor (#2901)
• Add extra info when failed to create new instance of class (#2870)
• add documentation about nomad consul integration (#2898)
• add src export (#2899)
• submit topology file by uri (#2886)
• move downloader registry map to yaml (#2884)
• Nwang/update license in other files (#2895)
• fixing test (#2894)
• Refactoring Nomad documentation and add documentation on running heron via docker on Nomad (#2876)
• Update license text in py files (#2889)
• pull yaml cpp for official release page (#2893)
• check checkpoint file exists before deleting it (#2883)
• remove thrift and scribe to prepare for apache release (#2879)
• Update license text in yaml files (#2887)
• Update license text in scala files (#2888)
• Update license text in H files (#2885)
• Update license text in java files (#2881)
• Update license text in cpp files (#2882)
• Update NOTICE file (#2878)
• Scala Streamlet API Documentation is being added (#2871)
• add .htaccess and index.html [https://github.com//issues/2758] (#2869)
• Fix kryo factor config (#2868)
• Add extra info when failed to create new instance of class (#2867)
• improving nomad launch script (#2862)
• k8s ensure response body is closed after reading an error. (#2863)
• [Streamlet Scala API] Add Scala Streamlet Integration Tests Part II (#2861)
• fix healthmgr metrics (#2839)
• Integrate runtime config and rate limit (#2846)
• package rename and related fixes (#2853)
• Align MetricsCacheMgr location discovery in Stmgr (#2797)
• Update Dhalion dependency version (#2821)
• [Streamlet Scala API] Add Scala Streamlet Integration Tests Part I (#2826)
• Rate limit needs to be disabled before the bufferevent_free call (#2848)
• Add sha256 checksums for all http_archives (#2856)
• expose heron metrics as a service in Nomad (#2859)
• Add two backup urls for zookeeper (#2857)
• Joshfischer/eco stateful topology (#2851)
• Eco for heron topologies (#2849)
• Add json format for dry-run (#2842)
• add config for apiserver overrides (#2845)
• While emitting in spout, adhere to the batch size limit (#2798)
• avoid make install for libunwind (#2844)
• Heron JavaDoc and Documentation Fixes (#2838)
• removed glog/gperftools/libevent/libunwind/zookeeper tar.gz from source (#2833)

Release 0.17.8

Release Notes

• update README.md (#2835)
• Fix bug in dry-run argument for update command (#2831)
• removing abstract requirement (#2830)
• [Documentation] Improve Java Streamlet API doc (#2819)
• add rate limit change log in stream manager (#2822)
• Fix URL issues associated with Hugo upgrade (#2825)
• More website fixes (#2824)
• Update Git submodule URL for GitHub pages branch (#2823)
• update baseURL for site generation (#2820)
• Add missing command line options for runtime config (#2818)
• Allow the apiserver to set the direct memory size. (#2813)
• Add a new tmaster endpoint for runtime config (#2747)
• [Streamlet Scala API] Add Scala Example Support - Part II (#2810)
• Refactor HttpUploader - Part II (#2812)
• Fix comment in heron_internals.yaml (#2811)
• fix library link in WORKSPACE (#2816)
• modified bazel build to include samoa (#2809)
• Nomad docker support (#2804)
• Revert "remove cpu rounding in packing algorithms (#2805)" (#2808)
• Add memory unit to k8s resource request. (#2802)
• remove cpu rounding in packing algorithms (#2805)
• Do not include scribe sink when compiling on non x86 platforms. (#2801)
• Add per component resource config for cpu and disk (#2800)
• Fix a typo and comments/doc for per component rate limit config (#2796)
• [Streamlet Scala API] Add Scala Example Support - Part I (#2791)
• [Streamlet Scala API] Add Scala StreamletImpl Support - Part V (#2790)
• Add rate limiter in stmgr (#2783)
• Correct print errors (#2789)
• Fix error message when large instance is packed (#2784)
• Add a new escaping '(61)' for '=' because the original one '='… (#2785)
• Add runtime config in heron update command (#2760)
• Fix tracker instance groups. (#2782)
• add a switch for metricscache (#2744)
• [healthmgr] add a class to expose metrics to local metricsmgr (#2771)
• [Streamlet Scala API] Add Scala StreamletImpl Support - Part IV (#2767)
• Add a topology config endpoint to the tracker. (#2781)
• Small change to Nomad doc (#2780)
• Retain heron-core package for YARN like schedulers (#2775)
• [Streamlet Scala API] Add Scala StreamletImpl Support - Part III (#2764)
• Builder creation (#2769)
• Fix heron update on k8s. (#2770)
• Improve Communicator tests (#2768)
• [Streamlet Scala API] Add Scala StreamletImpl Support - Part II (#2761)
• fixing bug in wakeable loop causing IndexOutOfBoundException (#2753)
• Fix heron-explorer components command. (#2762)
• Re-organize documentation nav (#2756)
• Add Scala StreamletImpl Support (#2740)
• [API] Improve HeronSubmitter (#2746)

Release 0.17.7

Release Notes

• fix WindowedWordCountTopology (#2755)
• adding additional info to standalone documentation (#2748)
• fix bug in stateful windows (#2754)
• Pass role and environment to hava topoology components. (#2752)
• [HttpUploader] Add Documentation (#2750)
• Fixed example name in getting-started.md (#2751)

Release 0.17.6

Release Notes

• fixing bugs in the API server when downloading files (#2749)
• Documentation for the Nomad scheduler (#2723)
• Allowing API Server to distribute heron core package (#2724)
• Allow user to run kill command when some topology data is missing (#2730)
• [#2735 follow up] move out of core into aurora scheduler (#2741)
• Fix installation docs (#2742)
• add warning when aurora job add command fails during heron update (#2735)
• add topology version in tracker runtimestate (#2739)
• include eco into storm compatibility jar (#2736)
• JavaCheckstyle fix for IntelliJ setup script (#2738)
• [healthmgr] add healthmgr src exportation (#2734)
• Check that current process is not session master (#2731)
• update heron version in config.yaml (#2732)

Release 0.17.5

Release Notes

• Refactor hostname logic (#2718)
• Add Sink Trait Support (#2726)
• Log configs in packing algorithms (#2727)
• Joshfischer/eco docs redeux (#2703)
• fix null in printout during submission (#2722)
• use actual path (#2725)
• Simplify website setup (#2721)
• deprecate RRPacking in default config (#2717)
• adding some confs for heron nomad and standalone (#2716)
• fix a RRrepacking bug (#2720)
• mitigate prompt (#2719)
• [Streamlet Scala API] Add FunSuite Support (#2695)
• Move stmgr quitting logic from stmgr client to tmaster client (#2711)
• fixes the helm chart, config and api server memory restriction for k8s (#2714)
• Expose the component config through the tracker. (#2709)
• Add Streamlet Trait Support (#2696)
• HttpUploader is being refactored. (#2713)
• [metricscache] align metricscache toggle switch (#2707)
• [metricscache] reduce exception stack trace to first 2 lines (#2706)
• [metricscache] make default log level to INFO (#2705)
• Fix sandbox script (#2710)
• modify language in sandbox.sh script (#2708)
• added sandbox script to deploy heron in a single docker (#2704)
• Fix src and java doc generation for heron-api (#2702)
• Necessary software for single docker image (#2701)
• make heron core distribution - symbolic linkable (#2684)
• depend on java protobuf target from protobuf sources (#2640)
• Clean up simulator/utils (#2674)
• [Streamlet Scala API] Add initial Build Files (#2688)
• Add tolerations to tools and apiserver deploymens for kubernetes. (#2687)
• expose heron tracker as a service (#2686)
• no need to check the existence of env_exec.sh in scripts/setup-intellij.sh (#2683)

Release 0.17.4

Release Notes

• Add Download hostname override config (#2680)
• fix mismatch container id between packing alg and aurora (#2582)
• add section on setting the service URL for a standalone cluster (#2682)
• Heron standalone docs update (WIP) (#2676)
• JSON output for heron-admin standalone cluster info command (#2675)
• Don't drop tuples during backpressure in DrainTupleStream (cross stream manager traffic) (#2679)
• Remove cmake requirement in bazel configure (#2661)
• Add k8s pod tolerations for topologies. (#2677)
• Heron standalone mode documentation (WIP) (#2614)
• move scripts/docker to scripts/images (#2672)
• Kubernetes installation with Helm docs (#2606)
• Use the minimal ram size for components instead of the last one (#2659)
• Fix for running topologies with DC/OS 1.10 or Marathon 1.5 (#2670)
• moved eco to the top level (#2669)
• Add support for custom evictor and trigger policies (#2653)
• modified the helm chart (#2668)
• Update k8s stateful sets termination and pod management. (#2666)
• Add no checkstyle build targets (#2660)
• update README.md [https://github.com//issues/2664] (#2665)
• RoundRobinPacking implements IRepacking (#2600)

Release 0.17.3

Release Notes

• ECO topology using YAML(#2658)
• Fixing the slurm scheduler (#2657)
• Updated to use brew delivered bazel (#2655)
• Fix a typo in comment (#2654)
• Add k8s support for aws ebs volume mounts. (#2650)
• Increase wait time in MetricsCacheSinkTest and TMasterSinkTest (#2646)
• added a quick fix (#2652)
• Decouple increment and log to avoid potential error (#2644)
• bookkeeper using emptyDir (#2649)
• Fix aurora scheduler (#2645)
• make the yaml cpp tarball (#2648)
• Refactoring and improving standalone mode (#2633)
• Add python encoding (#2631)
• keep topology defn during update (#2602)
• Refactor aurora scheduler to use SchedulerUtils to construct arguments (#2632)
• Update docker build images with bazel 0.9.0 (#2641)
• Move the logical plan format to the tracker. (#2639)
• move to bazel 0.9.0 and cleanups (#2637)
• Add instance groups to the physical plan response. (#2636)
• added targets for heron tools, heron and heron-core (#2635)

Release 0.17.2

Release Notes

• [Streamlet] Reinforce usage of StreamletNamePrefixes for more type-safety (#2627)
• Add cluster role and environment info to sink context. (#2634)
• Multi node standalone cluster for heron (#2611)
• Add new state-manager-config-file argument for aurora (#2630)
• Fix unit tests (MetricsCacheSinkTest, TMasterSinkTest) (#2629)
• remove problematic link (#2628)
• Fix website asset pipeline + add publish script (#2626)
• Revert "Fix website asset pipeline + add publish script (WIP) (#2624)" (#2625)
• Fix website asset pipeline + add publish script (WIP) (#2624)
• use gtest as a artifact rather than a tarball (#2623)
• use cereal from artifact rather than a tarball (#2622)
• use protobuf artifactory rather than tarball (#2621)
• use gflags as a artifact instead of tar ball (#2620)
• Fix api server create config cluster mode. (#2617)
• generate helm charts (#2619)
• generate docker image and push for development (#2613)
• Refactor heron client main.py (#2607)
• convert git repo for bazel dockers rules to artifiact (#2618)
• Fix bookkeeper statefulset yaml. (#2609)
• make a single heron package for each platform, removed api, tools, cl… (#2608)
• update java API docs (#2604)
• Kubernetes configuration (#2507)
• change version and add index to package (#2603)
• use bazel docker rules (#2545)
• adding Nomad scheduler support for Heron (#2601)
• Add nfs volumes to kubernetes. (#2598)
• Assign pplan helper before doing state activate. (#2599)
• easy install for kubernetes (#2590)
• Add ability for users to allow tuple drops upon backpressure detection (#2593)
• Add null protection in config translation code (#2597)
• imporve print (#2594)
• Use yaml lib to generate override.yaml (#2596)
• [Streamlet] Support abstraction and type safety more (#2589)
• Add config translations for getComponentConfiguration() (#2592)
• [work in progress] fix a bug for deactivated heron-instance during heron update (#2580)
• Standardize builder interfaces and remove Resources class (#2559)
• Fix gcs bookkeeper apiserver yaml. (#2591)
• Reduce the docker image size (#2578)
• Add the ability to mount volumes for topologies in k8s. (#2588)
• Fix for "Marathon scheduler generates json based on "old method"" (#2583)
• [Streamlet] Small refactoring is proposed and UT coverage is extended (#2570)
• Add ConsumerStreamlet name to stageNames Set to avoid duplication (#2574)
• Add batch support for AuroraScheduler to remove containers (#2579)
• Streamlet theoretical documentation (WIP) (#2452)
• Refactor kubernetes scheduler to use statefulsets. (#2560)
• Fix wrong stmgr log (#2577)
• Log when stmgr broadcasts physical plan (#2573)
• add exception handling for metricscache process (#2572)
• Streamlet API cleanup (#2567)

Release 0.17.1

Highlights

• BugFixes

Release Notes

• remove unused kubernetes config (#2568)
• bump version (#2569)
• Fix sample ComponentJVMOptionsTopology (#2565)
• Fix the logging of System Config (#2566)
• Log component's config when constructing the instance (#2564)
• enhance heron-shell /killexecutor (#2557)
• Beefed up the kryo check to catch during submission time (#2562)
• Fix StreamletImplTest unit test (#2561)
• fix metricscache location bug (#2556)
• Streamlet name needs to be robust for blank values (#2558)
• Refactoring windowing (#2547)
• Correct the print_usage functionality in Heron Executor (#2548)
• Retry when failing to kill an Aurora topology (#2554)
• Make Kryo the default serializer for the Streamlet API (#2549)
• travis cmake is already 3.x.x and no need to install it (#2552)
• fix bugs in AuroraHeronShellController (#2553)
• adding remote debugging functionality (#2484)
• fix null (#2555)
• Move topology config translations into a different function to avoid overwriting (#2551)
• Add example to set Container Ram Padding (#2550)
• travis cmake is already 3.x.x and no need to install it (#2552)
• Extend LocalFileSystemUploader UT Coverage (#2542)