Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream target language #202

Open
gaborhermann opened this issue May 4, 2016 · 0 comments
Open

Stream target language #202

gaborhermann opened this issue May 4, 2016 · 0 comments
Assignees

Comments

@gaborhermann
Copy link

gaborhermann commented May 4, 2016

As stream processing engines differ and none of them seem to suit all of our needs, we need to define a target language. We can plug in backends (Flink, Storm, Samza etc.), as all of them are close to our needed set of features. However, this should be as lightweight as possible, as it is not the main concern of the current research.

Needed features:

  • Building dataflow DAG of operators
  • Separate event handlers for separate inputs of an operator
  • Setting number of parallel operator instances
  • Custom partitioning
  • Custom configuration passing
  • Managed operator state
@gaborhermann gaborhermann self-assigned this May 4, 2016
@gaborhermann gaborhermann mentioned this issue May 4, 2016
12 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant