Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use generatos in 5.5 #3

Open
henrikbjorn opened this issue Dec 28, 2013 · 2 comments
Open

Use generatos in 5.5 #3

henrikbjorn opened this issue Dec 28, 2013 · 2 comments

Comments

@henrikbjorn
Copy link
Contributor

When using 5.5 using iterators is quicker than checking for values and mapping a single value for each tick in the loop.

This also makes it possible to just assume all values are mapped by wrapping the given iterator in a generator.

example went from ~30s to ~15s.

@henrikbjorn
Copy link
Contributor Author

@henrikbjorn
Copy link
Contributor Author

To keep BC a MapperIterator have been introduced which wraps a Iterator and a Mapper and it is done transparently in MapReduce::run().

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant