Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory allocation issue #109

Open
ramyaragupathy opened this issue Jun 29, 2017 · 1 comment
Open

Memory allocation issue #109

ramyaragupathy opened this issue Jun 29, 2017 · 1 comment

Comments

@ramyaragupathy
Copy link

Here's a tile-reduce process that's run for the planet. I'm expecting the script to release memory after processing a tile. Instead process keeps taking up more memory space without freeing up memory for the processed tiles and fails at a point due to memory allocation issue.

Time Spent Memory
Before beginning the process image
10s image
30s image
After 1 minute image

Map script

'use strict';
module.exports = function(tileLayers, tile, writeData, done) {
done();
};

Reduce script

'use strict';

var tileReduce = require('@mapbox/tile-reduce');
tileReduce({
 zoom: 12,
  map: path.join(__dirname, 'index.js'),
  sources: [{
    name: 'osm',
    mbtiles: 'latest.planet.mbtiles',
  }

  ]
})

I'd need help to resolve this issue.

@ramyaragupathy
Copy link
Author

Before the failure message process freezes at a particular tile for more than 10 mins and the free memory at this point comes down to 400MB.

tile-reduce

cc @tcql @mourner @morganherlocker @bkowshik

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant