map downloads are extremely slow

[hlinden]

I am currently trying to download some standard maps for my country and I'm seeing 5% of 600MB after half an hour or so. That translates to about 15kB/s. I have switched from my local network to 4G to make sure that nothing about the routing or peering to the content host is wonky, but the situation is not improving.

I get that content hosting is expensive. I'm already subscribed to OSMAnd Live, but I'd be happy to throw a few more Euros per month to you guys if that means I can download maps in a reasonable time.

In the meantime, is there any other way to resolve this?

[vshcherb]

Well, we don't exactly why it is slow sometimes. Please double check here https://download.osmand.net/list

[vshcherb]

Today the problem was with Scaleway actually, they are replacing the routing. Will test tomorrow.

[hlinden]

The problem seems to persist. I just ran the benchmark from a wired machine on a Telekom Germany VDSL 100 connection and from another machine connected to my phone which uses T-Mobile LTE:

VDSL 100, Telekom Germany

Downloading from dl2.osmand.net.
9520502 bytes/s average speed.
Downloading from dl7.osmand.net.
65527 bytes/s average speed.
Downloading from dl8.osmand.net.
54058 bytes/s average speed.
Downloading from dl9.osmand.net.
62248 bytes/s average speed.

LTE, T-Mobile Germany

Downloading from dl2.osmand.net.
6052986 bytes/s average speed.
Downloading from dl7.osmand.net.
35489 bytes/s average speed.
Downloading from dl8.osmand.net.
33850 bytes/s average speed.
Downloading from dl9.osmand.net.
31666 bytes/s average speed.

some VM hosted at Netcup for comparison

Downloading from dl2.osmand.net.
43133593.000 bytes/s average speed.
Downloading from dl7.osmand.net.
45668378.000 bytes/s average speed.
Downloading from dl8.osmand.net.
54580585.000 bytes/s average speed.
Downloading from dl9.osmand.net.
84099948.000 bytes/s average speed.

This would make it impossible to download new maps for a reasonable region size even overnight. As the peering from Telekom to Scaleway still seems to be the problem, redirecting users from Telekom Germany to dl2 would probably be a good idea.

[vshcherb]

We're planning to setup dynamic routing at least for Germany to dl2. Do you have any simple detection algorithm idea?

[hlinden]

As the problem seems to be related only to Telekom Germany (which includes T-Mobile) and their peering, I'd probably pull a list of their announced IPv4 prefixes, e.g. from https://stat.ripe.net/data/announced-prefixes/data.json?resource=AS3320 on a regular basis and use the list in your script at https://download.osmand.net/download? to match and redirect clients from those prefixes to dl2 only. This should cover the current problem without any external lookups (reverse DNS, whatever...) at runtime and could be easily expanded to fix similar situations with other ISPs.

[vshcherb]

#13032

[da-alb]

The issue persists even on Android 14 with Osmand 4.7.17. Downloading directly from the link above there are no issues.