Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve the way the download of exernal database is working #224

Open
arno-st opened this issue Dec 23, 2024 · 1 comment
Open

Improve the way the download of exernal database is working #224

arno-st opened this issue Dec 23, 2024 · 1 comment

Comments

@arno-st
Copy link
Contributor

arno-st commented Dec 23, 2024

In 'slow' internet access, the download of the different database can be slow.
And since it's 'inside' cacti process it can provoke some timeout on the poller.
23/12/2024 00:08:01 - POLLER: Poller[Main Poller] PID[1021061] WARNING: Cactid/Cron is out of sync with the Poller Interval! The Poller Interval is '60' seconds, with a maximum of a '60' second Cactid/Cron, but 419.4 seconds have passed since the last poll! 23/12/2024 00:07:15 - FLOWVIEW IRR UPDATE: Downloading arin.db.gz 23/12/2024 00:07:15 - FLOWVIEW IRR UPDATE: IRR Source:arin, Current Serial:4202309, Last Serial:4157315 23/12/2024 00:07:08 - FLOWVIEW IRR UPDATE: Downloading apnic.db.rtr-set.gz 23/12/2024 00:07:03 - FLOWVIEW IRR UPDATE: Downloading apnic.db.route6.gz 23/12/2024 00:07:01 - MAILER INFO: Mail successfully sent via SMTP from 'Cacti 1.2.x Prod <EMAIL>', to 'Administrator <EMAIL>', cc '', bcc '', and took 0.07 seconds, Subject 'Cacti System Warning' 23/12/2024 00:07:01 - POLLER: Poller[Main Poller] PID[1021029] WARNING: Cactid/Cron is out of sync with the Poller Interval! The Poller Interval is '60' seconds, with a maximum of a '60' second Cactid/Cron, but 359.4 seconds have passed since the last poll! 23/12/2024 00:06:58 - FLOWVIEW IRR UPDATE: Downloading apnic.db.route.gz 23/12/2024 00:06:53 - FLOWVIEW IRR UPDATE: Downloading apnic.db.route-set.gz 23/12/2024 00:06:48 - FLOWVIEW IRR UPDATE: Downloading apnic.db.role.gz 23/12/2024 00:06:43 - FLOWVIEW IRR UPDATE: Downloading apnic.db.peering-set.gz 23/12/2024 00:06:38 - FLOWVIEW IRR UPDATE: Downloading apnic.db.organisation.gz 23/12/2024 00:06:33 - FLOWVIEW IRR UPDATE: Downloading apnic.db.mntner.gz 23/12/2024 00:06:28 - FLOWVIEW IRR UPDATE: Downloading apnic.db.key-cert.gz 23/12/2024 00:06:23 - FLOWVIEW IRR UPDATE: Downloading apnic.db.irt.gz 23/12/2024 00:06:18 - FLOWVIEW IRR UPDATE: Downloading apnic.db.inetnum.gz 23/12/2024 00:06:13 - FLOWVIEW IRR UPDATE: Downloading apnic.db.inet6num.gz 23/12/2024 00:06:08 - FLOWVIEW IRR UPDATE: Downloading apnic.db.inet-rtr.gz 23/12/2024 00:06:03 - FLOWVIEW IRR UPDATE: Downloading apnic.db.filter-set.gz 23/12/2024 00:06:01 - MAILER INFO: Mail successfully sent via SMTP from 'Cacti 1.2.x Prod <EMAIL>', to 'Administrator <EMAIL>', cc '', bcc '', and took 0.06 seconds, Subject 'Cacti System Warning' 23/12/2024 00:06:01 - POLLER: Poller[Main Poller] PID[1020990] WARNING: Cactid/Cron is out of sync with the Poller Interval! The Poller Interval is '60' seconds, with a maximum of a '60' second Cactid/Cron, but 299.4 seconds have passed since the last poll! 23/12/2024 00:05:58 - FLOWVIEW IRR UPDATE: Downloading apnic.db.domain.gz 23/12/2024 00:05:53 - FLOWVIEW IRR UPDATE: Downloading apnic.db.aut-num.gz 23/12/2024 00:05:48 - FLOWVIEW IRR UPDATE: Downloading apnic.db.as-set.gz 23/12/2024 00:05:43 - FLOWVIEW IRR UPDATE: Downloading apnic.db.as-block.gz 23/12/2024 00:05:43 - FLOWVIEW IRR UPDATE: IRR Source:apnic, Current Serial:12769501, Last Serial:12760161 23/12/2024 00:05:01 - MAILER INFO: Mail successfully sent via SMTP from 'Cacti 1.2.x Prod <EMAIL>', to 'Administrator <EMAIL>', cc '', bcc '', and took 0.06 seconds, Subject 'Cacti System Warning'

Maybe if we can do a exec in the background, and have a flag to let flowview_poller_bottom, the donwload is done, the import can be done inline. Even if on this log I don't wee the import!

Maybe keep in settings table, the imported serial number, and the new serial number, so if the number is not the same, that an import has to be done.

or something like that.

@arno-st arno-st changed the title Improve the way th download of exernal database is working Improve the way the download of exernal database is working Dec 23, 2024
@TheWitness
Copy link
Member

It's supposed to be in background already.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants