Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow startup with big profile #459

Open
wiblaa opened this issue May 23, 2024 · 1 comment
Open

Slow startup with big profile #459

wiblaa opened this issue May 23, 2024 · 1 comment
Assignees
Labels
code Code Improvement data Data enhancement New Feature

Comments

@wiblaa
Copy link

wiblaa commented May 23, 2024

jEveassets startup is (very) slow with a big profile (2.6GB)

Load times:
CORE: 2 seconds
DATA: 4 minutes 34 seconds - spends a lot of time apparently maxing out one core/thread, RAM sits at 15-16GB for a while, then jumps to 18GB
GUI: 1 minute 8 seconds

Some part of the data loading process seems to be singlethreaded and it takes quite a while to finish loading.

@GoldenGnu
Copy link
Owner

GoldenGnu commented May 23, 2024

Profiles

Option 1: SQLite

Migrate all profile data to SQlite

Option 2: Move profiles into multiple files

profiles/#Default.xml
   #Default (directory)
      assets.xml
      indystry_jobs.xml
      etc.

Compare Options

Super important dev build info:
https://wiki.jeveassets.org/devbuild (please read to keep your data safe, it's very short)

Dev Build 1
Profile split up into smaller xml files and loaded/saved in threads
https://eve.nikr.net/jeveassets/jeveassets-8.0.0-dev1-xml.zip

Dev Build 2
Profile in SQLite database
https://eve.nikr.net/jeveassets/jeveassets-8.0.0-dev2-sqlite.zip

The Details:
Note the old single xml file will persist until the profile is saved for the first time. You can trigger that by updating data:
Start dev build > Update any account data > Exit dev build > Ready for testing

Please test both builds and report what is best for you.
Please also report any bugs you find (do expect bugs), such as missing data etc.

This is very early in the development, but, getting feedback to know if this improve the load time is important before investing time in hardening the code.

Settings

#452

GUI

#451

@GoldenGnu GoldenGnu added the code Code Improvement label May 23, 2024
@GoldenGnu GoldenGnu self-assigned this May 23, 2024
@GoldenGnu GoldenGnu added enhancement New Feature data Data labels May 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code Code Improvement data Data enhancement New Feature
Projects
Status: 🎯 In Progress
Development

No branches or pull requests

2 participants