Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] Fixing the doc generation jobs #1076

Merged
merged 1 commit into from
Dec 28, 2023
Merged

Conversation

salkinium
Copy link
Member

Fixes #1074 (hopefully).

@salkinium salkinium force-pushed the develop-fix-docs-all branch 2 times, most recently from 78c6b94 to ee9e074 Compare September 11, 2023 12:53
@salkinium
Copy link
Member Author

ok, so plain stupid container/runner update doesn't fix it, but seems to make it fail silently. That's… great.

@salkinium
Copy link
Member Author

Still failing silently. Perhaps overriding the Python installation with the latest or previous version will fix it?

@rleh
Copy link
Member

rleh commented Sep 18, 2023

I'll take a (deeper) look later this week.

@salkinium
Copy link
Member Author

You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 96 MB

Oh, it has nothing to do with the code. We're simply out of disk space. The last job probably did better at symlinking to reduce duplication: https://github.com/modm-io/modm/actions/runs/6318898186

Ok, so we need to split the job up into multiple parts and upload them separately. I'm not going to do that for the 2023q3 release though, since the docs are resonably up-to-date (27. Sept).

@salkinium salkinium force-pushed the develop-fix-docs-all branch 5 times, most recently from f03c8d4 to 7fa42ac Compare December 26, 2023 15:12
@salkinium
Copy link
Member Author

Ok, so I have implemented an "incremental compression" scheme, where each generated target inside develop/api/ is compressed into its own .tar.gz folder and then the uncompressed files are deleted. This should prevent us from running out of disk space. Unfortunately, this means that @rleh needs to adapt the hook on the hosting server to also unpack those files.

@salkinium
Copy link
Member Author

Well… it worked! I successfully killed the docs website with my compressed targets! There's still some issue with the task return value, but it doesn't seem like we're running out of disk space anymore. Plus it's a little faster now.

@salkinium
Copy link
Member Author

Ah, it failed only because of the lack of fibers on the RPi. ARM64 fibers are not implemented.

Generating documentation for raspberrypi...
Error generating documentation for device raspberrypi: Cannot resolve dependency ':processing:fiber' of Module(modm:driver:bmi088)!
In file '../../__w/modm/modm/src/modm/driver/inertial/bmi088.lb:22' in function 'prepare':
def prepare(module, options):

@salkinium salkinium force-pushed the develop-fix-docs-all branch 3 times, most recently from 47487d8 to 01c91f5 Compare December 27, 2023 15:39
@salkinium
Copy link
Member Author

Ok, cleaned up the code a little more and will merge once the CI passes (except for the RPi fiber issue).

@salkinium salkinium added this to the 2023q4 milestone Dec 27, 2023
@salkinium salkinium force-pushed the develop-fix-docs-all branch 3 times, most recently from b2c848c to bbfb1de Compare December 27, 2023 23:15
@salkinium salkinium merged commit ca80170 into develop Dec 28, 2023
14 of 15 checks passed
@salkinium salkinium deleted the develop-fix-docs-all branch December 28, 2023 02:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

CI docs all job is broken
2 participants