-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
"Download to IIAB" button fails every time on Ubuntu 24.10 and 25.04 pre-releases — originally "An error occurred during the subprocess execution: 'NoneType' object is not subscriptable" — and now "failed to download: None" #267
Comments
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
FYI I tried the following:
Then I tried "Download to IIAB" with https://youtu.be/zRM2AnwNY20 again. Result is: NOTICE the slightly different error message in Tasks view: New iiab-diagnostics: https://paste.centos.org/view/3eb329f8 @deldesir can you please log in to .0.10 to investigate? |
@deldesir what are all these
|
All 30 mentions of
|
I tried again with longer-form (canonical) URL https://www.youtube.com/watch?v=zRM2AnwNY20 for the same video: After running this:
The result is the same ( |
|
Verdict / FYI: Video downloads work on a fresh & fully-updated Debian 13 Trixie VM install❗ |
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
@deldesir and I were wondering if Ubuntu 24.10's bash version might be causing this new problem. But that would appear not to be true, as Debian 13 (works!) and Ubuntu 24.10 (doesn't work!) are running the exact same version of bash:
Whereas Ubuntu 24.04 shows...
|
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
and later failed to download: None
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
and later failed to download: None
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
and later failed to download: None
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
and later failed to download: None
@deldesir please test IIAB Calibre-Web on Ubuntu 25.04 (Plucky Puffin) pre-releases next week when that's made available via Multipass, and report back, Thanks! Clarif For All: Multipass makes IIAB Calibre-Web testing nearly instantaneous — follow the instructions at https://github.com/iiab/calibre-web/wiki#wrench-installation |
Ubuntu 25.04 Release Schedule & (Pre-)Release Notes:
|
While I thought this was obvious (many fresh installs of Ubuntu 24.10 by at least 3 different people, were never able to "Download to IIAB" over the past 10+ days, which by definition means an empty database |
Another example, just to confirm this problem is still happening: https://www.youtube.com/watch?v=AAyCh3IWlN4 ("MI PRIMERA VEZ EN ECUADOR!") iiab-diagnostics: https://paste.centos.org/view/d9b61464 |
The issue seems to be related to Bash and it affects only Ubuntu 24.10. Other issues about Bash on Ubuntu 24.10 (may or may not be related): |
Tests should now be run on Ubuntu 25.04 pre-releases like this one: https://cloud-images.ubuntu.com/plucky/ (...to confirm that IIAB Calibre-Web urgently needs to be fixed on both OS's, Ubuntu 24.10 and 25.04!) |
Looks like the same exact problem on Ubuntu 25.04 pre-releases: Test URL: https://www.youtube.com/watch?v=tmbZVmXyOXM iiab-diagnostics: https://paste.centos.org/view/0cfde31d |
New error with Bash 5.3.0(1)-beta (devel):
Why this matters? Update: Same error message encountered on Bash 5.2.32(1)-release. |
Good news at last. Single video downloaded successfully on Ubuntu 24.10 when option What next? |
Great the root cause is starting to emerge! Ubuntu 24.10 was released more than a month ago so hopefully this'll be solved soon! |
Just another test to confirm this is still failing on the latest (and fully apt-updated) Ubuntu 25.04 pre-release: Test URL: https://www.youtube.com/shorts/dZXJnmhGd2k iiab-diagnostics https://paste.centos.org/view/18f85c43 |
Videos will download when --search option is not used, but this makes all failed videos from previous runs eligible for current downloading session. Let's consider this database: https://dbhub.io/deldesir/xklb-metadata-test.db. Some videos are not downloaded. They are recognized by their Now, when the playlist of 4 videos https://www.youtube.com/playlist?list=PL1mGU3fBqrV9yoNCE4YNJFsDzBg8Np68A is submitted for download, notice how the database changed: https://dbhub.io/deldesir/xklb-metadata-test2.db. What happened is 14 videos were downloaded instead of the 4 requested. Here is the log: sqlalchemy-generated.db schema
|
Hi Blondel, From the log it seems like the wrapper script is calling
Maybe this is the cause of the issue? This is the way I use One process adds URLS:
Another process downloads:
You could have |
Today I learned. Now the challenge is to get the dynamic polling for every video added. This is reported in a Tasks page in real time. The current flow is as follow: Task MetadataExtract is called:
Task Download is called
I expect with the alternative approach of running lb dl as a service, I'll be able to poll xklb log for every video separately. Will do some experiments and let you know how this went. |
I don't yet see how a systemd service improves the situation?
|
Both a YouTube Short video (https://www.youtube.com/shorts/M_Zt5K057xs) and a regular YouTube video https://youtu.be/zRM2AnwNY20 (The Wild Story of the Taum Sauk Dam Failure) failed to download repeatedly, to this Ubuntu 24.10 VM.
Rebooting did not help:
iiab-diagnostics: https://paste.centos.org/view/a53f9107 (that'll disappear in 4 weeks!)
/var/log/calibre-web.log
mean?Full excerpt (Lines 1122-1127) below:
/var/log/xklb.log
relevant/meaningful ❓@deldesir suggests this is what happened:
RECAP QUESTIONS:
@deldesir were you able to learn anything by logging into the
.0.10
VM directly?Is this issue the same as Prevent [upcoming and truly live YouTube] videos from carrying over [to] subsequent download tasks [& discussion of UTC for code safety — avoid TZ code complexity wherever possible!?] #212 ? Or at least similar?? Or not at all?!
What short-term CLI hack or workaround gets IIAB Calibre-Web machines like this able to download again? So that can quickly be written into https://github.com/iiab/calibre-web/wiki
What long-term fix or reimplementation is most appropriate — so that this stop happening entirely ?
Finally, how can we make real progress in removing errors like
An error occurred during the subprocess execution: 'NoneType' object is not subscriptable
from educators' web UI — in favor of much more specific and human-readable explanation in 2025?Tasks
view messages — but is a new ticket needed to make sure this is solved properly?The text was updated successfully, but these errors were encountered: