Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RPi5 is unable to boot #23

Open
samip5 opened this issue Oct 3, 2024 · 16 comments
Open

RPi5 is unable to boot #23

samip5 opened this issue Oct 3, 2024 · 16 comments

Comments

@samip5
Copy link

samip5 commented Oct 3, 2024

Trying to boot Talos 1.8.0 with RPi5, results in just a mostly black screen with the u-boot logo on top right.

IMG_0597

NOTE: I did try to use the UEFI loader for Pi5, and that is able to boot until it appears to lack network driver in kernel so it cannot properly boot even if we get into Talos.

@smira
Copy link
Member

smira commented Oct 3, 2024

There's no support for RPi5, and RPi5 is only supported with more recent Linux than the LTS 6.6. we're currently using

@samip5
Copy link
Author

samip5 commented Oct 4, 2024

RPi5 is only supported with more recent Linux than the LTS 6.6

Not entirely correct, as mainline kernel lacks ethernet support on RPi5 due to the way it's handled there (RP1 chip is responsible for it, https://www.raspberrypi.com/news/rp1-the-silicon-controlling-raspberry-pi-5-i-o-designed-here-at-raspberry-pi/), so it can bare minimally boot on newer kernel, but that's pretty much it at the moment.

@mooneydude
Copy link

mooneydude commented Nov 5, 2024

Hi @samip5 any progress with maybe a uboot patch? It seems you are correct and
head Makefile -n 4 on my RP5 running OS LTE 64 returns

VERSION = 6
PATCHLEVEL = 6
SUBLEVEL = 51

and i see talos 1.8.2 is 6.6.58 so my thinking is how do I stop RP1 from handling ethernet via patch?

@samip5
Copy link
Author

samip5 commented Nov 5, 2024

Hi @samip5 any progress with maybe a uboot patch?

It would be best served to put uboot into the trash bin, and use systemd-boot instead for it.

and i see talos 1.8.2 is 6.6.58 so my thinking is how do I stop RP1 from handling ethernet via patch?

You don't. The Pi5 architecture makes that impossible and Raspberry Pi OS LITE uses different kernel than Talos does.

@mooneydude
Copy link

Hi @samip5 any progress with maybe a uboot patch?

It would be best served to put uboot into the trash bin, and use systemd-boot instead for it.

and i see talos 1.8.2 is 6.6.58 so my thinking is how do I stop RP1 from handling ethernet via patch?

You don't. The Pi5 architecture makes that impossible and Raspberry Pi OS LITE uses different kernel than Talos does.

I'm only using RPi OS Lite since i was able to install proxmox on it (link) but I want talos on bare metal. Were you able to achieve this via systemd-boot?

@samip5
Copy link
Author

samip5 commented Nov 5, 2024

Hi @samip5 any progress with maybe a uboot patch?

It would be best served to put uboot into the trash bin, and use systemd-boot instead for it.

and i see talos 1.8.2 is 6.6.58 so my thinking is how do I stop RP1 from handling ethernet via patch?

You don't. The Pi5 architecture makes that impossible and Raspberry Pi OS LITE uses different kernel than Talos does.

I'm only using RPi OS Lite since i was able to install proxmox on it (link) but I want talos on bare metal. Were you able to achieve this via systemd-boot?

Not yet, as haven't yet figured out the proper way to install UEFI loader first onto it. https://github.com/skyssolutions/talos-sbc-raspberrypi

@mooneydude
Copy link

Hi @samip5 any progress with maybe a uboot patch?

It would be best served to put uboot into the trash bin, and use systemd-boot instead for it.

and i see talos 1.8.2 is 6.6.58 so my thinking is how do I stop RP1 from handling ethernet via patch?

You don't. The Pi5 architecture makes that impossible and Raspberry Pi OS LITE uses different kernel than Talos does.

I'm only using RPi OS Lite since i was able to install proxmox on it (link) but I want talos on bare metal. Were you able to achieve this via systemd-boot?

Not yet, as haven't yet figured out the proper way to install UEFI loader first onto it. https://github.com/skyssolutions/talos-sbc-raspberrypi

Have you looked into
https://github.com/worproject/rpi5-uefi?tab=readme-ov-file#supported-peripherals-in-uefi

I thought about using an ethernet adapter (link) but still not sure how to install UEFI loader first. Maybe an overlay and somehow set "ip=:::::eth1:dhcp"

This is way outside my skill set and just thought i'd pass along.

@samip5
Copy link
Author

samip5 commented Nov 7, 2024

I have looked at that and that's precisely what I'm trying to use for it.

@RyandenOtter
Copy link

Any luck on this? I just got four Raspberry Pi 5s for Christmas, and I am dying to get a bare-metal Talos cluster running!

@samip5
Copy link
Author

samip5 commented Jan 10, 2025

Any luck on this? I just got four Raspberry Pi 5s for Christmas, and I am dying to get a bare-metal Talos cluster running!

NVME boot doesn't work, SD card boot works and the mainline kernel talos uses cannot use ethernet.

@brainplot
Copy link

Does Talos use only LTS kernel versions? Do we need to wait until the next LTS release is out for ethernet to work?

@smira
Copy link
Member

smira commented Jan 10, 2025

Does Talos use only LTS kernel versions? Do we need to wait until the next LTS release is out for ethernet to work?

Yes, but at the moment the latest LTS 6.12.x Linux kernel is the latest Linux kernel release available as well, fyi.

@samip5
Copy link
Author

samip5 commented Jan 10, 2025

Does Talos use only LTS kernel versions? Do we need to wait until the next LTS release is out for ethernet to work?

Will not work either. Support hasn't been upstreamed yet while work to do that is ongoing.
Have to use Raspberry Pi Foundation's kernel for the moment.

@Sense545
Copy link

I got UEFI + NVME boot to work, but when kernel boots loop driver is missing.
Used worproject/rpi5-uefi and the dtb file from raspberrypi's repo (did not use u-boot).

Got this error while booting talos:
mrecovered from: early boot failed: error mounting "/dev/loop0": error mounting: 1 error(s) occurred: no such device

Has anyone managed to build talos using official/patched raspberrypi linux kernel?
Have not tried to set up kernel build with extra talos required config myself yet..

@Cyclonit
Copy link

Hi,

I have three Raspberry Pi 5 to create a small bare metal k8s cluster. I'd love to use Talos from the start but I am struggling with understanding the current state of affairs. Obviously, there is no official support. Several people are trying to get Talos working on this hardware, with more or less success. I tried to follow what some others said, but couldn't make sense of it.

Given my setup as an example, could someone more knowledgeable explain if this is possible at all at the moment?

  • 3x Raspberry Pi 5
  • USB thumb drives as boot/os drive
  • NVMEs for additional storage
  • PoE for power
  • connected via Ethernet

@samip5
Copy link
Author

samip5 commented Jan 13, 2025

Hi,

I have three Raspberry Pi 5 to create a small bare metal k8s cluster. I'd love to use Talos from the start but I am struggling with understanding the current state of affairs. Obviously, there is no official support. Several people are trying to get Talos working on this hardware, with more or less success. I tried to follow what some others said, but couldn't make sense of it.

Given my setup as an example, could someone more knowledgeable explain if this is possible at all at the moment?

  • 3x Raspberry Pi 5
  • USB thumb drives as boot/os drive
  • NVMEs for additional storage
  • PoE for power
  • connected via Ethernet

For any of your peripherals to work:

  • Requires the use of Raspberry Pi Foundation kernel
  • nvme nor Ethernet are supported in mainline kernel

they are provided via the RP1 IO microcontroller which is not supported fully at the moment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants