DietPi v9.9.0 breaks PCIE / NVMe on Pine SOQUARTZ compute modules (perhaps more), fixed in kernel 6.13

[m00dawg]

Creating a bug report/issue

• I have searched the existing open and closed issues (May relate Orange Pi 5 Max spl module (zfs-dkms package) load error #7344)

Required Information

• DietPi version | 9.9.0, master, MichaIng
• Distro version | bookworm
• Kernel version | 6.12.8
• SBC model | Quartz64 (aarch64)
• Power supply used | SOQUARTZ Blade / PoE (D-Link 8-port PoE+ switch)
• SD card used | None, using MMC

Steps to reproduce

1. Ran dietpi-update which appeared to swap out the kernel and/or may have misconfigured the CM
2. After the upgrade, my NVMe would not be recognized and lspci didn't show any devices.
3. dmesg contained some potential PCIe errors (https://termbin.com/sv4p)
4. Fix: Upgrading the kernel to 6.13 seems to have the patch, but 6.13 isn't available within the repos and I have trouble rolling to a previous kernel (see below).

Expected behaviour

1. NVMe should be recognized with LVM volumes mounting per my fstab

Actual behaviour

1. Initially system didn't boot since I didn't have noerrors setup on the fstab for the volume. This was due to the NVMe not being there so LVM had nothing to do.

Extra details

1. I talked about this on the Quartz64 Matrix and it seems to be related to this bug which has been fixed in Kernel 6.13
2. I tried down-grading the kernel to 6.12.9+bpo though installing it and changing /boot/extlinux/extlinux.conf caused it not to boot.
3. Additionally though, extlinux.conf had the wrong board type. It was /boot/rk3566-soquartz-cm4.dtb but I updated it to /boot/rk3566-soquartz-blade.dtb as that is what I am using. As I recall before the front USB didn't work but now it does so that's something to note.
4. Finally, I tried building and installing an updated u-boot via these instructions and placing it on the boot sector (via dd) and in /boot. This did work but didn't fix the issue since it appears as though it's related to 6.12 specifically.

[m00dawg]

I was able to get PCIe working again by manually adding the line noted in this patch to my /boot/rk3566-soquartz-blade.dtb file by doing:

dtc -I dts -O dtb ~/out > rk3566-soquartz-blade.dtb
vi out (add patch)
dtc -I dts -O dtb ~/out > rk3566-soquartz-blade.dtb

Credit to dsimic on the PINE64 Matrix channel for finding the issue, kernel bug, and the fix noted above.

[MichaIng]

Many thanks for the report. I'll do a Linux 6.13 package build once the LTS tag as been rolled over. Should not take long.

And right, we include the CM4 device tree for the SOQuartz only, I remember it was most compatible. But makes sense that we add as well others: there is as well a SOQuartz Model A device tree, the one I actually have.

We could try to auto-detect the carrier board on first boot, and adjust the device tree automatically. Do you have an idea how to identify the Blade? I'll try to find one for the Model A carrier board.