iommu Linux kernel WARNING on every boot

[srcshelton]

PCEngines firmware version

Currently v4.19.0.1, but previous firmware releases were also affected.

APU variant

apu2e4

OS and OS Version

Linux apu2e 6.1.4-gentoo #3 SMP Sat Feb 4 14:42:43 GMT 2023 x86_64 AMD GX-412TC SOC AuthenticAMD GNU/Linux

Affected component(s), peripheral(s) or functionality

~20 second boot delay and kernel warning issued.

Brief summary

I have the AMD IOMMU enabled in the BIOS settings.

On every boot with at least every 5.x and 6.x kernel, the boot sequence output reads:

[    1.961190] pci 0000:00:02.2: PCI bridge to [bus 01]
[    1.966873] pci 0000:00:02.2:   bridge window [io  0x1000-0x1fff]
[    1.973677] pci 0000:00:02.2:   bridge window [mem 0xd0000000-0xd00fffff]
[    1.981176] pci 0000:00:02.3: PCI bridge to [bus 02]
[    1.986846] pci 0000:00:02.3:   bridge window [io  0x2000-0x2fff]
[    1.993647] pci 0000:00:02.3:   bridge window [mem 0xd0100000-0xd01fffff]
[    2.001142] pci 0000:00:02.4: PCI bridge to [bus 03]
[    2.006813] pci 0000:00:02.4:   bridge window [io  0x3000-0x3fff]
[    2.013617] pci 0000:00:02.4:   bridge window [mem 0xd0200000-0xd02fffff]
[    2.021141] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    2.028043] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    2.034926] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000dffff]
[    2.041902] pci_bus 0000:00: resource 7 [mem 0xd0000000-0xffffffff]
[    2.048878] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    2.055161] pci_bus 0000:01: resource 1 [mem 0xd0000000-0xd00fffff]
[    2.062138] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[    2.068420] pci_bus 0000:02: resource 1 [mem 0xd0100000-0xd01fffff]
[    2.075389] pci_bus 0000:03: resource 0 [io  0x3000-0x3fff]
[    2.081669] pci_bus 0000:03: resource 1 [mem 0xd0200000-0xd02fffff]
[    2.089644] pci 0000:00:13.0: PME# does not work under D3, disabling it
[    2.097060] PCI: CLS 64 bytes, default 64
[    2.101816] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    2.109567] pci 0000:00:02.0: Adding to iommu group 0
[    2.115390] pci 0000:00:02.2: Adding to iommu group 1
[    2.121200] pci 0000:00:02.3: Adding to iommu group 2
[    2.127017] pci 0000:00:02.4: Adding to iommu group 3
[    2.132841] pci 0000:00:08.0: Adding to iommu group 4
[    2.138634] pci 0000:00:10.0: Adding to iommu group 5
[    2.144447] pci 0000:00:11.0: Adding to iommu group 6
[    2.150253] pci 0000:00:13.0: Adding to iommu group 7
[    2.156077] pci 0000:00:14.0: Adding to iommu group 8
[    2.161864] pci 0000:00:14.3: Adding to iommu group 8
[    2.167654] pci 0000:00:14.7: Adding to iommu group 8
[    2.173508] pci 0000:00:18.0: Adding to iommu group 9
[    2.179316] pci 0000:00:18.1: Adding to iommu group 9
[    2.185109] pci 0000:00:18.2: Adding to iommu group 9
[    2.190897] pci 0000:00:18.3: Adding to iommu group 9
[    2.196686] pci 0000:00:18.4: Adding to iommu group 9
[    2.202480] pci 0000:00:18.5: Adding to iommu group 9
[    2.208280] pci 0000:01:00.0: Adding to iommu group 10
[    2.214186] pci 0000:02:00.0: Adding to iommu group 11
[    2.220076] pci 0000:03:00.0: Adding to iommu group 12
[    2.226180] pci 0000:00:00.2: can't derive routing for PCI INT A
[    2.232897] pci 0000:00:00.2: PCI INT A: no GSI
[    2.238157] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.244349] AMD-Vi: Extended features (0x800290ad2, 0x0): PPR GT IA GA PC GA_vAPIC
[    2.252632] AMD-Vi: Interrupt remapping enabled
[   23.598239] ------------[ cut here ]------------
[   23.603562] WARNING: CPU: 1 PID: 1 at drivers/iommu/amd/init.c:930 enable_iommus_vapic+0x30d/0x370
[   23.613235] Modules linked in:
[   23.616995] CPU: 1 PID: 1 Comm: swapper/0 Not tainted 6.1.4-gentoo #3
[   23.624144] Hardware name: PC Engines apu2/apu2, BIOS v4.19.0.1 01/31/2023
[   23.631720] RIP: 0010:enable_iommus_vapic+0x30d/0x370
[   23.637482] Code: 29 12 8a 4d 89 ec 41 bd e0 00 00 00 48 39 c3 0f 85 2a fe ff ff 80 0d 41 ab ba 00 01 48 c7 c7 0d 35 d0 89 e8 2e 82 b2 ff eb 02 <0f> 0b 65 48 8b 04 25 28 00 00 00 48 3b 44 24 08 75 48 48 83 c4 10
[   23.656937] RSP: 0018:ffffb6d380023b38 EFLAGS: 00010247
[   23.662873] RAX: 000000008449dcdb RBX: ffff9f5f80059800 RCX: 0000000000000001
[   23.670706] RDX: 000000000000272b RSI: 0000000000000001 RDI: 00000000000026fe
[   23.678541] RBP: 0800000000000000 R08: 0000000000000001 R09: 000000098449b5b0
[   23.686376] R10: ffffe5128402fe80 R11: 0000000000000000 R12: 0000000000000000
[   23.694212] R13: 000fffff80000000 R14: ffffffff7fffffff R15: 0000000000000000
[   23.702053] FS:  0000000000000000(0000) GS:ffff9f5faac80000(0000) knlGS:0000000000000000
[   23.710848] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   23.717296] CR2: 0000000000000000 CR3: 0000000109009000 CR4: 00000000000406e0
[   23.725131] Call Trace:
[   23.728292]  <TASK>
[   23.731105]  state_next+0x18e/0x1e0
[   23.735309]  ? iommu_setup+0x295/0x295
[   23.739768]  iommu_go_to_state+0x1f/0x33
[   23.744405]  pci_iommu_init+0x6/0x24
[   23.748697]  __initstub__kmod_pci_dma__239_208_pci_iommu_initrootfs+0x9/0xc
[   23.756363]  do_one_initcall+0x11a/0x280
[   23.761008]  do_initcall_level+0x71/0x84
[   23.765647]  do_initcalls+0x44/0x6b
[   23.769848]  kernel_init_freeable+0x10c/0x167
[   23.774918]  ? rest_init+0xb0/0xb0
[   23.779034]  kernel_init+0x15/0x190
[   23.783237]  ret_from_fork+0x1f/0x30
[   23.787521]  </TASK>
[   23.790412] ---[ end trace 0000000000000000 ]---

How reproducible

Every boot.

How to reproduce

Steps to reproduce the behavior:

1. Enable IOMMU in BIOS settings
2. Reboot apu2e4
3. Observe kernel boot-log output

Expected behavior

Kernel WARNINGs shouldn't be triggered.

Actual behavior

There is a ~20s delay during the early-boot sequence and then the above WARNING is output.

(I believe that @metux is the kernel maintainer for APU boards? This may be unrelated if this is a general IOMMU issue...)

same on apu4c4, apu4d4

Linux blackberry 5.10.0-21-amd64 #1 SMP Debian 5.10.162-1 (2023-01-21) x86_64 GNU/Linux

different error though...

[    3.386328] pci 0000:00:02.1: PCI bridge to [bus 01]
[    3.391314] pci 0000:00:02.1:   bridge window [io  0x1000-0x1fff]
[    3.397425] pci 0000:00:02.1:   bridge window [mem 0xd0300000-0xd03fffff]
[    3.404232] pci 0000:00:02.2: PCI bridge to [bus 02]
[    3.409214] pci 0000:00:02.2:   bridge window [io  0x2000-0x2fff]
[    3.415327] pci 0000:00:02.2:   bridge window [mem 0xd0400000-0xd04fffff]
[    3.422138] pci 0000:00:02.3: PCI bridge to [bus 03]
[    3.427129] pci 0000:00:02.3:   bridge window [io  0x3000-0x3fff]
[    3.433236] pci 0000:00:02.3:   bridge window [mem 0xd0500000-0xd05fffff]
[    3.440048] pci 0000:00:02.4: PCI bridge to [bus 04]
[    3.445031] pci 0000:00:02.4:   bridge window [io  0x4000-0x4fff]
[    3.451143] pci 0000:00:02.4:   bridge window [mem 0xd0600000-0xd06fffff]
[    3.457949] pci 0000:00:02.5: PCI bridge to [bus 05]
[    3.462929] pci 0000:00:02.5:   bridge window [mem 0xd0000000-0xd02fffff]
[    3.469747] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    3.475938] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    3.482133] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    3.488408] pci_bus 0000:00: resource 7 [mem 0x000c0000-0x000dffff]
[    3.494683] pci_bus 0000:00: resource 8 [mem 0xd0000000-0xffffffff]
[    3.500962] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    3.506550] pci_bus 0000:01: resource 1 [mem 0xd0300000-0xd03fffff]
[    3.512825] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[    3.518409] pci_bus 0000:02: resource 1 [mem 0xd0400000-0xd04fffff]
[    3.524693] pci_bus 0000:03: resource 0 [io  0x3000-0x3fff]
[    3.530282] pci_bus 0000:03: resource 1 [mem 0xd0500000-0xd05fffff]
[    3.536556] pci_bus 0000:04: resource 0 [io  0x4000-0x4fff]
[    3.542140] pci_bus 0000:04: resource 1 [mem 0xd0600000-0xd06fffff]
[    3.548428] pci_bus 0000:05: resource 1 [mem 0xd0000000-0xd02fffff]
[    3.555854] pci 0000:00:12.0: PME# does not work under D3, disabling it
[    3.562901] pci 0000:00:13.0: PME# does not work under D3, disabling it
[    3.569708] PCI: CLS 64 bytes, default 64
[    3.573990] Trying to unpack rootfs image as initramfs...
[    5.744906] Freeing initrd memory: 40156K
[    5.749253] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    5.756567] pci 0000:00:00.2: can't derive routing for PCI INT A
[    5.762589] pci 0000:00:00.2: PCI INT A: no GSI
[    5.767250] pci 0000:00:02.0: Adding to iommu group 0
[    5.772364] pci 0000:00:02.1: Adding to iommu group 1
[    5.777477] pci 0000:00:02.2: Adding to iommu group 2
[    5.782583] pci 0000:00:02.3: Adding to iommu group 3
[    5.787711] pci 0000:00:02.4: Adding to iommu group 4
[    5.792821] pci 0000:00:02.5: Adding to iommu group 5
[    5.797943] pci 0000:00:08.0: Adding to iommu group 6
[    5.803053] pci 0000:00:10.0: Adding to iommu group 7
[    5.808175] pci 0000:00:11.0: Adding to iommu group 8
[    5.813294] pci 0000:00:12.0: Adding to iommu group 9
[    5.818402] pci 0000:00:13.0: Adding to iommu group 10
[    5.823634] pci 0000:00:14.0: Adding to iommu group 11
[    5.828840] pci 0000:00:14.3: Adding to iommu group 11
[    5.834027] pci 0000:00:14.7: Adding to iommu group 11
[    5.839294] pci 0000:00:18.0: Adding to iommu group 12
[    5.844485] pci 0000:00:18.1: Adding to iommu group 12
[    5.849671] pci 0000:00:18.2: Adding to iommu group 12
[    5.854863] pci 0000:00:18.3: Adding to iommu group 12
[    5.860054] pci 0000:00:18.4: Adding to iommu group 12
[    5.865270] pci 0000:00:18.5: Adding to iommu group 12
[    5.870486] pci 0000:01:00.0: Adding to iommu group 13
[    5.875682] pci 0000:02:00.0: Adding to iommu group 14
[    5.880884] pci 0000:03:00.0: Adding to iommu group 15
[    5.886100] pci 0000:04:00.0: Adding to iommu group 16
[    5.891317] pci 0000:05:00.0: Adding to iommu group 17
[    5.901653] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    5.907189] AMD-Vi: Extended features (0x800290ad2): PPR GT IA GA PC GA_vAPIC
[    5.914344] AMD-Vi: Interrupt remapping enabled
[    5.918892] AMD-Vi: Virtual APIC enabled
[   27.252579] ------------[ cut here ]------------
[   27.257238] WARNING: CPU: 1 PID: 1 at drivers/iommu/amd/init.c:850 amd_iommu_enable_interrupts+0x2c2/0x310
[   27.266904] Modules linked in:
[   27.269975] CPU: 1 PID: 1 Comm: swapper/0 Not tainted 5.10.0-21-amd64 #1 Debian 5.10.162-1
[   27.278248] Hardware name: PC Engines apu4/apu4, BIOS v4.19.0.1 01/31/2023
[   27.285147] RIP: 0010:amd_iommu_enable_interrupts+0x2c2/0x310
[   27.290918] Code: 85 be fd ff ff 31 ed e9 d9 fd ff ff bd ed ff ff ff e9 cf fd ff ff 0f 0b 48 8b 1b 48 81 fb d0 a8 5c 97 0f 85 9b fd ff ff eb db <0f> 0b 48 8b 1b 48 81 fb d0 a8 5c 97 0f 85 87 fd ff ff eb c7 48 8b
[   27.309678] RSP: 0018:ffffbded40023d70 EFLAGS: 00010246
[   27.314922] RAX: 0000000a3528babe RBX: ffff97e98004a000 RCX: 0000000000000001
[   27.322071] RDX: 000000000000270f RSI: 0000000000000001 RDI: 0000000a352893af
[   27.329218] RBP: 0000000000000000 R08: 0000000000000001 R09: 00000000000026ad
[   27.336365] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000080000000
[   27.343516] R13: 000ffffffffffff8 R14: 0800000000000000 R15: 0008000000000000
[   27.350667] FS:  0000000000000000(0000) GS:ffff97e9aac80000(0000) knlGS:0000000000000000
[   27.358772] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   27.364532] CR2: 0000000000000000 CR3: 00000000b280a000 CR4: 00000000000406e0
[   27.371677] Call Trace:
[   27.374156]  iommu_go_to_state+0x1114/0x13df
[   27.378465]  ? e820__memblock_setup+0x7d/0x7d
[   27.382843]  amd_iommu_init+0x11/0x4a
[   27.386528]  pci_iommu_init+0x16/0x43
[   27.390206]  do_one_initcall+0x41/0x1d0
[   27.394065]  kernel_init_freeable+0x21e/0x280
[   27.398455]  ? rest_init+0xb4/0xb4
[   27.401874]  kernel_init+0xa/0x10c
[   27.405303]  ret_from_fork+0x1f/0x30
[   27.408910] ---[ end trace 589e2ae7109f0fe8 ]---

another apu4d4 with ipfire installed but with older bios (v4.17.0.3)

Linux redberry.monkeycat.nl 6.1.11-ipfire #1 SMP PREEMPT_DYNAMIC Wed Feb 22 17:07:36 GMT 2023 x86_64 AMD GX-412TC SOC AuthenticAMD GNU/Linux

[    0.000000] Linux version 6.1.11-ipfire (root@x86-01.haj.ipfire.org) (gcc (GCC) 11.3.0, GNU ld (GNU Binutils) 2.39) #1 SMP PREEMPT_DYNAMIC Wed Feb 22 17:07:36 GMT 2023
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-6.1.11-ipfire root=UUID=e32e520d-58e0-4c63-8968-3c84a96b18d1 ro panic=10 rd.auto console=ttyS0,115200n8
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] signal: max sigframe size: 1360
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000cfe8dfff] usable
[    0.000000] BIOS-e820: [mem 0x00000000cfe8e000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec10000-0x00000000fec10fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000012effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000012f000000-0x000000012fffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 3.0.0 present.
[    0.000000] DMI: PC Engines apu4/apu4, BIOS v4.17.0.3 08/22/2022
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 998.070 MHz processor
[    0.000364] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000381] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000405] last_pfn = 0x12f000 max_arch_pfn = 0x400000000
[    0.001153] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.001631] last_pfn = 0xcfe8e max_arch_pfn = 0x400000000
[    0.021094] Using GB pages for direct mapping
[    0.022634] RAMDISK: [mem 0x3490f000-0x3647efff]
[    0.022690] ACPI: Early table checksum verification disabled
[    0.022714] ACPI: RSDP 0x00000000000F2990 000024 (v02 COREv4)
[    0.022734] ACPI: XSDT 0x00000000CFEAB0E0 00007C (v01 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022787] ACPI: FACP 0x00000000CFEACE10 000114 (v06 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022815] ACPI: DSDT 0x00000000CFEAB280 001B87 (v02 COREv4 COREBOOT 00010001 INTL 20200925)
[    0.022834] ACPI: FACS 0x00000000CFEAB240 000040
[    0.022850] ACPI: SSDT 0x00000000CFEACF30 0001F3 (v02 COREv4 COREBOOT 0000002A CORE 20200925)
[    0.022868] ACPI: MCFG 0x00000000CFEAD130 00003C (v01 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022899] ACPI: TPM2 0x00000000CFEAD170 00004C (v04 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022930] ACPI: APIC 0x00000000CFEAD1C0 00007E (v03 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022948] ACPI: HEST 0x00000000CFEAD240 0001D0 (v01 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022965] ACPI: IVRS 0x00000000CFEAD410 0000E0 (v02 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.022982] ACPI: SSDT 0x00000000CFEAD4F0 0048A6 (v02 AMD    AGESA    00000002 MSFT 04000000)
[    0.023000] ACPI: SSDT 0x00000000CFEB1DA0 0007C8 (v01 AMD    AGESA    00000001 AMD  00000001)
[    0.023017] ACPI: DRTM 0x00000000CFEB2570 00007C (v01 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.023035] ACPI: HPET 0x00000000CFEB25F0 000038 (v01 COREv4 COREBOOT 00000000 CORE 20200925)
[    0.023049] ACPI: Reserving FACP table memory at [mem 0xcfeace10-0xcfeacf23]
[    0.023057] ACPI: Reserving DSDT table memory at [mem 0xcfeab280-0xcfeace06]
[    0.023062] ACPI: Reserving FACS table memory at [mem 0xcfeab240-0xcfeab27f]
[    0.023068] ACPI: Reserving SSDT table memory at [mem 0xcfeacf30-0xcfead122]
[    0.023073] ACPI: Reserving MCFG table memory at [mem 0xcfead130-0xcfead16b]
[    0.023078] ACPI: Reserving TPM2 table memory at [mem 0xcfead170-0xcfead1bb]
[    0.023083] ACPI: Reserving APIC table memory at [mem 0xcfead1c0-0xcfead23d]
[    0.023088] ACPI: Reserving HEST table memory at [mem 0xcfead240-0xcfead40f]
[    0.023093] ACPI: Reserving IVRS table memory at [mem 0xcfead410-0xcfead4ef]
[    0.023098] ACPI: Reserving SSDT table memory at [mem 0xcfead4f0-0xcfeb1d95]
[    0.023103] ACPI: Reserving SSDT table memory at [mem 0xcfeb1da0-0xcfeb2567]
[    0.023108] ACPI: Reserving DRTM table memory at [mem 0xcfeb2570-0xcfeb25eb]
[    0.023113] ACPI: Reserving HPET table memory at [mem 0xcfeb25f0-0xcfeb2627]
[    0.023242] Zone ranges:
[    0.023246]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.023256]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.023264]   Normal   [mem 0x0000000100000000-0x000000012effffff]
[    0.023273] Movable zone start for each node
[    0.023276] Early memory node ranges
[    0.023278]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.023285]   node   0: [mem 0x0000000000100000-0x00000000cfe8dfff]
[    0.023292]   node   0: [mem 0x0000000100000000-0x000000012effffff]
[    0.023299] Initmem setup node 0 [mem 0x0000000000001000-0x000000012effffff]
[    0.023318] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.023450] On node 0, zone DMA: 97 pages in unavailable ranges
[    0.064788] On node 0, zone Normal: 370 pages in unavailable ranges
[    0.065012] On node 0, zone Normal: 4096 pages in unavailable ranges
[    0.065371] ACPI: PM-Timer IO Port: 0x818
[    0.065401] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.065425] IOAPIC[0]: apic_id 4, version 33, address 0xfec00000, GSI 0-23
[    0.065438] IOAPIC[1]: apic_id 5, version 33, address 0xfec20000, GSI 24-55
[    0.065449] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.065458] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.065475] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.065479] ACPI: HPET id: 0x10228201 base: 0xfed00000
[    0.065502] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[    0.065575] [mem 0xd0000000-0xf7ffffff] available for PCI devices
[    0.065582] Booting paravirtualized kernel on bare hardware
[    0.065591] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.084774] setup_percpu: NR_CPUS:64 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
[    0.086009] percpu: Embedded 54 pages/cpu s182824 r8192 d30168 u524288
[    0.086051] pcpu-alloc: s182824 r8192 d30168 u524288 alloc=1*2097152
[    0.086065] pcpu-alloc: [0] 0 1 2 3 
[    0.086218] Built 1 zonelists, mobility grouping on.  Total pages: 1027539
[    0.086228] Kernel command line: BOOT_IMAGE=/vmlinuz-6.1.11-ipfire root=UUID=e32e520d-58e0-4c63-8968-3c84a96b18d1 ro panic=10 rd.auto console=ttyS0,115200n8
[    0.086516] Unknown kernel command line parameters "BOOT_IMAGE=/vmlinuz-6.1.11-ipfire", will be passed to user space.
[    0.088721] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.089840] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.091104] mem auto-init: stack:byref_all(zero), heap alloc:on, heap free:off
[    0.091184] software IO TLB: area num 4.
[    0.221161] Memory: 3973272K/4176048K available (14343K kernel code, 2403K rwdata, 4124K rodata, 1868K init, 2024K bss, 202516K reserved, 0K cma-reserved)
[    0.222621] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.222676] ftrace: allocating 38214 entries in 150 pages
[    0.250362] ftrace: allocated 150 pages with 4 groups
[    0.253122] Dynamic Preempt: voluntary
[    0.253372] rcu: Preemptible hierarchical RCU implementation.
[    0.253377] rcu: 	RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.
[    0.253383] 	Trampoline variant of Tasks RCU enabled.
[    0.253386] 	Rude variant of Tasks RCU enabled.
[    0.253403] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.253410] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.279380] NR_IRQS: 4352, nr_irqs: 1000, preallocated irqs: 16
[    0.279821] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.280140] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)
[    0.280238] spurious 8259A interrupt: IRQ7.
[    0.280588] Console: colour dummy device 80x25
[    0.874889] printk: console [ttyS0] enabled
[    0.877810] ACPI: Core revision 20220331
[    0.880938] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    0.888804] APIC: Switch to symmetric I/O mode setup
[    0.892657] AMD-Vi: Using global IVHD EFR:0x800290ad2, EFR2:0x0
[    0.898202] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.907807] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1cc5efd647c, max_idle_ns: 881590444599 ns
[    0.917057] Calibrating delay loop (skipped), value calculated using timer frequency.. 1996.14 BogoMIPS (lpj=998070)
[    0.918049] pid_max: default: 32768 minimum: 301
[    0.920232] LSM: Security Framework initializing
[    0.921064] Yama: becoming mindful.
[    0.922131] Stack Depot allocating hash table of 262144 entries with kvcalloc
[    0.924984] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.925090] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.928128] LVT offset 1 assigned for vector 0xf9
[    0.929057] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 4
[    0.930046] Last level dTLB entries: 4KB 512, 2MB 256, 4MB 128, 1GB 0
[    0.931065] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.932050] Spectre V2 : Mitigation: Retpolines
[    0.933046] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.934046] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[    0.935046] RETBleed: Mitigation: untrained return thunk
[    0.936048] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[    0.966109] Freeing SMP alternatives memory: 36K
[    1.069836] smpboot: CPU0: AMD GX-412TC SOC (family: 0x16, model: 0x30, stepping: 0x1)
[    1.071806] cblist_init_generic: Setting adjustable number of callback queues.
[    1.072047] cblist_init_generic: Setting shift to 2 and lim to 1.
[    1.073195] cblist_init_generic: Setting shift to 2 and lim to 1.
[    1.074143] Performance Events: AMD PMU driver.
[    1.075050] ... version:                0
[    1.076047] ... bit width:              48
[    1.077047] ... generic registers:      4
[    1.078048] ... value mask:             0000ffffffffffff
[    1.079048] ... max period:             00007fffffffffff
[    1.080047] ... fixed-purpose events:   0
[    1.081047] ... event mask:             000000000000000f
[    1.083515] rcu: Hierarchical SRCU implementation.
[    1.084047] rcu: 	Max phase no-delay instances is 400.
[    1.087008] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    1.088088] smp: Bringing up secondary CPUs ...
[    1.089695] x86: Booting SMP configuration:
[    1.090050] .... node  #0, CPUs:      #1 #2 #3
[    1.098168] smp: Brought up 1 node, 4 CPUs
[    1.100058] smpboot: Max logical packages: 1
[    1.101058] smpboot: Total of 4 processors activated (7984.56 BogoMIPS)
[    1.105058] devtmpfs: initialized
[    1.107716] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    1.108086] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    1.109253] pinctrl core: initialized pinctrl subsystem
[    1.114788] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.116608] thermal_sys: Registered thermal governor 'fair_share'
[    1.116620] thermal_sys: Registered thermal governor 'bang_bang'
[    1.117049] thermal_sys: Registered thermal governor 'step_wise'
[    1.118047] thermal_sys: Registered thermal governor 'user_space'
[    1.119132] cpuidle: using governor ladder
[    1.121066] cpuidle: using governor menu
[    1.122247] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.124316] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    1.125054] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    1.126098] PCI: Using configuration type 1 for base access
[    1.137319] cryptd: max_cpu_qlen set to 1000
[    1.142844] ACPI: Added _OSI(Module Device)
[    1.143056] ACPI: Added _OSI(Processor Device)
[    1.144048] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.145076] ACPI: Added _OSI(Processor Aggregator Device)
[    1.171946] ACPI: 4 ACPI AML tables successfully acquired and loaded
[    1.186923] ACPI: Interpreter enabled
[    1.187133] ACPI: PM: (supports S0 S5)
[    1.188048] ACPI: Using IOAPIC for interrupt routing
[    1.189335] HEST: Table parsing has been initialized.
[    1.190092] GHES: Failed to enable APEI firmware first mode.
[    1.191088] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.192046] PCI: Using E820 reservations for host bridge windows
[    1.194916] ACPI: Enabled 7 GPEs in block 00 to 1F
[    1.212947] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    1.213064] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.214185] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability LTR]
[    1.215056] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-3f] only partially covers this bridge
[    1.216229] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0x0cf7 window]; [io  0x03b0-0x03df window] ignored
[    1.218156] PCI host bridge to bus 0000:00
[    1.219050] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    1.220048] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    1.221048] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000dffff]
[    1.222048] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xffffffff]
[    1.223050] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.224130] pci 0000:00:00.0: [1022:1566] type 00 class 0x060000
[    1.225436] pci 0000:00:00.2: [1022:1567] type 00 class 0x080600
[    1.226355] pci 0000:00:02.0: [1022:156b] type 00 class 0x060000
[    1.227283] pci 0000:00:02.1: [1022:1439] type 01 class 0x060400
[    1.228111] pci 0000:00:02.1: enabling Extended Tags
[    1.229145] pci 0000:00:02.1: PME# supported from D0 D3hot D3cold
[    1.231547] pci 0000:00:02.2: [1022:1439] type 01 class 0x060400
[    1.232108] pci 0000:00:02.2: enabling Extended Tags
[    1.234130] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    1.236444] pci 0000:00:02.3: [1022:1439] type 01 class 0x060400
[    1.237109] pci 0000:00:02.3: enabling Extended Tags
[    1.239049] pci 0000:00:02.3: PME# supported from D0 D3hot D3cold
[    1.241304] pci 0000:00:02.4: [1022:1439] type 01 class 0x060400
[    1.243106] pci 0000:00:02.4: enabling Extended Tags
[    1.244153] pci 0000:00:02.4: PME# supported from D0 D3hot D3cold
[    1.246220] pci 0000:00:02.5: [1022:1439] type 01 class 0x060400
[    1.247108] pci 0000:00:02.5: enabling Extended Tags
[    1.248141] pci 0000:00:02.5: PME# supported from D0 D3hot D3cold
[    1.250179] pci 0000:00:08.0: [1022:1537] type 00 class 0x108000
[    1.251067] pci 0000:00:08.0: reg 0x10: [mem 0xd0980000-0xd099ffff 64bit pref]
[    1.252056] pci 0000:00:08.0: reg 0x18: [mem 0xd0700000-0xd07fffff]
[    1.253055] pci 0000:00:08.0: reg 0x1c: [mem 0xd09a4000-0xd09a4fff]
[    1.254056] pci 0000:00:08.0: reg 0x20: [mem 0xd0800000-0xd08fffff]
[    1.255056] pci 0000:00:08.0: reg 0x24: [mem 0xd09a0000-0xd09a1fff]
[    1.257103] pci 0000:00:10.0: [1022:7814] type 00 class 0x0c0330
[    1.258077] pci 0000:00:10.0: reg 0x10: [mem 0xd09a2000-0xd09a3fff 64bit]
[    1.259205] pci 0000:00:10.0: PME# supported from D0 D3hot D3cold
[    1.260567] pci 0000:00:11.0: [1022:7801] type 00 class 0x010601
[    1.261068] pci 0000:00:11.0: reg 0x10: [io  0x5010-0x5017]
[    1.262058] pci 0000:00:11.0: reg 0x14: [io  0x5020-0x5023]
[    1.263058] pci 0000:00:11.0: reg 0x18: [io  0x5018-0x501f]
[    1.264058] pci 0000:00:11.0: reg 0x1c: [io  0x5024-0x5027]
[    1.265073] pci 0000:00:11.0: reg 0x20: [io  0x5000-0x500f]
[    1.266083] pci 0000:00:11.0: reg 0x24: [mem 0xd09a5000-0xd09a53ff]
[    1.267115] pci 0000:00:11.0: PME# supported from D3hot
[    1.268462] pci 0000:00:12.0: [1022:7808] type 00 class 0x0c0320
[    1.269068] pci 0000:00:12.0: reg 0x10: [mem 0xd09a6000-0xd09a60ff]
[    1.270163] pci 0000:00:12.0: supports D1 D2
[    1.271048] pci 0000:00:12.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.273196] pci 0000:00:13.0: [1022:7808] type 00 class 0x0c0320
[    1.274068] pci 0000:00:13.0: reg 0x10: [mem 0xd09a7000-0xd09a70ff]
[    1.276073] pci 0000:00:13.0: supports D1 D2
[    1.277047] pci 0000:00:13.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.278413] pci 0000:00:14.0: [1022:780b] type 00 class 0x0c0500
[    1.279519] pci 0000:00:14.3: [1022:780e] type 00 class 0x060100
[    1.281153] pci 0000:00:14.7: [1022:7813] type 00 class 0x080501
[    1.282073] pci 0000:00:14.7: reg 0x10: [mem 0xd09a8000-0xd09a80ff 64bit]
[    1.283387] pci 0000:00:18.0: [1022:1580] type 00 class 0x060000
[    1.284402] pci 0000:00:18.1: [1022:1581] type 00 class 0x060000
[    1.285256] pci 0000:00:18.2: [1022:1582] type 00 class 0x060000
[    1.286359] pci 0000:00:18.3: [1022:1583] type 00 class 0x060000
[    1.287473] pci 0000:00:18.4: [1022:1584] type 00 class 0x060000
[    1.288297] pci 0000:00:18.5: [1022:1585] type 00 class 0x060000
[    1.290070] pci 0000:01:00.0: [8086:1539] type 00 class 0x020000
[    1.291078] pci 0000:01:00.0: reg 0x10: [mem 0xd0300000-0xd031ffff]
[    1.292079] pci 0000:01:00.0: reg 0x18: [io  0x1000-0x101f]
[    1.293076] pci 0000:01:00.0: reg 0x1c: [mem 0xd0320000-0xd0323fff]
[    1.294244] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    1.295403] pci 0000:00:02.1: PCI bridge to [bus 01]
[    1.296055] pci 0000:00:02.1:   bridge window [io  0x1000-0x1fff]
[    1.297050] pci 0000:00:02.1:   bridge window [mem 0xd0300000-0xd03fffff]
[    1.298212] pci 0000:02:00.0: [8086:1539] type 00 class 0x020000
[    1.299079] pci 0000:02:00.0: reg 0x10: [mem 0xd0400000-0xd041ffff]
[    1.300079] pci 0000:02:00.0: reg 0x18: [io  0x2000-0x201f]
[    1.301064] pci 0000:02:00.0: reg 0x1c: [mem 0xd0420000-0xd0423fff]
[    1.302273] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    1.304202] pci 0000:00:02.2: PCI bridge to [bus 02]
[    1.305054] pci 0000:00:02.2:   bridge window [io  0x2000-0x2fff]
[    1.306050] pci 0000:00:02.2:   bridge window [mem 0xd0400000-0xd04fffff]
[    1.307226] pci 0000:03:00.0: [8086:1539] type 00 class 0x020000
[    1.308106] pci 0000:03:00.0: reg 0x10: [mem 0xd0500000-0xd051ffff]
[    1.309079] pci 0000:03:00.0: reg 0x18: [io  0x3000-0x301f]
[    1.310064] pci 0000:03:00.0: reg 0x1c: [mem 0xd0520000-0xd0523fff]
[    1.311245] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[    1.312373] pci 0000:00:02.3: PCI bridge to [bus 03]
[    1.313054] pci 0000:00:02.3:   bridge window [io  0x3000-0x3fff]
[    1.314050] pci 0000:00:02.3:   bridge window [mem 0xd0500000-0xd05fffff]
[    1.315211] pci 0000:04:00.0: [8086:1539] type 00 class 0x020000
[    1.316079] pci 0000:04:00.0: reg 0x10: [mem 0xd0600000-0xd061ffff]
[    1.317091] pci 0000:04:00.0: reg 0x18: [io  0x4000-0x401f]
[    1.318063] pci 0000:04:00.0: reg 0x1c: [mem 0xd0620000-0xd0623fff]
[    1.319305] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    1.320417] pci 0000:00:02.4: PCI bridge to [bus 04]
[    1.321070] pci 0000:00:02.4:   bridge window [io  0x4000-0x4fff]
[    1.322050] pci 0000:00:02.4:   bridge window [mem 0xd0600000-0xd06fffff]
[    1.323252] pci 0000:05:00.0: [168c:003c] type 00 class 0x028000
[    1.324081] pci 0000:05:00.0: reg 0x10: [mem 0xd0000000-0xd01fffff 64bit]
[    1.325110] pci 0000:05:00.0: reg 0x30: [mem 0xd0200000-0xd020ffff pref]
[    1.326172] pci 0000:05:00.0: supports D1 D2
[    1.327375] pci 0000:00:02.5: PCI bridge to [bus 05]
[    1.328057] pci 0000:00:02.5:   bridge window [mem 0xd0000000-0xd02fffff]
[    1.329108] pci_bus 0000:00: on NUMA node 0
[    1.331265] ACPI: PCI: Interrupt link INTA configured for IRQ 3
[    1.333155] ACPI: PCI: Interrupt link INTB configured for IRQ 3
[    1.334240] ACPI: PCI: Interrupt link INTC configured for IRQ 5
[    1.335239] ACPI: PCI: Interrupt link INTD configured for IRQ 7
[    1.336290] ACPI: PCI: Interrupt link INTE configured for IRQ 11
[    1.337236] ACPI: PCI: Interrupt link INTF configured for IRQ 10
[    1.338264] ACPI: PCI: Interrupt link INTG configured for IRQ 0
[    1.339331] ACPI: PCI: Interrupt link INTH configured for IRQ 0
[    1.341070] iommu: Default domain type: Translated 
[    1.342047] iommu: DMA domain TLB invalidation policy: strict mode 
[    1.344266] SCSI subsystem initialized
[    1.346129] libata version 3.00 loaded.
[    1.346277] ACPI: bus type USB registered
[    1.348093] usbcore: registered new interface driver usbfs
[    1.349081] usbcore: registered new interface driver hub
[    1.350075] usbcore: registered new device driver usb
[    1.351204] EDAC MC: Ver: 3.0.0
[    1.354153] PCI: Using ACPI for IRQ routing
[    1.357734] PCI: pci_cache_line_size set to 64 bytes
[    1.357858] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    1.357881] e820: reserve RAM buffer [mem 0xcfe8e000-0xcfffffff]
[    1.357893] e820: reserve RAM buffer [mem 0x12f000000-0x12fffffff]
[    1.358219] vgaarb: loaded
[    1.360168] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    1.361046] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    1.364336] clocksource: Switched to clocksource tsc-early
[    1.369060] VFS: Disk quotas dquot_6.6.0
[    1.371780] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.377678] pnp: PnP ACPI init
[    1.380397] system 00:00: [mem 0xfec10002-0xfec11001] could not be reserved
[    1.387570] pnp: PnP ACPI: found 4 devices
[    1.407536] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.415639] NET: Registered PF_INET protocol family
[    1.419827] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    1.431447] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    1.438889] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    1.445649] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    1.453276] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear)
[    1.459749] TCP: Hash tables configured (established 32768 bind 32768)
[    1.465234] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.470726] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.476946] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    1.481446] pci 0000:00:02.1: PCI bridge to [bus 01]
[    1.485146] pci 0000:00:02.1:   bridge window [io  0x1000-0x1fff]
[    1.489963] pci 0000:00:02.1:   bridge window [mem 0xd0300000-0xd03fffff]
[    1.495478] pci 0000:00:02.2: PCI bridge to [bus 02]
[    1.499161] pci 0000:00:02.2:   bridge window [io  0x2000-0x2fff]
[    1.503983] pci 0000:00:02.2:   bridge window [mem 0xd0400000-0xd04fffff]
[    1.509504] pci 0000:00:02.3: PCI bridge to [bus 03]
[    1.513186] pci 0000:00:02.3:   bridge window [io  0x3000-0x3fff]
[    1.517998] pci 0000:00:02.3:   bridge window [mem 0xd0500000-0xd05fffff]
[    1.523508] pci 0000:00:02.4: PCI bridge to [bus 04]
[    1.527190] pci 0000:00:02.4:   bridge window [io  0x4000-0x4fff]
[    1.532003] pci 0000:00:02.4:   bridge window [mem 0xd0600000-0xd06fffff]
[    1.537514] pci 0000:00:02.5: PCI bridge to [bus 05]
[    1.541201] pci 0000:00:02.5:   bridge window [mem 0xd0000000-0xd02fffff]
[    1.546717] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    1.551635] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    1.556527] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000dffff]
[    1.561521] pci_bus 0000:00: resource 7 [mem 0xd0000000-0xffffffff]
[    1.566523] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    1.570810] pci_bus 0000:01: resource 1 [mem 0xd0300000-0xd03fffff]
[    1.575796] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[    1.580086] pci_bus 0000:02: resource 1 [mem 0xd0400000-0xd04fffff]
[    1.585077] pci_bus 0000:03: resource 0 [io  0x3000-0x3fff]
[    1.589372] pci_bus 0000:03: resource 1 [mem 0xd0500000-0xd05fffff]
[    1.594354] pci_bus 0000:04: resource 0 [io  0x4000-0x4fff]
[    1.598650] pci_bus 0000:04: resource 1 [mem 0xd0600000-0xd06fffff]
[    1.603634] pci_bus 0000:05: resource 1 [mem 0xd0000000-0xd02fffff]
[    1.610073] pci 0000:00:12.0: PME# does not work under D3, disabling it
[    1.616031] pci 0000:00:13.0: PME# does not work under D3, disabling it
[    1.621519] PCI: CLS 64 bytes, default 64
[    1.624287] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    1.624656] Trying to unpack rootfs image as initramfs...
[    1.630180] pci 0000:00:02.0: Adding to iommu group 0
[    1.638057] pci 0000:00:02.1: Adding to iommu group 1
[    1.642105] pci 0000:00:02.2: Adding to iommu group 2
[    1.646242] pci 0000:00:02.3: Adding to iommu group 3
[    1.650301] pci 0000:00:02.4: Adding to iommu group 4
[    1.654404] pci 0000:00:02.5: Adding to iommu group 5
[    1.658531] pci 0000:00:08.0: Adding to iommu group 6
[    1.662429] pci 0000:00:10.0: Adding to iommu group 7
[    1.666361] pci 0000:00:11.0: Adding to iommu group 8
[    1.670222] pci 0000:00:12.0: Adding to iommu group 9
[    1.674152] pci 0000:00:13.0: Adding to iommu group 10
[    1.678324] pci 0000:00:14.0: Adding to iommu group 11
[    1.682318] pci 0000:00:14.3: Adding to iommu group 11
[    1.686289] pci 0000:00:14.7: Adding to iommu group 11
[    1.690455] pci 0000:00:18.0: Adding to iommu group 12
[    1.694431] pci 0000:00:18.1: Adding to iommu group 12
[    1.698413] pci 0000:00:18.2: Adding to iommu group 12
[    1.702414] pci 0000:00:18.3: Adding to iommu group 12
[    1.706406] pci 0000:00:18.4: Adding to iommu group 12
[    1.710443] pci 0000:00:18.5: Adding to iommu group 12
[    1.714436] pci 0000:01:00.0: Adding to iommu group 13
[    1.718415] pci 0000:02:00.0: Adding to iommu group 14
[    1.722389] pci 0000:03:00.0: Adding to iommu group 15
[    1.726340] pci 0000:04:00.0: Adding to iommu group 16
[    1.730344] pci 0000:05:00.0: Adding to iommu group 17
[    1.740055] pci 0000:00:00.2: can't derive routing for PCI INT A
[    1.744814] pci 0000:00:00.2: PCI INT A: no GSI
[    1.748109] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    1.752322] AMD-Vi: Extended features (0x800290ad2, 0x0): PPR GT IA GA PC GA_vAPIC
[    1.758640] AMD-Vi: Interrupt remapping enabled
[    2.316229] Freeing initrd memory: 28096K
[   23.915008] ------------[ cut here ]------------
[   23.918343] WARNING: CPU: 0 PID: 1 at drivers/iommu/amd/init.c:930 enable_iommus_vapic+0x321/0x370
[   23.926042] Modules linked in:
[   23.927849] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 6.1.11-ipfire #1
[   23.933102] Hardware name: PC Engines apu4/apu4, BIOS v4.17.0.3 08/22/2022
[   23.938693] RIP: 0010:enable_iommus_vapic+0x321/0x370
[   23.942473] Code: 41 5c 41 5d 41 5e 41 5f e9 3c de c5 ff 48 8b 15 7d 78 8d 01 48 c1 ea 05 83 e2 07 48 83 fa 01 0f 84 e4 fd ff ff e9 56 90 46 00 <0f> 0b e9 8b fd ff ff f6 05 63 78 8d 01 20 0f 85 be fd ff ff c7 05
[   23.959942] RSP: 0018:ffffafe640023e08 EFLAGS: 00010246
[   23.963885] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
[   23.969736] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[   23.975587] RBP: 0000000080000000 R08: 0000000000000000 R09: 0000000000000000
[   23.981436] R10: 0000000000000000 R11: 0000000000000000 R12: 000ffffffffffff8
[   23.987288] R13: 0800000000000000 R14: 2000000000000000 R15: ffff8e4ec005a800
[   23.993138] FS:  0000000000000000(0000) GS:ffff8e4eeac00000(0000) knlGS:0000000000000000
[   23.999941] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   24.004405] CR2: ffff8e4eeefff000 CR3: 00000000a960c000 CR4: 00000000000406f0
[   24.010259] Call Trace:
[   24.011432]  <TASK>
[   24.012252]  iommu_go_to_state+0xde0/0x1444
[   24.015175]  ? iommu_setup+0x281/0x281
[   24.017649]  amd_iommu_init+0xf/0x2d
[   24.019982]  pci_iommu_init+0xe/0x38
[   24.022287]  do_one_initcall+0x57/0x220
[   24.024858]  kernel_init_freeable+0x1f4/0x23c
[   24.027937]  ? rest_init+0xc0/0xc0
[   24.030075]  kernel_init+0x16/0x120
[   24.032296]  ret_from_fork+0x22/0x30
[   24.034620]  </TASK>
[   24.035529] ---[ end trace 0000000000000000 ]---

on my debian 5 system I switched from kvm to xen
(installed/apt get xen)...

no more errors regarding iommu in dmesg

i have no idea about the difference... or how it fixed it... but currently the only work around.
Since we don't know what this crash represents... (it seems to have no impact)

[corbolais]

still happening on PC Engines apu6/apu6, BIOS v4.19.0.1 01/31/2023 (APU6B4) with std Debian, std kernel Not tainted 6.10.9-amd64 #1 Debian 6.10.9-1:

[Sun Sep 22 12:45:27 2024] ------------[ cut here ]------------
[Sun Sep 22 12:45:27 2024] WARNING: CPU: 0 PID: 1 at drivers/iommu/amd/init.c:933 amd_iommu_enable_interrupts+0x557/0x870
[Sun Sep 22 12:45:27 2024] Modules linked in:
[Sun Sep 22 12:45:27 2024] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 6.10.9-amd64 #1  Debian 6.10.9-1
[Sun Sep 22 12:45:27 2024] Hardware name: PC Engines apu6/apu6, BIOS v4.19.0.1 01/31/2023
[Sun Sep 22 12:45:27 2024] RIP: 0010:amd_iommu_enable_interrupts+0x557/0x870
[Sun Sep 22 12:45:27 2024] Code: 0c 48 03 05 8b 0d cb 00 48 89 85 d0 00 00 00 0f 85 a3 fd ff ff 48 8b 85 b8 00 00 00 48 85 c0 0f 85 5f 01 00 00 e9 e4 01 00 00 <0f> 0b 48 8b 15 f0 fe f7 01 48 89 d0 48 f7 d0 a8 12 0f 85 4d fc ff
[Sun Sep 22 12:45:27 2024] RSP: 0018:ffffa3d4c0023d68 EFLAGS: 00010246
[Sun Sep 22 12:45:27 2024] RAX: 0000000bae85eebd RBX: 00000000001e8480 RCX: 0000000000000000
[Sun Sep 22 12:45:27 2024] RDX: 00000000000026d6 RSI: 0000000000000000 RDI: 0000000bae85c7e7
[Sun Sep 22 12:45:27 2024] RBP: ffff8a084005a000 R08: 00000000000026ae R09: 0000000000000000
[Sun Sep 22 12:45:27 2024] R10: 000000000003b640 R11: 0000000000000028 R12: 0000000080000000
[Sun Sep 22 12:45:27 2024] R13: 000ffffffffffff8 R14: 0800000000000000 R15: 2000000000000000
[Sun Sep 22 12:45:27 2024] FS:  0000000000000000(0000) GS:ffff8a086ac00000(0000) knlGS:0000000000000000
[Sun Sep 22 12:45:27 2024] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Sun Sep 22 12:45:27 2024] CR2: ffff8a086efff000 CR3: 000000008e420000 CR4: 00000000000406f0
[Sun Sep 22 12:45:27 2024] Call Trace:
[Sun Sep 22 12:45:27 2024]  <TASK>
[Sun Sep 22 12:45:27 2024]  ? __warn+0x80/0x120
[Sun Sep 22 12:45:27 2024]  ? amd_iommu_enable_interrupts+0x557/0x870
[Sun Sep 22 12:45:27 2024]  ? report_bug+0x164/0x190
[Sun Sep 22 12:45:27 2024]  ? handle_bug+0x3c/0x80
[Sun Sep 22 12:45:27 2024]  ? exc_invalid_op+0x17/0x70
[Sun Sep 22 12:45:27 2024]  ? asm_exc_invalid_op+0x1a/0x20
[Sun Sep 22 12:45:27 2024]  ? amd_iommu_enable_interrupts+0x557/0x870
[Sun Sep 22 12:45:27 2024]  ? amd_iommu_enable_interrupts+0x3db/0x870
[Sun Sep 22 12:45:27 2024]  state_next+0x1091/0x2450
[Sun Sep 22 12:45:27 2024]  amd_iommu_init+0x21/0x80
[Sun Sep 22 12:45:27 2024]  ? __pfx_pci_iommu_init+0x10/0x10
[Sun Sep 22 12:45:27 2024]  pci_iommu_init+0x12/0x40
[Sun Sep 22 12:45:27 2024]  do_one_initcall+0x5b/0x320
[Sun Sep 22 12:45:27 2024]  kernel_init_freeable+0x31b/0x460
[Sun Sep 22 12:45:27 2024]  ? __pfx_kernel_init+0x10/0x10
[Sun Sep 22 12:45:27 2024]  kernel_init+0x1a/0x1c0
[Sun Sep 22 12:45:27 2024]  ret_from_fork+0x34/0x50
[Sun Sep 22 12:45:27 2024]  ? __pfx_kernel_init+0x10/0x10
[Sun Sep 22 12:45:27 2024]  ret_from_fork_asm+0x1a/0x30
[Sun Sep 22 12:45:27 2024]  </TASK>
[Sun Sep 22 12:45:27 2024] ---[ end trace 0000000000000000 ]---

This also happened with previous firmware versions.

Equally happening on APU4D4, BIOS v4.12.0.1 .

[pietrushnic]

Because of this, development continues only under Dasharo. I would not expect any feedback from the PC Engines of 3mdeb teams. Of course, the whole organization remains open to the community, and we don't plan to archive it, at least for now.

Firmware development happens under Dasharo and is reported regularly during Dasharo User Group virtual meetup. Next firmware release milestone is here.