Optee experiments

[macpijan]

No description provided.

[DaniilKl]

This PR need some modifications, converting it to draft.

[macpijan]

This PR need some modifications, converting it to draft.

If there are any problems with opi, do not worry about them, we can drop it from here and focus purely on the optee. We can also make another clean branch with optee integration, if that makes it easier.

[DaniilKl]

I meant U-Boot. We need to modify U-Boot to use OP-TEE binaries with load address specified. I already have a patch for this but cannot find free time to do so.

[macpijan]

@macpijan I though that rather than patching U-Boot, we wrap the bin into elf.

I have used the

ENTRY(_binary_tee_rk3566_bin_start);

SECTIONS
{
        . = 0x08400000;
        .data : {
                *(.data)
        }
}

and

aarch64-linux-gnu-objcopy -B aarch64 -I binary -O elf64-littleaarch64 tee-rk3566.bin bl32.o
aarch64-linux-gnu-ld bl32.o -T tee.ld -o tee-rk3566.elf

That can be further generalized and pushed into usptream rkbin recipe later on as well.

That worked best for me when integrating this, but this was a single step done manually.

[DaniilKl]

Some rebasing...

[DaniilKl]

@macpijan, I tried to follow your example but have not met success with these blobs. You can check my code here #5. Though there is a binman patch - I did not use it, the binaries got linked manually as you described here #19 (comment). The result is:

�DDR 2d653b3476 typ 24/01/20-15:04:19,fwver: v1.21
ln
LP4/4x derate en, other dram:1x trefi
ddrconfig:7
LPDDR4X, 324MHz
BW=32 Col=10 Bk=8 CS0 Row=17 CS1 Row=17 CS=2 Die BW=8 Size=8192MB
tdqss: cs0 dqs0: 72ps, dqs1: -96ps, dqs2: -48ps, dqs3: -144ps, 
tdqss: cs1 dqs0: 72ps, dqs1: -120ps, dqs2: -48ps, dqs3: -144ps, 

change to: 324MHz
PHY drv:clk:36,ca:36,DQ:29,odt:0
vrefinner:24%, vrefout:41%
dram drv:40,odt:0
clk skew:0x61
rx vref: 34.4%
tx vref: 38.0%

change to: 528MHz
PHY drv:clk:36,ca:36,DQ:29,odt:0
vrefinner:24%, vrefout:41%
dram drv:40,odt:0
clk skew:0x58
rx vref: 34.4%
tx vref: 36.0%

change to: 780MHz
PHY drv:clk:36,ca:36,DQ:29,odt:60
vrefinner:16%, vrefout:41%
dram drv:40,odt:0
clk skew:0x58
rx vref: 17.6%
tx vref: 34.0%

change to: 1056MHz(final freq)
PHY drv:clk:36,ca:36,DQ:29,odt:60
vrefinner:16%, vrefout:22%
dram drv:40,odt:80
vref_ca:00000071
clk skew:0x36
rx vref: 16.6%
tx vref: 22.8%
cs 0:
the read training result:
DQS0:0x3b, DQS1:0x3b, DQS2:0x40, DQS3:0x39, 
min  : 0xb  0xb  0xe  0xc  0x1  0x3  0x7  0x6 , 0x5  0x6  0x1  0x1  0x9  0x9  0xa  0x8 ,
       0xe  0xe  0xb  0xa  0x4  0x1  0x2  0x7 , 0x9  0x6  0x6  0x1  0xd  0xd  0x9  0xe ,
mid  :0x28 0x29 0x2b 0x29 0x1f 0x21 0x24 0x23 ,0x23 0x23 0x1f 0x1f 0x27 0x27 0x27 0x26 ,
      0x2d 0x2d 0x29 0x28 0x22 0x1f 0x1f 0x24 ,0x27 0x24 0x23 0x1f 0x2b 0x2b 0x27 0x2c ,
max  :0x46 0x47 0x49 0x47 0x3e 0x3f 0x42 0x41 ,0x41 0x41 0x3d 0x3d 0x46 0x46 0x45 0x44 ,
      0x4d 0x4c 0x47 0x46 0x41 0x3d 0x3c 0x42 ,0x46 0x42 0x40 0x3d 0x49 0x49 0x46 0x4a ,
range:0x3b 0x3c 0x3b 0x3b 0x3d 0x3c 0x3b 0x3b ,0x3c 0x3b 0x3c 0x3c 0x3d 0x3d 0x3b 0x3c ,
      0x3f 0x3e 0x3c 0x3c 0x3d 0x3c 0x3a 0x3b ,0x3d 0x3c 0x3a 0x3c 0x3c 0x3c 0x3d 0x3c ,
the write training result:
DQS0:0x3f, DQS1:0x26, DQS2:0x30, DQS3:0x23, 
min  :0x67 0x68 0x68 0x67 0x5a 0x5d 0x63 0x62 0x61 ,0x4a 0x49 0x45 0x42 0x4d 0x4d 0x4d 0x4d 0x4a ,
      0x55 0x55 0x51 0x50 0x48 0x47 0x48 0x4d 0x4f ,0x4d 0x4a 0x48 0x46 0x4e 0x4f 0x4c 0x52 0x4a ,
mid  :0x82 0x84 0x85 0x82 0x77 0x79 0x7e 0x7d 0x7c ,0x65 0x65 0x5f 0x5e 0x69 0x68 0x68 0x68 0x66 ,
      0x71 0x71 0x6c 0x6c 0x64 0x60 0x62 0x68 0x6a ,0x69 0x66 0x63 0x61 0x6b 0x6b 0x68 0x6e 0x66 ,
max  :0x9e 0xa0 0xa2 0x9e 0x94 0x96 0x99 0x98 0x97 ,0x81 0x81 0x7a 0x7a 0x86 0x83 0x84 0x84 0x82 ,
      0x8e 0x8e 0x87 0x88 0x81 0x7a 0x7d 0x84 0x85 ,0x86 0x82 0x7e 0x7c 0x88 0x88 0x84 0x8b 0x82 ,
range:0x37 0x38 0x3a 0x37 0x3a 0x39 0x36 0x36 0x36 ,0x37 0x38 0x35 0x38 0x39 0x36 0x37 0x37 0x38 ,
      0x39 0x39 0x36 0x38 0x39 0x33 0x35 0x37 0x36 ,0x39 0x38 0x36 0x36 0x3a 0x39 0x38 0x39 0x38 ,
cs 1:
the read training result:
DQS0:0x3b, DQS1:0x3b, DQS2:0x40, DQS3:0x39, 
min  : 0xb  0xb  0xe  0xc  0x1  0x3  0x7  0x6 , 0x5  0x6  0x1  0x1  0x9  0x9  0xa  0x8 ,
       0xe  0xe  0xb  0xa  0x4  0x1  0x2  0x7 , 0x9  0x6  0x6  0x1  0xd  0xd  0x9  0xe ,
mid  :0x28 0x29 0x2b 0x29 0x1f 0x21 0x24 0x23 ,0x23 0x23 0x1f 0x1f 0x27 0x27 0x27 0x26 ,
      0x2d 0x2d 0x29 0x28 0x22 0x1f 0x1f 0x24 ,0x27 0x24 0x23 0x1f 0x2b 0x2b 0x27 0x2c ,
max  :0x46 0x47 0x49 0x47 0x3e 0x3f 0x42 0x41 ,0x41 0x41 0x3d 0x3d 0x46 0x46 0x45 0x44 ,
      0x4d 0x4c 0x47 0x46 0x41 0x3d 0x3c 0x42 ,0x46 0x42 0x40 0x3d 0x49 0x49 0x46 0x4a ,
range:0x3b 0x3c 0x3b 0x3b 0x3d 0x3c 0x3b 0x3b ,0x3c 0x3b 0x3c 0x3c 0x3d 0x3d 0x3b 0x3c ,
      0x3f 0x3e 0x3c 0x3c 0x3d 0x3c 0x3a 0x3b ,0x3d 0x3c 0x3a 0x3c 0x3c 0x3c 0x3d 0x3c ,
the write training result:
DQS0:0x3f, DQS1:0x26, DQS2:0x30, DQS3:0x23, 
min  :0x67 0x68 0x68 0x67 0x5a 0x5d 0x63 0x62 0x61 ,0x4a 0x49 0x45 0x42 0x4d 0x4d 0x4d 0x4d 0x4a ,
      0x55 0x55 0x51 0x50 0x48 0x47 0x48 0x4d 0x4f ,0x4d 0x4a 0x48 0x46 0x4e 0x4f 0x4c 0x52 0x4a ,
mid  :0x82 0x84 0x85 0x82 0x77 0x79 0x7e 0x7d 0x7c ,0x65 0x65 0x5f 0x5e 0x69 0x68 0x68 0x68 0x66 ,
      0x71 0x71 0x6c 0x6c 0x64 0x60 0x62 0x68 0x6a ,0x69 0x66 0x63 0x61 0x6b 0x6b 0x68 0x6e 0x66 ,
max  :0x9e 0xa0 0xa2 0x9e 0x94 0x96 0x99 0x98 0x97 ,0x81 0x81 0x7a 0x7a 0x86 0x83 0x84 0x84 0x82 ,
      0x8e 0x8e 0x87 0x88 0x81 0x7a 0x7d 0x84 0x85 ,0x86 0x82 0x7e 0x7c 0x88 0x88 0x84 0x8b 0x82 ,
range:0x37 0x38 0x3a 0x37 0x3a 0x39 0x36 0x36 0x36 ,0x37 0x38 0x35 0x38 0x39 0x36 0x37 0x37 0x38 ,
      0x39 0x39 0x36 0x38 0x39 0x33 0x35 0x37 0x36 ,0x39 0x38 0x36 0x36 0x3a 0x39 0x38 0x39 0x38 ,
CA Training result:
cs:0 min  :0x4d 0x4a 0x45 0x3e 0x45 0x3d 0x47 ,0x48 0x43 0x41 0x3b 0x43 0x3b 0x47 ,
cs:0 mid  :0x89 0x8b 0x82 0x7f 0x82 0x7e 0x76 ,0x85 0x84 0x7d 0x7c 0x7f 0x7b 0x76 ,
cs:0 max  :0xc6 0xcc 0xc0 0xc1 0xc0 0xc0 0xa6 ,0xc3 0xc5 0xba 0xbe 0xbc 0xbc 0xa6 ,
cs:0 range:0x79 0x82 0x7b 0x83 0x7b 0x83 0x5f ,0x7b 0x82 0x79 0x83 0x79 0x81 0x5f ,
cs:1 min  :0x49 0x4e 0x41 0x43 0x42 0x42 0x46 ,0x45 0x48 0x3d 0x3f 0x40 0x3f 0x42 ,
cs:1 mid  :0x89 0x8a 0x82 0x80 0x82 0x7f 0x78 ,0x86 0x84 0x7e 0x7c 0x80 0x7c 0x76 ,
cs:1 max  :0xca 0xc7 0xc3 0xbd 0xc2 0xbc 0xab ,0xc7 0xc1 0xbf 0xba 0xc0 0xba 0xaa ,
cs:1 range:0x81 0x79 0x82 0x7a 0x80 0x7a 0x65 ,0x82 0x79 0x82 0x7b 0x80 0x7b 0x68 ,
out

U-Boot SPL 2024.01 (Jan 08 2024 - 15:37:48 +0000)
Trying to boot from MMC2
## Checking hash(es) for config config-1 ... OK
## Checking hash(es) for Image atf-1 ... sha256+ OK
## Checking hash(es) for Image u-boot ... sha256+ OK
## Checking hash(es) for Image fdt-1 ... sha256+ OK
## Checking hash(es) for Image atf-2 ... sha256+ OK
## Checking hash(es) for Image atf-3 ... sha256+ OK
## Checking hash(es) for Image atf-4 ... sha256+ OK
## Checking hash(es) for Image atf-5 ... sha256+ OK
## Checking hash(es) for Image atf-6 ... sha256+ OK
## Checking hash(es) for Image tee-1 ... sha256+ OK
INFO:    Preloader serial: 2
NOTICE:  BL31: v2.3():v2.3-685-g4a52a1f56-dirty:zwx, fwver: v2.17
NOTICE:  BL31: Built : 20:14:33, Jan 31 2024
INFO:    GICv3 without legacy support detected.
INFO:    ARM GICv3 driver initialized in EL3
INFO:    pmu v1 is valid 220114
INFO:    l3 cache partition cfg-0
INFO:    dfs DDR fsp_param[0].freq_mhz= 1056MHz
INFO:    dfs DDR fsp_param[1].freq_mhz= 324MHz
INFO:    dfs DDR fsp_param[2].freq_mhz= 528MHz
INFO:    dfs DDR fsp_param[3].freq_mhz= 780MHz
INFO:    Using opteed sec cpu_context!
INFO:    boot cpu mask: 0
INFO:    Feature: ultra suspend
INFO:    BL31: Initializing runtime services
INFO:    BL31: Initializing BL32
I/TC: 
I/TC: OP-TEE version: 3.13.0-743-gb5340fd65 #hisping.lin (gcc version 10.2.1 20201103 (GNU Toolchain for the A-profil4
I/TC: Primary CPU initializing
E/TC:0 0 hal_algo_version_init:296 CRYPTO_CRYPTO_VERSION_NEW no support. Skip all algo mode check.
I/TC: Primary CPU switching to normal world boot
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0xa00000
INFO:    SPSR = 0x3c9


U-Boot 2024.01 (Jan 08 2024 - 15:37:48 +0000)

Model: Pine64 RK3566 Quartz64-A Board
DRAM:  8 GiB (effective 7.7 GiB)
PMIC:  RK8170 (on=0x40, off=0x00)
Core:  321 devices, 27 uclasses, devicetree: separate
MMC:   mmc@fe2b0000: 1, mmc@fe2c0000: 2, mmc@fe310000: 0
Loading Environment from nowhere... OK
In:    serial@fe660000
Out:   serial@fe660000
Err:   serial@fe660000
Model: Pine64 RK3566 Quartz64-A Board
Net:   eth0: ethernet@fe010000
Hit any key to stop autoboot:  0 
** Booting bootflow 'mmc@fe2b0000.bootdev.part_9' with extlinux
1:      zarhus-machine-cm3
Retrieving file: /boot/fitImage
append: root=PARTLABEL=root rootwait rw rootfstype=ext4 earlycon console=tty1 console=ttyS2,1500000n8
## Loading kernel from FIT Image at 02080000 ...
   Using 'conf-rk3566-quartz64-a.dtb' configuration
   Verifying Hash Integrity ... OK
   Trying 'kernel-1' kernel subimage
     Description:  Linux kernel
     Type:         Kernel Image
     Compression:  gzip compressed
     Data Start:   0x020800fc
     Data Size:    9351950 Bytes = 8.9 MiB
     Architecture: AArch64
     OS:           Linux
     Load Address: 0x06000000
     Entry Point:  0x06000000
     Hash algo:    sha256
     Hash value:   93774a7dfb6396a6224e4fbf2e241a4af6ef1a7f5828e5617a17b6e27e8ba689
   Verifying Hash Integrity ... sha256+ OK
## Loading fdt from FIT Image at 02080000 ...
   Using 'conf-rk3566-quartz64-a.dtb' configuration
   Verifying Hash Integrity ... OK
   Trying 'fdt-rk3566-quartz64-a.dtb' fdt subimage
     Description:  Flattened Device Tree blob
     Type:         Flat Device Tree
     Compression:  uncompressed
     Data Start:   0x0296b524
     Data Size:    56178 Bytes = 54.9 KiB
     Architecture: AArch64
     Hash algo:    sha256
     Hash value:   bf9d0c88b6d67716eba6c9d000c3fb6af5d6d36b458237deb752f4b311c9f4e8
   Verifying Hash Integrity ... sha256+ OK
   Booting using the fdt blob at 0x296b524
Working FDT set to 296b524
   Uncompressing Kernel Image
   Loading Device Tree to 00000000eceb9000, end 00000000ecec9b71 ... OK
Working FDT set to eceb9000

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x412fd050]
[    0.000000] Linux version 6.6.23-yocto-standard-00119-g2f56eb1b9852 (oe-user@oe-host) (aarch64-zarhus-linux-gcc (G4
[    0.000000] KASLR disabled due to lack of seed
[    0.000000] Machine model: Pine64 RK3566 Quartz64-A Board
[    0.000000] efi: UEFI not found.
[    0.000000] OF: reserved mem: 0x0000000008400000..0x00000000093fffff (16384 KiB) nomap non-reusable optee@840000
[    0.000000] earlycon: uart0 at MMIO32 0x00000000fe660000 (options '1500000n8')
[    0.000000] printk: bootconsole [uart0] enabled
[    0.000000] NUMA: No NUMA configuration found
[    0.000000] NUMA: Faking a node at [mem 0x0000000000200000-0x00000001ffffffff]
[    0.000000] NUMA: NODE_DATA [mem 0x1ff0259c0-0x1ff027fff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000200000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x00000001ffffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000200000-0x00000000083fffff]
[    0.000000]   node   0: [mem 0x0000000008400000-0x00000000093fffff]
[    0.000000]   node   0: [mem 0x0000000009400000-0x00000000efffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x00000001ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000200000-0x00000001ffffffff]
[    0.000000] On node 0, zone DMA: 512 pages in unavailable ranges
[    0.000000] cma: Reserved 32 MiB at 0x00000000ee000000 on node -1
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 21 pages/cpu s48680 r8192 d29144 u86016
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: Virtualization Host Extensions
[    0.000000] CPU features: detected: Qualcomm erratum 1009, or ARM erratum 1286807, 2441009
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] alternatives: applying boot alternatives
[    0.000000] Kernel command line: root=PARTLABEL=root rootwait rw rootfstype=ext4 earlycon console=tty1 console=tty8
[    0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)
[    0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Fallback order for Node 0: 0 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1999368
[    0.000000] Policy zone: Normal
[    0.000000] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.000000] software IO TLB: area num 4.
[    0.000000] software IO TLB: mapped [mem 0x00000000e8eb9000-0x00000000eceb9000] (64MB)
[    0.000000] Memory: 7829968K/8124416K available (12928K kernel code, 1374K rwdata, 4748K rodata, 3264K init, 535K )
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] workqueue: name exceeds WQ_NAME_LEN. Truncating to: events_freezable_power_efficien
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 320 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: MBI range [296:319]
[    0.000000] GICv3: Using MBI frame 0x00000000fd410000
[    0.000000] Root IRQ handler: gic_handle_irq
[    0.000000] GICv3: GICv3 features: 16 PPIs
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000fd460000
[    0.000000] ITS: No ITS available, not enabling LPIs
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 4407952025s
[    0.000001] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns
[    0.001844] Console: colour dummy device 80x25
[    0.002352] printk: console [tty1] enabled
[    0.003584] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=96000)
[    0.004618] pid_max: default: 32768 minimum: 301
[    0.005188] LSM: initializing lsm=capability,integrity
[    0.005891] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.006725] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.008808] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    0.010849] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.011689] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.012788] rcu: Hierarchical SRCU implementation.
[    0.013277] rcu:     Max phase no-delay instances is 1000.
[    0.015034] EFI services will not be available.
[    0.015927] smp: Bringing up secondary CPUs ...
IoUcno
/nUhnr
IeCigIoUcno
[    0.017386] Detected VIPT I-cache on CPU1
[    0.017472] GICv3: CPU1: found redistributor 100 region 0:0x00000000fd480000
[    0.017537] CPU1: Booted secondary processor 0x0000000100 [0x412fd050]
[    0.018646] Detected VIPT I-cache on CPU2
[    0.018719] GICv3: CPU2: found redistributor 200 region 0:0x00000000fd4a0000
[    0.018767] CPU2: Booted secondary processor 0x0000000200 [0x412fd050]
[    0.019924] Detected VIPT I-cache on CPU3
[    0.019994] GICv3: CPU3: found redistributor 300 region 0:0x00000000fd4c0000
[    0.020038] CPU3: Booted secondary processor 0x0000000300 [0x412fd050]
[    0.020191] smp: Brought up 1 node, 4 CPUs
[    0.025855] SMP: Total of 4 processors activated.
[    0.026331] CPU features: detected: 32-bit EL0 Support
[    0.026843] CPU features: detected: 32-bit EL1 Support
[    0.027416] CPU features: detected: Data cache clean to the PoU not required for I/D coherence
[    0.028277] CPU features: detected: Common not Private translations
[    0.028902] CPU features: detected: CRC32 instructions
[    0.029420] CPU features: detected: RCpc load-acquire (LDAPR)
[    0.029993] CPU features: detected: LSE atomic instructions
[    0.030549] CPU features: detected: Privileged Access Never
[    0.031105] CPU features: detected: RAS Extension Support
[    0.031674] CPU features: detected: Speculative Store Bypassing Safe (SSBS)
[    0.032477] CPU: All CPU(s) started at EL2
[    0.032897] alternatives: applying system-wide alternatives
[    0.040370] devtmpfs: initialized
[    0.058736] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.059759] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.061742] pinctrl core: initialized pinctrl subsystem
[    0.062901] DMI not present or invalid.
[    0.064165] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.065966] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations
[    0.066975] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.068227] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.069064] audit: initializing netlink subsys (disabled)
[    0.069906] audit: type=2000 audit(0.068:1): state=initialized audit_enabled=0 res=1
[    0.070898] thermal_sys: Registered thermal governor 'step_wise'
[    0.070910] thermal_sys: Registered thermal governor 'power_allocator'
[    0.071590] cpuidle: using governor menu
[    0.072948] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.073816] ASID allocator initialised with 65536 entries
[    0.074657] Serial: AMBA PL011 UART driver
[    0.087649] platform fe040000.vop: Fixed dependency cycle(s) with /hdmi@fe0a0000
[    0.088504] platform fe0a0000.hdmi: Fixed dependency cycle(s) with /vop@fe040000
[    0.105005] gpio gpiochip0: Static allocation of GPIO base is deprecated, use dynamic allocation.
[    0.106388] rockchip-gpio fdd60000.gpio: probed /pinctrl/gpio@fdd60000
[    0.107597] gpio gpiochip1: Static allocation of GPIO base is deprecated, use dynamic allocation.
[    0.108729] rockchip-gpio fe740000.gpio: probed /pinctrl/gpio@fe740000
[    0.109868] gpio gpiochip2: Static allocation of GPIO base is deprecated, use dynamic allocation.
[    0.111025] rockchip-gpio fe750000.gpio: probed /pinctrl/gpio@fe750000
[    0.112083] gpio gpiochip3: Static allocation of GPIO base is deprecated, use dynamic allocation.
[    0.113202] rockchip-gpio fe760000.gpio: probed /pinctrl/gpio@fe760000
[    0.114248] gpio gpiochip4: Static allocation of GPIO base is deprecated, use dynamic allocation.
[    0.115396] rockchip-gpio fe770000.gpio: probed /pinctrl/gpio@fe770000
[    0.118033] platform fe0a0000.hdmi: Fixed dependency cycle(s) with /hdmi-con
[    0.118853] platform hdmi-con: Fixed dependency cycle(s) with /hdmi@fe0a0000
[    0.125142] Modules: 26992 pages in range for non-PLT usage
[    0.125159] Modules: 518512 pages in range for PLT usage
[    0.126772] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    0.128040] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page
[    0.128670] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
[    0.129347] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page
[    0.129971] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.130645] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
[    0.131270] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
[    0.131944] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
[    0.134866] ACPI: Interpreter disabled.
[    0.136542] iommu: Default domain type: Translated
[    0.137085] iommu: DMA domain TLB invalidation policy: strict mode
[    0.138068] SCSI subsystem initialized
[    0.138963] usbcore: registered new interface driver usbfs
[    0.139562] usbcore: registered new interface driver hub
[    0.140154] usbcore: registered new device driver usb
[    0.141380] pps_core: LinuxPPS API ver. 1 registered
[    0.141887] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.142814] PTP clock support registered
[    0.143263] EDAC MC: Ver: 3.0.0
[    0.144424] scmi_core: SCMI protocol bus registered
[    0.145508] FPGA manager framework
[    0.145988] Advanced Linux Sound Architecture Driver Initialized.
[    0.147877] vgaarb: loaded
[    0.148640] clocksource: Switched to clocksource arch_sys_counter
[    0.149848] VFS: Disk quotas dquot_6.6.0
[    0.150298] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.151272] pnp: PnP ACPI: disabled
[    0.164989] NET: Registered PF_INET protocol family
[    0.166002] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.174285] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)
[    0.175306] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.176108] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.177456] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    0.180308] TCP: Hash tables configured (established 65536 bind 65536)
[    0.181173] UDP hash table entries: 4096 (order: 5, 131072 bytes, linear)
[    0.182010] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes, linear)
[    0.183066] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.183700] PCI: CLS 0 bytes, default 64
[    0.184799] kvm [1]: IPA Size Limit: 40 bits
[    0.185267] kvm [1]: GICv3: no GICV resource entry
[    0.185752] kvm [1]: disabling GICv2 emulation
[    0.186221] kvm [1]: GIC system register CPU interface enabled
[    0.186835] kvm [1]: vgic interrupt IRQ9
[    0.187278] kvm [1]: VHE mode initialized successfully
[    0.189693] Initialise system trusted keyrings
[    0.190411] workingset: timestamp_bits=42 max_order=21 bucket_order=0
[    0.191496] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.192300] 9p: Installing v9fs 9p2000 file system support
[    0.270307] Key type asymmetric registered
[    0.270733] Asymmetric key parser 'x509' registered
[    0.271299] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246)
[    0.272045] io scheduler mq-deadline registered
[    0.272504] io scheduler kyber registered
[    0.272982] io scheduler bfq registered
[    0.287670] dma-pl330 fe530000.dma-controller: Loaded driver for PL330 DMAC-241330
[    0.288459] dma-pl330 fe530000.dma-controller:       DBUFF-128x8bytes Num_Chans-8 Num_Peri-32 Num_Events-16
[    0.292195] dma-pl330 fe550000.dma-controller: Loaded driver for PL330 DMAC-241330
[    0.292996] dma-pl330 fe550000.dma-controller:       DBUFF-128x8bytes Num_Chans-8 Num_Peri-32 Num_Events-16
[    0.304061] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.308782] fdd50000.serial: ttyS0 at MMIO 0xfdd50000 (irq = 25, base_baud = 1500000) is a 16550A
[    0.311605] fe650000.serial: ttyS1 at MMIO 0xfe650000 (irq = 26, base_baud = 1500000) is a 16550A
[    0.313051] serial serial0: tty port ttyS1 registered
[    0.315256] fe660000.serial: ttyS2 at MMIO 0xfe660000 (irq = 27, base_baud = 1500000) is a 16550A
[    0.316409] printk: console [ttyS2] enabled
[    0.316409] printk: console [ttyS2] enabled
[    0.317260] printk: bootconsole [uart0] disabled
[    0.317260] printk: bootconsole [uart0] disabled
[    0.320191] STM32 USART driver initialized
[    0.330366] loop: module loaded
[    0.332008] megasas: 07.725.01.00-rc1
[    0.339208] tun: Universal TUN/TAP device driver, 1.6
[    0.341000] thunder_xcv, ver 1.0
[    0.341356] thunder_bgx, ver 1.0
[    0.341705] nicpf, ver 1.0
[    0.342871] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    0.343531] hns3: Copyright (c) 2017 Huawei Corporation.
[    0.344058] hclge is initializing
[    0.344415] e1000: Intel(R) PRO/1000 Network Driver
[    0.344899] e1000: Copyright (c) 1999-2006 Intel Corporation.
[    0.345473] e1000e: Intel(R) PRO/1000 Network Driver
[    0.345929] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    0.346501] igb: Intel(R) Gigabit Ethernet Network Driver
[    0.346993] igb: Copyright (c) 2007-2014 Intel Corporation.
[    0.347533] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    0.348101] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    0.348705] sky2: driver version 1.30
[    0.350024] VFIO - User Level meta-driver version: 0.3
[    0.353410] usbcore: registered new interface driver usb-storage
[    0.357327] i2c_dev: i2c /dev entries driver
[    0.359452] i2c 0-0020: Fixed dependency cycle(s) with /i2c@fdd40000/pmic@20/regulators/BOOST
[    0.366973] sdhci: Secure Digital Host Controller Interface driver
[    0.367560] sdhci: Copyright(c) Pierre Ossman
[    0.368799] Synopsys Designware Multimedia Card Interface Driver
[    0.370563] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.374304] ledtrig-cpu: registered to indicate activity on CPUs
[    0.375881] scmi_protocol scmi_dev.1: Enabled polling mode TX channel - prot_id:16
[    0.377008] arm-scmi firmware:scmi: SCMI Notifications - Core Enabled.
[    0.377670] arm-scmi firmware:scmi: SCMI Protocol v2.0 'rockchip:' Firmware version 0x0
[    0.380398] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    0.381754] usbcore: registered new interface driver usbhid
[    0.382267] usbhid: USB HID core driver
[    0.385529] hw perfevents: enabled with armv8_cortex_a55 PMU driver, 7 counters available
[    0.391141] NET: Registered PF_PACKET protocol family
[    0.391683] 9pnet: Installing 9P2000 support
[    0.404424] registered taskstats version 1
[    0.405053] Loading compiled-in X.509 certificates
[    0.426430] fan53555-regulator 0-001c: FAN53555 Option[12] Rev[15] Detected!

So, it just stopped booting without any issues. The leds in the board also stopped blinkin, so it is not communication problem.

[DaniilKl]

Now I wonder, whether my build failed not inside Linux (Linux, when fails, shows kernel oops or kernel panic), but inside OP-TEE or TFA? This would explain why there is no issues from Linux and a bunch of strange OP-TEE logs:

IoUcno
/nUhnr
IeCigIoUcno

Too bad OP-TEE and ATF are binaries supplied from Rockchip.

[DaniilKl]

Closing this PR. OrangePi Code is already merged into develop and OP-TEE development is located in #5.