Streaming data through aria SDK failed

[Pittmann-XIE]

Hi. I was testing the provided script ''undistort_rgb_image.py" of aria sdk.

Problem

It shows two blank windows, which means 'observer.rgb_image' is None. There's no error while executing this script (''undistort_rgb_image.py").

Here is the environment of my case:

ubuntu 22.04.1
python 3.10.18
projectaria-client-sdk 1.1.0
projectaria-tools 1.5.2a1
scripts to execute: https://facebookresearch.github.io/projectaria_tools/docs/ARK/sdk/setup
command to reproduce: python3 undistort_rgb_image.py --interface usb --update_iptables

it's related to #275

[amygh9]

Hey, I’m experiencing the same problem as well.

[davidelic]

I am experiencing the same issue as well

[algvr]

I am facing this issue as well

[Tarunstk]

Hi @algvr @amygh9 @davidelic could you please try this with python 3.11 and let me know if this improves?

[Tarunstk]

@algvr @amygh9 @davidelic please let me know if you are able to get unblocked.

[algvr]

Hello @Tarunstk, I tried Python 3.10, 3.11, 3.12. Same issue. The determining factor seems to be the host device, since it works on some PCs and not on others. I tried different Nvidia driver versions as well with no effect.

[Tarunstk]

@algvr could you be more specific as to which host pc's are working and not working. As per our reproduction linux distro's fedora and ubuntu are not having this visualisation issue with python 3.11. If you could list the host systems you are trying this on that would be very helpful. Thanks.

[Pittmann-XIE]

@Tarunstk Hi. I am using Ubuntu 22.04. I also tried Python 3.11. It doesn't work.

[Tarunstk]

Could you share a screenshot of what you are experiencing when you try this command? And was this working previously?

[Pittmann-XIE]

Hi, Here is what I got. @Tarunstk

The log of execution:

The internet situdation:

aria: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.42.118 netmask 255.255.255.0 broadcast 192.168.42.255
inet6 fe80::fcfe:78ff:fe38:f03a prefixlen 64 scopeid 0x20
ether fe:fe:78:38:f0:3a txqueuelen 1000 (Ethernet)
RX packets 44 bytes 24703 (24.7 KB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 218 bytes 202706 (202.7 KB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

br-a46765142324: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.18.0.1 netmask 255.255.0.0 broadcast 172.18.255.255
inet6 fe80::3c96:23ff:febc:8cb4 prefixlen 64 scopeid 0x20
ether 3e:96:23:bc:8c:b4 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

docker0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 172.17.0.1 netmask 255.255.0.0 broadcast 172.17.255.255
ether f6:ea:b7:1b:bc:85 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

enp4s0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
ether d4:93:90:14:9e:52 txqueuelen 1000 (Ethernet)
RX packets 3 bytes 180 (180.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 52 bytes 6736 (6.7 KB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

enx08beac364017: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 10.0.0.2 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::1886:6c28:616e:53dd prefixlen 64 scopeid 0x20
ether 08:be:ac:36:40:17 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 1000 (Local Loopback)
RX packets 93277 bytes 164773917 (164.7 MB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 93277 bytes 164773917 (164.7 MB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

vethcb0418f: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::c4f6:93ff:fe08:4c9b prefixlen 64 scopeid 0x20
ether c6:f6:93:08:4c:9b txqueuelen 0 (Ethernet)
RX packets 557 bytes 40578 (40.5 KB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 539 bytes 239711 (239.7 KB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

wlp0s20f3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.18.0.70 netmask 255.255.252.0 broadcast 172.18.3.255
inet6 fe80::d89d:d41:308:785c prefixlen 64 scopeid 0x20
ether c4:03:a8:02:44:5a txqueuelen 1000 (Ethernet)
RX packets 23856 bytes 21722325 (21.7 MB)
RX errors 0 dropped 21 overruns 0 frame 0
TX packets 12286 bytes 6314575 (6.3 MB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

[Tarunstk]

@Pittmann-XIE Hmm this is weird. I had this same issue reproduced locally and was able to get the sensor stream and feed after downgrading to python 3.11. However I did this on fedora. Wonder if a Wayland dependency is deprecated or missing in your setup.

Let me reproduce this on an ubuntu and get back to you with my findings.

[Pittmann-XIE]

@Tarunstk Hi. Any updates?

[TX-Leo]

It does work for me:

ubuntu 22.04.5
Python 3.11.14
projectaria-client-sdk 1.1.0
projectaria-tools 1.5.2a1

[Tarunstk]

Thanks for confirming. @TX-Leo

@Pittmann-XIE @algvr are you using a virtual machine? This is not supported on virtual machines as the ports are not forwarded reliably.

[Tarunstk]

Hey @Pittmann-XIE @algvr any updates. Are you using VM/cloud machines?