U2Net Model Example Runs Once Successfully, Crashes After

[lawlcakez]

Version

^0.2.3

Problem Area

react-native-pytorch-core (core package)

Steps to Reproduce

1. Run u2net model example using example code from https://playtorch.dev/snack/@playtorch/u2net/.
2. Successfully generates mask on first run, crashes after trying to run past that.

Expected Results

Model should run without crashing after first run.

Crash Logs:

12-10 18:51:24.290 20638 20638 F DEBUG : backtrace:
12-10 18:51:24.290 20638 20638 F DEBUG : #00 pc 0000000000051b20 /apex/com.android.runtime/lib64/bionic/libc.so (abort+168) (BuildId: 73e145ce4e1dfca57a8eaf6d29c1d3fe)
12-10 18:51:24.290 20638 20638 F DEBUG : #1 pc 000000000009ce88 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libc++_shared.so (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 18:51:24.290 20638 20638 F DEBUG : #2 pc 000000000009d07c /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libc++_shared.so (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 18:51:24.290 20638 20638 F DEBUG : #3 pc 00000000000aead0 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libc++_shared.so (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 18:51:24.290 20638 20638 F DEBUG : #4 pc 00000000000aea68 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libc++_shared.so (std::terminate()+36) (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 18:51:24.290 20638 20638 F DEBUG : #5 pc 000000000003cff0 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libtorchlive.so (__clang_call_terminate+8) (BuildId: 0a803d5f698a12e07d4c31b32095ee75a8eefd87)
12-10 18:51:24.290 20638 20638 F DEBUG : #6 pc 0000000000088f00 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libtorchlive.so (torchlive::media::Image::~Image()+92) (BuildId: 0a803d5f698a12e07d4c31b32095ee75a8eefd87)
12-10 18:51:24.290 20638 20638 F DEBUG : #7 pc 0000000000043874 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libtorchlive.so (torchlive::media::ImageHostObject::~ImageHostObject()+76) (BuildId: 0a803d5f698a12e07d4c31b32095ee75a8eefd87)
12-10 18:51:24.290 20638 20638 F DEBUG : #8 pc 000000000001cc20 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes-executor-release.so (facebook::jsi::DecoratedHostObject::~DecoratedHostObject()+76) (BuildId: f9ec095fd26bd03ab3b56d56ec655670c546c472)
12-10 18:51:24.290 20638 20638 F DEBUG : #9 pc 000000000007033c /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #10 pc 00000000000798fc /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #11 pc 0000000000131190 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #12 pc 000000000013326c /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #13 pc 0000000000138d38 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #14 pc 0000000000137a54 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #15 pc 000000000013861c /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #16 pc 00000000001384b4 /data/app/~~tGo_W1LgnykvwiT9t7jBtQ==/dev.playtorch-NUv9YPDoqWoQiv-dKR2ylA==/lib/arm64/libhermes.so (BuildId: 957ec0f39e08feadc6d0ec99bbe00fa14a3687b3)
12-10 18:51:24.290 20638 20638 F DEBUG : #17 pc 00000000000b6e44 /apex/com.android.runtime/lib64/bionic/libc.so (__pthread_start(void*)+264) (BuildId: 73e145ce4e1dfca57a8eaf6d29c1d3fe)
12-10 18:51:24.290 20638 20638 F DEBUG : #18 pc 0000000000053454 /apex/com.android.runtime/lib64/bionic/libc.so (__start_thread+68) (BuildId: 73e145ce4e1dfca57a8eaf6d29c1d3fe)
12-10 19:15:44.434 21437 21567 F libc : Fatal signal 6 (SIGABRT), code -1 (SI_QUEUE) in tid 21567 (hades), pid 21437 (.faceapp_native)
12-10 19:15:45.014 26451 26451 F DEBUG : *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
12-10 19:15:45.014 26451 26451 F DEBUG : Build fingerprint: 'samsung/d2xq2sq/d2xq2:12/SP1A.210812.016/N976USQS5GVJ2:user/release-keys'
12-10 19:15:45.014 26451 26451 F DEBUG : Revision: '18'
12-10 19:15:45.014 26451 26451 F DEBUG : ABI: 'arm64'
12-10 19:15:45.014 26451 26451 F DEBUG : Processor: '5'
12-10 19:15:45.014 26451 26451 F DEBUG : Timestamp: 2022-12-10 19:15:44.601109083-0500
12-10 19:15:45.014 26451 26451 F DEBUG : Process uptime: 972s
12-10 19:15:45.014 26451 26451 F DEBUG : Cmdline: com.faceapp_native
12-10 19:15:45.014 26451 26451 F DEBUG : pid: 21437, tid: 21567, name: hades >>> com.faceapp_native <<<
12-10 19:15:45.014 26451 26451 F DEBUG : uid: 10751
12-10 19:15:45.014 26451 26451 F DEBUG : signal 6 (SIGABRT), code -1 (SI_QUEUE), fault addr --------
12-10 19:15:45.014 26451 26451 F DEBUG : Abort message: 'terminating with uncaught exception of type std::runtime_error: Unable to retrieve jni environment. Is the thread attached?'
12-10 19:15:45.014 26451 26451 F DEBUG : x0 0000000000000000 x1 000000000000543f x2 0000000000000006 x3 0000006fb83fb050
12-10 19:15:45.014 26451 26451 F DEBUG : x4 736f646277641f73 x5 736f646277641f73 x6 736f646277641f73 x7 7f7f7f7f7f7f7f7f
12-10 19:15:45.014 26451 26451 F DEBUG : x8 00000000000000f0 x9 84d37911297e4f60 x10 0000000000000000 x11 ffffff80fffffbdf
12-10 19:15:45.014 26451 26451 F DEBUG : x12 0000000000000001 x13 0000000063952130 x14 0018fcfca9eed265 x15 0000db9016d3ed9a
12-10 19:15:45.014 26451 26451 F DEBUG : x16 000000734fdc4060 x17 000000734fda0980 x18 0000006ef44fa000 x19 00000000000053bd
12-10 19:15:45.014 26451 26451 F DEBUG : x20 000000000000543f x21 00000000ffffffff x22 ffffff80ffffffc8 x23 0000006fb83fb2a0
12-10 19:15:45.014 26451 26451 F DEBUG : x24 0000006fb83fb180 x25 0000006fb83fb1c0 x26 0000006ef7400000 x27 0000000000000001
12-10 19:15:45.014 26451 26451 F DEBUG : x28 0000006fde5b0fd0 x29 0000006fb83fb0d0
12-10 19:15:45.014 26451 26451 F DEBUG : lr 000000734fd50af4 sp 0000006fb83fb030 pc 000000734fd50b20 pst 0000000000000000
12-10 19:15:45.014 26451 26451 F DEBUG : backtrace:
12-10 19:15:45.014 26451 26451 F DEBUG : #00 pc 0000000000051b20 /apex/com.android.runtime/lib64/bionic/libc.so (abort+168) (BuildId: 73e145ce4e1dfca57a8eaf6d29c1d3fe)
12-10 19:15:45.014 26451 26451 F DEBUG : #1 pc 000000000009ce88 /data/app/~~oaswytM_7c70c2x3P691BQ==/com.faceapp_native-jBo2sa_SNO0cIvjju4fygw==/lib/arm64/libc++_shared.so (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 19:15:45.014 26451 26451 F DEBUG : #2 pc 000000000009d07c /data/app/~~oaswytM_7c70c2x3P691BQ==/com.faceapp_native-jBo2sa_SNO0cIvjju4fygw==/lib/arm64/libc++_shared.so (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 19:15:45.014 26451 26451 F DEBUG : #3 pc 00000000000aead0 /data/app/~~oaswytM_7c70c2x3P691BQ==/com.faceapp_native-jBo2sa_SNO0cIvjju4fygw==/lib/arm64/libc++_shared.so (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 19:15:45.014 26451 26451 F DEBUG : #4 pc 00000000000aea68 /data/app/~~oaswytM_7c70c2x3P691BQ==/com.faceapp_native-jBo2sa_SNO0cIvjju4fygw==/lib/arm64/libc++_shared.so (std::terminate()+36) (BuildId: 31abebc1b564add54fe43b52ce69acac326be4fe)
12-10 19:15:45.014 26451 26451 F DEBUG : #5 pc 00000000000f5944 /data/app/~~oaswytM_7c70c2x3P691BQ==/com.faceapp_native-jBo2sa_SNO0cIvjju4fygw==/lib/arm64/libtorchlive.so (BuildId: d34f8f8b13b73951fb8c4c9ffe73069a41558283)

Code example, screenshot, or link to repository

No response

[raedle]

Thanks for reporting this issue, @lawlcakez! We are able to reproduce the issue and submitted a potential fix in #177 (see before/after screencasts below).

The fix will eventually be available in the next PlayTorch app release v0.1.3.

If you need the fix faster, it will be available in a react-native-pytorch-core nightly build after the fix merged. Then, there are two options:

1. Build the PlayTorch app locally. I submitted a PR with basic instructions to build the app for Android and iOS (Basic instructions to build the PlayTorch app #178). It'll require to upgrade the react-native-pytorch-core version in the app/package.json from 0.2.3 to the nightly version.
2. Build a custom Expo app (see instructions Expo App in the PlayTorch Get Started section)

I will close the issue. Feel free to reopen the issue if there issue isn't solved with #177

Before

u2net_crashes.mp4

After

u2net_works.mp4

[raedle]

@lawlcakez, we landed a fix, which is available in the latest react-native-pytorch-core@nighly

[lawlcakez]

@raedle, thanks! Just implemented the nightly fix and can confirm the crash no longer happens on my native app.