Project Sync fails for ayon-kitsu 1.2.5

[PrettyPurpleInk]

Is there an existing issue for this?

• I have searched the existing issues and added correct labels.

Description

Syncing projects fails with following error:

ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 312, in check_status
ayon-worker-1    | raise NotAuthenticatedException(path)
ayon-worker-1    | gazu.exception.NotAuthenticatedException: data/projects/6bb7b08c-9dc5-474d-a6e6-da86186b60b7/asset-types

As a result newly created assets and changes are not updated in AYON. I downgraded to 1.2.4, replaced the worker with the right version and with the same configuration it works again.

Unfortunately I don't have the Kitsu Logs on hand but it showed a couple of HTTP 200, followed by 401 so the inital login worked. The URL 'api/data/projects/6bb7b08c-9dc5-474d-a6e6-da86186b60b7/asset-types' also works in the browser with the configured credentials.

Steps To Reproduce:

1. Standard configuration with email and password configured, service running and a Kitsu project linked.
2. Manual Sync (Settings/Addon/Kitsu) because automatic Sync did not run.
3. Nothing happened, error only showed in log files of server.

Additional context:

Versions

Version of the server, ayon-core and the addon that's affected
AYON-Server: 1.6.1+202501091712
ayon-kitsu: 1.2.5
ayon-core: 1.0.14
Kitsu: 0.20.25 / ghcr.io/emberlightvfx/kitsu-for-docker:0.20.25

Relevant log output:

ayon-worker-1    | 2025-01-30 10:24:19 INFO       kitsu_processor_1.2.5 Syncing kitsu project 6bb7b08c-9dc5-474d-a6e6-da86186b60b7 to Sharks
ayon-worker-1    | 2025-01-30 10:24:19 ERROR      kitsu_processor_1.2.5 Unable to sync kitsu project Sharks
ayon-worker-1    | 
ayon-worker-1    | Traceback (most recent call last):
ayon-worker-1    | File "/service/processor/processor.py", line 355, in start_processing
ayon-worker-1    | project_full_sync(self, kitsu_project_id, ayon_project_name)
ayon-worker-1    | File "/service/processor/fullsync.py", line 62, in project_full_sync
ayon-worker-1    | asset_types = get_asset_types(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/service/processor/utils.py", line 8, in get_asset_types
ayon-worker-1    | raw_asset_types = gazu.asset.all_asset_types_for_project(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/cache.py", line 204, in wrapper
ayon-worker-1    | return function(*args, **kwargs)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/asset.py", line 275, in all_asset_types_for_project
ayon-worker-1    | return sort_by_name(raw.fetch_all(path, client=client))
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 339, in fetch_all
ayon-worker-1    | return get(url_path_join("data", path), params=params, client=client)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 206, in get
ayon-worker-1    | check_status(response, path)
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 312, in check_status
ayon-worker-1    | raise NotAuthenticatedException(path)
ayon-worker-1    | gazu.exception.NotAuthenticatedException: data/projects/6bb7b08c-9dc5-474d-a6e6-da86186b60b7/asset-types

[Tilix4]

Are you sure you applied the authentication settings from 1.2.4 to 1.2.5? When upgrading an addon in a new bundle the value of Kitsu server is dropped and needs to be set again.

[PrettyPurpleInk]

Yes absolutely sure and also the plugin was able to fetch the Project List, only when synching a project I encountered this error.

I actually had this problem again and this time in 1.2.4. This happened after I had to restart Kitsu and I think the service tried to log in with an invalid access token. The issue is resolved with stopping the Kitsu processor service and starting it again. Restarting the whole AYON server apparently didn't work, that's why I thought it is an issue with AYON-Kitsu 1.2.5.

Logs from 1.2.4:

ayon-worker-1    | 2025-02-13 13:55:10 INFO       kitsu_processor_1.2.4 Syncing kitsu project 6bb7b08c-9dc5-474d-a6e6-da86186b60b7 to Sharks
ayon-worker-1    | 2025-02-13 13:55:10 ERROR      kitsu_processor_1.2.4 Unable to sync kitsu project Sharks
ayon-worker-1    | 
ayon-worker-1    | Traceback (most recent call last):
ayon-worker-1    | File "/service/processor/processor.py", line 339, in start_processing
ayon-worker-1    | full_sync(self, kitsu_project_id, ayon_project_name)
ayon-worker-1    | File "/service/processor/fullsync.py", line 55, in full_sync
ayon-worker-1    | asset_types = get_asset_types(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/service/processor/utils.py", line 8, in get_asset_types
ayon-worker-1    | raw_asset_types = gazu.asset.all_asset_types_for_project(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/cache.py", line 204, in wrapper
ayon-worker-1    | return function(*args, **kwargs)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/asset.py", line 275, in all_asset_types_for_project
ayon-worker-1    | return sort_by_name(raw.fetch_all(path, client=client))
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 339, in fetch_all
ayon-worker-1    | return get(url_path_join("data", path), params=params, client=client)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 206, in get
ayon-worker-1    | check_status(response, path)
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 312, in check_status
ayon-worker-1    | raise NotAuthenticatedException(path)
ayon-worker-1    | gazu.exception.NotAuthenticatedException: data/projects/6bb7b08c-9dc5-474d-a6e6-da86186b60b7/asset-types
ayon-worker-1    | 
ayon-worker-1    | 
ayon-worker-1    | 2025-02-13 13:55:10 INFO       kitsu_processor_1.2.4 Syncing kitsu project 6bb7b08c-9dc5-474d-a6e6-da86186b60b7 to Sharks
ayon-worker-1    | 2025-02-13 13:55:10 ERROR      kitsu_processor_1.2.4 Unable to sync kitsu project Sharks
ayon-worker-1    | 
ayon-worker-1    | Traceback (most recent call last):
ayon-worker-1    | File "/service/processor/processor.py", line 339, in start_processing
ayon-worker-1    | full_sync(self, kitsu_project_id, ayon_project_name)
ayon-worker-1    | File "/service/processor/fullsync.py", line 55, in full_sync
ayon-worker-1    | asset_types = get_asset_types(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/service/processor/utils.py", line 8, in get_asset_types
ayon-worker-1    | raw_asset_types = gazu.asset.all_asset_types_for_project(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/cache.py", line 204, in wrapper
ayon-worker-1    | return function(*args, **kwargs)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/asset.py", line 275, in all_asset_types_for_project
ayon-worker-1    | return sort_by_name(raw.fetch_all(path, client=client))
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 339, in fetch_all
ayon-worker-1    | return get(url_path_join("data", path), params=params, client=client)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 206, in get
ayon-worker-1    | check_status(response, path)
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 312, in check_status
ayon-worker-1    | raise NotAuthenticatedException(path)
ayon-worker-1    | gazu.exception.NotAuthenticatedException: data/projects/6bb7b08c-9dc5-474d-a6e6-da86186b60b7/asset-types
ayon-worker-1    | 
ayon-worker-1    | 
ayon-worker-1    | 2025-02-13 13:55:10 INFO       kitsu_processor_1.2.4 Syncing kitsu project 6bb7b08c-9dc5-474d-a6e6-da86186b60b7 to Sharks
ayon-worker-1    | 2025-02-13 13:55:10 ERROR      kitsu_processor_1.2.4 Unable to sync kitsu project Sharks
ayon-worker-1    | 
ayon-worker-1    | Traceback (most recent call last):
ayon-worker-1    | File "/service/processor/processor.py", line 339, in start_processing
ayon-worker-1    | full_sync(self, kitsu_project_id, ayon_project_name)
ayon-worker-1    | File "/service/processor/fullsync.py", line 55, in full_sync
ayon-worker-1    | asset_types = get_asset_types(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/service/processor/utils.py", line 8, in get_asset_types
ayon-worker-1    | raw_asset_types = gazu.asset.all_asset_types_for_project(kitsu_project_id)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/cache.py", line 204, in wrapper
ayon-worker-1    | return function(*args, **kwargs)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/asset.py", line 275, in all_asset_types_for_project
ayon-worker-1    | return sort_by_name(raw.fetch_all(path, client=client))
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 339, in fetch_all
ayon-worker-1    | return get(url_path_join("data", path), params=params, client=client)
ayon-worker-1    | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 206, in get
ayon-worker-1    | check_status(response, path)
ayon-worker-1    | File "/usr/local/lib/python3.11/site-packages/gazu/client.py", line 312, in check_status
ayon-worker-1    | raise NotAuthenticatedException(path)
ayon-worker-1    | gazu.exception.NotAuthenticatedException: data/projects/6bb7b08c-9dc5-474d-a6e6-da86186b60b7/asset-types

[PrettyPurpleInk]

Another small update: This issue also seems to appear after some time (~2 weeks), maybe when the secret become invalid. Restarting the Kitsu service does solve it again.

[runegan]

Running into the same issues here. I don't have access to the logs unfortunately, but can report that sometimes it does not sync some assets or tasks, and also every two weeks or so i need to restart the service for it to start working again.