Skip to content

Migrate to API-based catalog generation #21

@jbkolze

Description

@jbkolze

Due to the workflow being used for the batch-jobs container (i.e. standard WM image that pulls from GitHub at runtime) it likely won't be feasible to incorporate catalog creation into the CI process.

In lieu, the simplest route infrastructure-wise will likely be to manage catalog generation through the API itself. When a catalog is requested, the API could use this workflow:

  1. If available, reference catalog from API in-memory store
  2. If not in memory, reference catalog from S3 store (and save in-memory)
  3. If catalog reference older than 1 hour (?), update S3/memory catalog based on current GitHub catalog

Also, add an endpoint that can be used to force the API to update based on the current GitHub catalog. Could possibly tie this to dev/admin permissions?

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions