Skip to content

Manage increasing size of job logs #639

@sakshamarora1

Description

@sakshamarora1
  1. Fix jobs with constant errors and evaluate what to log. For eg. Orcid job
  2. Setup ILM policy: Setup ILM policy for datastream #364, mainly need:
  • a rollover policy
  • an auto deletion policy after a certain time (this should also decrease the log size)

Might be possible to quickly rollover manually now and delete the old backing index after a month(or whatever time period is decided)
[This is only to have more time to work on this setup]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions