v2.0.0

Version Number

2.0.0-894

Breaking Changes

• US593021: Nashorn script engine is no longer supported.

New Features

• US593021: Updated to run on Java 17.

Bug Fixes

• US607098: Fixed a potential issue in the 'Stale batches cleanup' scheduler, due to a change in the behavior
  of Instant.now() method between JDK8 and later versions causing a change in how the directories are named.

Patch Fixes Included

• US572082: Gson version upgraded to 2.9.1
• US572083: Snakeyaml version upgraded to 1.32

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:2.0.0-894 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:2.0.0-894 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:2.0.0-894 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:2.0.0-894 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:2.0.0-894 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:2.0.0-894 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:2.0.0-894 (jar.md5,jar.sha1,[jar](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/staging-service-acceptance-tests/2.0.0-894/staging-service-acceptance-...

v1.6.0

Version Number

1.6.0-873

New Features

• US568175: The number of subdocuments sent for ingestion can now be restricted in the batch-ingestion-plugin.

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:1.6.0-873 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:1.6.0-873 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:1.6.0-873 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:1.6.0-873 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:1.6.0-873 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:1.6.0-873 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:1.6.0-873 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,[pom](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/staging-service-ac...

v1.5.0

Version Number

1.5.0-864

New Features

• D453042: Added disk access health check feature

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:1.5.0-864 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:1.5.0-864 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:1.5.0-864 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:1.5.0-864 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:1.5.0-864 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:1.5.0-864 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:1.5.0-864 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,[pom](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/staging-service-acceptance-tests/1.5.0-864/staging-service-ac...

v1.4.0

Version Number

1.4.0-836

New Features

• 397426: Format of logging has been changed to include the UTC Date alongside UTC Time
• 359648: Added support for a new leaner message format
  The Worker Framework previously defined the task-specific part of its message (which is the vast majority of the message) as a byte array. As messages are normally passed in JSON, this was serialized as a base64 encoded string, which added~33% to the size of the task data. Given that the task-specific part of the message is itself normally JSON, the Worker Framework has now been updated to embed this directly and avoid the overhead. This significantly reduces the message size.

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:1.4.0-836 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:1.4.0-836 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:1.4.0-836 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:1.4.0-836 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:1.4.0-836 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:1.4.0-836 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:1.4.0-836 (jar.md5,jar.sha1,[jar](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/staging-service-acceptance-tests/1.4...

v1.3.0

Version Number

1.3.0-710

New Features

• SCMOD-14691: GraalVM JavaScript support
  The Batch Ingestion Worker has been updated to support specifying that the GraalVM JavaScript engine should be used to execute scripts. The graaljs: prefix can be used in place of the current prefix to indicate that the Graal engine should be used.

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:1.3.0-710 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:1.3.0-710 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:1.3.0-710 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:1.3.0-710 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:1.3.0-710 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:1.3.0-710 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:1.3.0-710 (jar.md5,jar.sha1,jar,pom.md5,[pom.sha1](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/stagin...

v1.2.0

Version Number

1.2.0-605

New Features

• SCMOD-12730: Added pause task support.
  • When a worker receives a task, it will now check if the task has been paused.
  • If the task has been paused, and the CAF_WORKER_PAUSED_QUEUE environment variable is set, the worker will publish the task to the
    CAF_WORKER_PAUSED_QUEUE instead of processing it.
  • If the task has been paused, and the CAF_WORKER_PAUSED_QUEUE environment variable is NOT set, the worker process the task as
    normal (as if the task was not paused).

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:1.2.0-605 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:1.2.0-605 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:1.2.0-605 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:1.2.0-605 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:1.2.0-605 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:1.2.0-605 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:1.2.0-605 (jar.md5,jar.sha1,jar,[pom.md5](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/sta...

v1.1.1

Version Number

1.1.1-512

New Features

• None

Bug Fixes

• SCMOD-11105: Fix to prevent a NullPointerException

Known Issues

• None

Release Artifacts

Maven

• com.github.cafdataprocessing:staging-service-aggregator:1.1.1-512 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:worker-batch-ingestion-container:1.1.1-512 (pom.md5,pom.sha1,pom)
• com.github.cafdataprocessing:staging-service-container:1.1.1-512 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:worker-batch-ingestion-plugin:1.1.1-512 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-contract:1.1.1-512 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-client:1.1.1-512 (jar.md5,jar.sha1,jar,javadoc.jar.md5,javadoc.jar.sha1,javadoc.jar,pom.md5,pom.sha1,pom,sources.jar.md5,sources.jar.sha1,sources.jar)
• com.github.cafdataprocessing:staging-service-acceptance-tests:1.1.1-512 (jar.md5,jar.sha1,jar,pom.md5,pom.sha1,[pom](https://oss.sonatype.org/content/groups/public/com/github/cafdataprocessing/staging-service-acceptance-tests/1.1.1-512/staging-...

v1.1.0

Version Number

1.1.0-409

New Features for staging-service

• SCMOD-9780: Updated images to use Java 11
• SCMOD:10129: Introduced configurable healthcheck timeout failure for NFS services.

New Features for worker-batch-ingestion

• SCMOD-9780: Updated images to use Java 11
• SCMOD-10198: Ingestion Worker Batch updated to 3.3.0 which inherited the features from worker framework 3.4.0
  • SCMOD-8463: Confirm health checks before starting
  • SCMOD-9102: New filesystem health check
  • SCMOD-4887: Poison message recording

Bug Fixes

• SCMOD-9626: Security hardening by upgrading the jackson version.

Known Issues

• None

v1.0.1

Version Number

1.0.1-340

New Features

• None

Bug fixes

• SCMOD-7829: Correct invalid offerings on admin port

  • Admin port root context now redirects to healthcheck endpoint
  • Swagger page no longer available on admin port

• SCMOD-8228: Tenant id is now set in logs.

• SCMOD-8520: Updated to use security hardened base images

Known Issues

• None

v1.0.0

Version Number

1.0.0-212

New Features

• Initial Release

Known Issues

• None