v5.5.2: HySDS Framework version 5.5.2

Patch release with:

• hysds-dockerfiles v5.5.2
• hysds_commons v1.2.1
• hysds v1.4.3
• lightweight-jobs v1.4.1
• hysds_ui v1.1.12
• pele v1.3.1

v5.5.1: HySDS Framework version 5.5.1 (Austin Reeves)

Patch release with HC-598 and
HC-599 fixes:

• hysds v1.4.2: Remove duplicate context field from job_status documents
• chimera v2.3.1: Update context field path to use job.context instead of top-level context

v6.0.3: HySDS Framework version 6.0.3 (Pluribus)

Bug fixes and enhancements:

hysds[v2.0.3]

https://github.com/hysds/hysds/releases/tag/v2.0.3

Bug Fixes and Enhancements:

• Fix HC-594: Prevent partial job status records missing @timestamp (#209)

Fixed race condition where watchdog scripts created partial OpenSearch
records with only 5 fields instead of the required 21+ fields, causing
Figaro UI to show inconsistent results due to missing @timestamp field.

hysds-dockerfiles[v6.0.3]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v6.0.3

Bug Fixes and Enhancements:

• bump to v6.0.3

v6.0.2: HySDS Framework version 6.0.2 (Cooper Flagg)

Bug fixes and enhancements:

hysds[v2.0.2]

https://github.com/hysds/hysds/releases/tag/v2.0.2

Bug Fixes and Enhancements:

• HC-593: Support for persisting environment variables during docker run commands (#208)
  • Fix environment variable expansion in runtime_options

hysds-dockerfiles[v6.0.2]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v6.0.2

Bug Fixes and Enhancements:

• HC-588: Update Docker Entrypoint Scripts to Use ENV VARS for services (#15)

• bump to v6.0.2

osaka[v1.3.1]

https://github.com/hysds/osaka/releases/tag/v1.3.1

Bug fixes and enhancements:

• HC-589: Add dynamic S3 bucket region detection (#42)

hysds_ui[v1.1.11]

https://github.com/hysds/hysds_ui/releases/tag/v1.1.11

Bug fixes and enhancements:

• HC-101: implementation of confirmation modal and various improvements to on-demand job submission
  • Add venue configuration and display in top banner
  • Only show confirmation modal if result set count exceeds some configurable value (default 1000)

v6.0.1: HySDS Framework version 6.0.1 (Leon Prater)

Bug fixes and enhancements:

hysds[v2.0.1]

https://github.com/hysds/hysds/releases/tag/v2.0.1

Bug Fixes and Enhancements:

• HC-575: Resolve checksum mismatch issue in dataset publishing (#205)

• HC-581: Resolve issue where job fails due to .running file not found (#207)

hysds-dockerfiles[v6.0.1]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v6.0.1

Bug Fixes and Enhancements:

• HC-579: Use Oracle Linux 8 Slim Container as the base image

• bump to version 6.0.1

v6.0.0: HySDS Framework version 6.0.0 (The Fantastic Four: First Steps)

To help you formulate the release body, links to updated repo releases are listed below:

Bug fixes and enhancements:

grq2[v2.3.0]

https://github.com/hysds/grq2/releases/tag/v2.3.0

Bug fixes and enhancements:

• HC-530: Updates to support Data in Transit (#69)
  • Added JitteredBackoffException for better resliency when making OpenSearch request calls

hysds[v2.0.0]

https://github.com/hysds/hysds/releases/tag/v2.0.0

Bug Fixes and Enhancements:

• HC-530: Updates to support Data in Transit (#206)
  • Enable SSL/TLS for gunicorn for Mozart and GRQ API endpoints
  • Update API endpoints for https

hysds-dockerfiles[v6.0.0]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v6.0.0

• bump latest_release to v6.0.0

hysds_commons[v2.0.0]

https://github.com/hysds/hysds_commons/releases/tag/v2.0.0

Bug Fixes and Enhancements:

• HC-530: Updates to support Data in Transit
  • Initial ES/OP update for DIT
  • Initial OS/ES credentials netrc load and use
  • Tweak interface slightly for credentials
  • Change to default credential entry and use ~/.netrc-os by default
  • auth -> http_auth for opensearchpy call
  • Add connection_class to ES/OS calls for self-signed certs
  • Add ca_certs
  • Add jittered_backoff_class_factory to OS/ES connection
  • Update queue_utils requests call

lightweight-jobs[v2.0.0]

https://github.com/hysds/lightweight-jobs/releases/tag/v2.0.0

Bug fixes and enhancements:

• HC-530: Updates to support Data in Transit (#39)
  • Mount the new netrc-os file to the jobs, which allows authentication into DIT OpenSearch

mozart[v3.0.0]

https://github.com/hysds/mozart/releases/tag/v3.0.0

Bug fixes and enhancements:

• HC-530: Updates to support Data in Transit (#57)
  • Update http->https

sdscli[v2.0.0]

https://github.com/hysds/sdscli/releases/tag/v2.0.0

Bug fixes and Enhancements:

• HC-530 and HC-539 - Updates to support Data in Transit; Enable https for RabbitMQ reset (#110)
  • Enable https for RabbitMQ reset
  • Update RabbitMQ connection to use custom cipher as well as verify with ca-bundle
  • Update redis-cli call to enable SSL/TLS with cacert
  • Remove metrics TLS
  • Update GRQ_REST_URL and GRQ_UPDATE_URL to https
  • Add TLS for metrics redis-cli
  • Quiet down tar and aws commands
  • Quiet rsync as well
  • Update rabbitmq_queues_flush delete to use custom SSL cipher
  • Wrap tar/aws/rsync calls with debug check for stdout file listings
  • Ship netrc-os for verdi
  • Send netrc-os to the right place for shipment
  • Ship netrc-os to Factotum
  • Update netrc-os ship location
  • Update send_template command
  • use GRQ to check status of dashboard; use Mozart for curl
  • Also add global securitytenant as a header parameter to ensure stuff goes to the correct place
  • wire out certificate files and ciphers to SDS/celery configs

v5.5.0: HySDS Framework version 5.5.0 (Superman)

Bug fixes and enhancements:

chimera[v2.3.0]

https://github.com/hysds/chimera/releases/tag/v2.3.0

Bug fixes and enhancements:

• HC-563: Migrate for Python 3.12 compatibility (#26)
  • Add development dependencies for Python 3.12 upgrade testing
  • Add pytest framework with coverage and mocking support
  • Include code quality tools (black, isort, flake8, pylint, mypy)
  • Add pyupgrade for Python 3.12 syntax modernization
  • Include performance testing with pytest-benchmark
  • Support parallel test execution with pytest-xdist

These dependencies enable comprehensive unit testing during the
Python 3.12 migration process.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Create unit test directory structure

Initialize tests/unit/ directory for isolated unit tests that don't
require external services or specific local development environments.

This structure supports the Python 3.12 migration testing strategy
by providing a clean separation between unit tests and the existing
integration-style tests.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Add test fixtures and pytest configuration

• Create comprehensive test fixtures for configuration files:

  • sample_chimera_config.yaml - Valid chimera configuration
  • sample_pge_config.json - Valid PGE configuration
  • sample_sf_context.json - Valid SciFlo context
  • sample_settings.yaml - Valid settings file
  • invalid_config.yaml - Invalid YAML for error testing

• Add conftest.py with shared pytest fixtures for:

  • Fixture path management
  • Temporary file/directory creation
  • Consistent test data access across test modules

These fixtures enable isolated testing without external dependencies
or hardcoded local paths, supporting reliable Python 3.12 migration
validation.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Add comprehensive unit tests for ChimeraConstants

Implement 21 test cases covering:

• Constant value validation and correctness
• String type enforcement for all constants
• Uniqueness validation (no duplicate values)
• Accessibility from both class and instance
• Integration patterns (dict keys, string operations)
• Immutability concepts and best practices

Tests achieve 100% coverage of chimera.commons.constants module
and validate all expected constants are properly defined with
correct values.

This establishes a solid foundation for regression testing during
the Python 3.12 migration process.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Add comprehensive unit tests for configuration utilities

Implement 22 test cases covering YamlConf class and load_config function:

YamlConf class tests:

• Initialization with valid/invalid YAML files
• Property access (file, cfg) and error handling
• Configuration key retrieval and missing key exceptions
• String representation and JSON serialization
• Mock-based testing for file operations

load_config function tests:

• YAML and JSON file loading with proper format detection
• Error handling for non-existent and malformed files
• File extension validation and unsupported format rejection
• OrderedDict preservation for JSON files
• Integration with YamlConf for YAML processing

Tests achieve 71% coverage of chimera.commons.conf_util module,
focusing on critical paths and error scenarios. Missing coverage
is primarily in unused utility classes.

All tests use isolated fixtures and mocking, eliminating dependencies
on external services or specific file system layouts.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Add Phase 1 test execution script and documentation

• Add test_phase1.sh: Docker-based test runner for Phase 1 unit tests

  • Uses Python 3.12 container for consistent testing environment
  • Installs dependencies and runs tests with coverage reporting
  • Provides clear output formatting and completion status

• Add UNIT_TESTING_PLAN.md: Comprehensive testing strategy documentation

  • 4-phase testing approach for Python 3.12 migration
  • Mock strategies for external dependencies
  • Test infrastructure setup and success criteria
  • Integration guidelines with migration plan

Phase 1 testing validates configuration utilities and constants
with 43 test cases achieving 79% overall coverage. All tests pass
in Python 3.12 environment, establishing baseline for migration
validation.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Add Docker-based development scripts for Python 3.12

• tests/test.sh: Run pytest in Python 3.12 Docker container
• tests/lint.sh: Run flake8, black, and isort checks in Docker
• tests/format.sh: Apply pyupgrade, black, and isort formatting in Docker

All scripts use python:3.12 container for consistent development environment.
Scripts are executable and handle non-TTY environments properly.
Placed in tests/ directory to keep repository root clean.
Part of Phase 2: Docker Remote Interpreter Setup.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Update CLAUDE.md with Docker-based development workflow

• Document Python 3.12 Docker container usage for development
• Add Docker workflow commands for testing and code quality
• Update script paths to tests/ directory location
• Provide both Docker and traditional development options
• Include interactive development session instructions

Part of Phase 2: Docker Remote Interpreter Setup.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Apply Python 3.12 code formatting and modernization

• Run pyupgrade --py312-plus on all Python files
• Apply black code formatter for consistent style
• Apply isort for standardized import ordering
• Reduce flake8 issues from 30+ to 13 minor violations
• Modernize string formatting and code patterns
• All 30 unit tests continue to pass after formatting

Automated formatting improves code quality and consistency.
Part of Phase 2: Docker Remote Interpreter Setup.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Document Phase 2 completion in Python 3.12 upgrade plan

• Mark Phase 2: Docker Remote Interpreter Setup as completed
• Document key achievements and implementation details
• Record testing results: 30 unit tests passing in Python 3.12
• Note code quality improvements: reduced flake8 issues
• Update status of all Phase 2 objectives as completed

Phase 2 successfully establishes Docker-based development workflow.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Remove duplicate development scripts from repository root

Scripts were moved to tests/ directory in previous commit.
Keeping repository root clean by removing duplicates.

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

• Organize repository structure and update gitignore

• Move plan documents to plans/ directory for better organization
• Add .claude/ and .serena/ to gitignore (AI assistant directories)
• Add *.egg-info/, .coverage, .pytest_cache/ to gitignore
• Keep repository root clean with dedicated plans directory

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com

---

Co-authored-by: Mike Cayanan michael.d.cayanan@jpl.nasa.gov
Co-authored-by: Sujen Shah sujen1412@gmail.com
Co-authored-by: Claude noreply@anthropic.com

container-builder[v1.1.0]

https://github.com/hysds/container-builder/releases/tag/v1.1.0

Bug fixes and enhancements:

• HC-563: python 3.12 compatability updates (#18)

grq2[v2.2.0]

https://github.com/hysds/grq2/releases/tag/v2.2.0

Bug fixes and enhancements:

• HC-563: Python3.12 Compatibility updates (#68)
  • Update Python syntax for Python 3.12 compatibility using pyupgrade
    • Removed Python 2 compatibility imports (future, builtins, standard_library)
    • Modernized string formatting to use f-strings and .format()
    • Added raw string prefix to regular expressions
    • Improved code style and formatting
  • Update dependencies and code for Python 3.12 compatibility
    • Updated Redis client to use 'Redis' instead of 'StrictRedis'
    • Improved error handling and progress reporting in copy_index.py
  • Update configuration and dependencies for Python 3.12 compatibility
    • Update .gitignore to exclude local config files
    • Fix path resolution for settings.cfg in init.py
    • Update dependencies in setup.py for Python 3.12 compatibility
    • Add jsonschema and referencing as explicit dependencies
  • mechanism to newer way to call current time in UTC, but maintaining backwards compatibility
  • use timezone.utc instead to be 3.9/3.12 compatible

---

hysds[v1.4.0]

https://github.com/hysds/hysds/releases/tag/v1.4.0

Bug Fixes and Enhancements:

• HC-563: Upgrade to Python 3.12 compatibility (#203)
  • Update datetime.utcnow() to datetime.now(UTC)
  • Replace logger.warn() with logger.warning()
  • Update timezone handling to use UTC explicitly
  • Fix test assertions and imports
  • Modernize string formatting: convert %-style to f-strings across codebase
  • Convert 35+ remaining %-style string formatting patterns to f-strings using flynt and manual fixes
  • Update 67 files including core modules (orchestrator, job_worker, dataset_ingest) and utility scripts
    ...

v5.4.3: HySDS Framework version 5.4.3 (Spontaneous Water Cooler Talks)

Bug fixes and enhancements:

hysds[v1.3.8]

https://github.com/hysds/hysds/releases/tag/v1.3.8

Bug Fixes and Enhancements:

• HC-573: Pin gevent to resolve job submit error (#204)

hysds-dockerfiles[v5.4.3]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v5.4.3

• bump to v5.4.3

hysds_commons[v1.1.6]

https://github.com/hysds/hysds_commons/releases/tag/v1.1.6

• Minor search utils doc fix (#64)

Very minor documentation update to SearchUtility.search_by_id's id
kwarg parameter to address discrepancy between docstring and code.

mozart[v2.3.2]

https://github.com/hysds/mozart/releases/tag/v2.3.2

Bug fixes and enhancements:

• HC-573: Pin gevent to resolve job submit error (#55)

v5.4.2: HySDS Framework version 5.4.2 (Spontaneous In-Person Interactions)

Bug fixes and enhancements:

hysds[v1.3.7]

https://github.com/hysds/hysds/releases/tag/v1.3.7

Bug Fixes and Enhancements:

• HC-571: Make cache optionally writeable; provide mechanism to prevent cache eviction; use HYSDS_ROOT_WORK_DIR for cache base (#201)

sdscli[v1.3.5]

https://github.com/sdskit/sdscli/releases/tag/v1.3.5

Bug fixes and Enhancements:

• HC-568: Pin setuptools to less than 80.0.0 (#111)

lightweight-jobs[v1.3.4]

https://github.com/hysds/lightweight-jobs/releases/tag/v1.3.4

Bug fixes and enhancements:

• HC-572: Update purge job to ignore 404 errors when trying to delete documents (#37)

v5.4.1: HySDS Framework version 5.4.1 (Broncic)

Bug fixes and enhancements:

hysds[v1.3.6]

https://github.com/hysds/hysds/releases/tag/v1.3.6

Bug Fixes and Enhancements:

• HC-565: Increase timeout thresholds in the RabbitMQ configuration file (#200)

hysds-dockerfiles[v5.4.1]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v5.4.1

• bump to v5.4.1