Skip to content

Releases: hysds/hysds_commons

v1.2.1: HySDS commons utils version 1.2.1

23 Dec 16:52

Choose a tag to compare

v2.0.0: HySDS commons utils version 2.0.0

23 Jul 16:50
730f3ee

Choose a tag to compare

Bug Fixes and Enhancements:

  • HC-530: Updates to support Data in Transit (#66)
    • Initial ES/OP update for DIT
    • Initial OS/ES credentials netrc load and use
    • Tweak interface slightly for credentials
    • Change to default credential entry and use ~/.netrc-os by default
    • auth -> http_auth for opensearchpy call
    • Add connection_class to ES/OS calls for self-signed certs
    • Add ca_certs
    • Add jittered_backoff_class_factory to OS/ES connection
    • Update queue_utils requests call

v1.2.0: HySDS commons utils version 1.2.0

15 Jul 00:18
5dc868f

Choose a tag to compare

Bug Fixes and Enhancements:

  • HC-563: Upgrade to Python 3.12 (#65)
    • Add python_requires='>=3.12' to setup.py
    • Update classifiers to only include Python 3.12
    • Remove future imports as they're not needed in Python 3.12
    • Run pyupgrade --py312-plus to update syntax
    • Update string formatting to use f-strings where appropriate
    • Remove unnecessary file mode 'r' in open() calls

v1.1.6: HySDS commons utils version 1.1.6

06 Jun 01:34

Choose a tag to compare

  • Minor search utils doc fix (#64)

Very minor documentation update to SearchUtility.search_by_id's id
kwarg parameter to address discrepancy between docstring and code.

v1.1.5: HySDS commons utils version 1.1.5

27 Feb 22:02
6b7b1c3

Choose a tag to compare

  • HC-562: Pin numpy<2.0.0 (#62)

This is due to > 2.0.0 being incompatible with the pinned versions of elasticsearch. Otherwise this error appears during cluster provisioning:

module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: Traceback (most recent call last):
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/ops/grq2/scripts/install_base_es_template.py", line 13, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from grq2 import grq_es
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/ops/grq2/grq2/__init__.py", line 11, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from hysds.es_util import get_grq_es, get_mozart_es
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/ops/hysds/hysds/es_util.py", line 8, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from elasticsearch import RequestsHttpConnection as RequestsHttpConnectionES
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/__init__.py", line 36, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from .client import Elasticsearch
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 23, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from ..transport import Transport, TransportError
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/transport.py", line 31, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from .serializer import DEFAULT_SERIALIZERS, Deserializer, JSONSerializer
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/serializer.py", line 50, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     np.float_,
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/conda/lib/python3.9/site-packages/numpy/__init__.py", line 397, in __getattr__
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     raise AttributeError(
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: AttributeError: `np.float_` was removed in the NumPy 2.0 release. Use `np.float64` instead.

Co-authored-by: Mike Cayanan michael.d.cayanan@jpl.nasa.gov

v1.1.4: HySDS commons utils version 1.1.4

31 Oct 20:00
62d88b9

Choose a tag to compare

Bug fixes and enhancements:

  • hot-fix: fix failed unit test (#61)

v1.1.3: HySDS commons utils version 1.1.3

10 Oct 16:45
6bf3fc1

Choose a tag to compare

Bug fixes and enhancements:

  • HC-526: Fix search_by_id function to not throw KeyError: 'hits' error (#60)

v1.1.2: HySDS commons utils version 1.1.2

25 Mar 17:31
6069014

Choose a tag to compare

Bug fixes and enhancements:

  • HC-473: Passthru publish_overwrite_ok in resolve_hysds_job (#55)

v1.1.1: HySDS commons utils version 1.1.1

09 Jan 17:43
8f7b72d

Choose a tag to compare

Bug fixes and enhancements:

  • HC-503: Fixed an issue where job_iterator could return duplicate results (#59)

v1.1.0: Hysds commons utils version 1.1.0

31 Oct 21:35
62d0747

Choose a tag to compare

Specify body of new release. Previous release's body below:

To help you formulate the release body, the list of behind commit messages are provided below:

sha: 62d0747
html_url: 62d0747
message:

HC-484: OpenSearch support (#58)

  • split the ES and Opensearch Utility into 2 classes

fixed bug in _pit where size defaults to 10 when not given
added opensearch-py to setup.py
bumped minor version to 1.1.0

  • able to use multiple hosts in elasticsearch

  • added multi-host to OpenSearchUtility

  • es-oss doesnt support PIT so defaulting to scroll

if user calls _pit, it will then use the search_after w/o _pit


Co-authored-by: dustinlo dustin.k.lo@jpl.nasa.gov