Releases: hysds/hysds_commons
v1.2.1: HySDS commons utils version 1.2.1
Full Changelog: v1.2.0...v1.2.1
v2.0.0: HySDS commons utils version 2.0.0
Bug Fixes and Enhancements:
- HC-530: Updates to support Data in Transit (#66)
- Initial ES/OP update for DIT
- Initial OS/ES credentials netrc load and use
- Tweak interface slightly for credentials
- Change to default credential entry and use ~/.netrc-os by default
- auth -> http_auth for opensearchpy call
- Add connection_class to ES/OS calls for self-signed certs
- Add ca_certs
- Add jittered_backoff_class_factory to OS/ES connection
- Update queue_utils requests call
v1.2.0: HySDS commons utils version 1.2.0
Bug Fixes and Enhancements:
- HC-563: Upgrade to Python 3.12 (#65)
- Add python_requires='>=3.12' to setup.py
- Update classifiers to only include Python 3.12
- Remove future imports as they're not needed in Python 3.12
- Run pyupgrade --py312-plus to update syntax
- Update string formatting to use f-strings where appropriate
- Remove unnecessary file mode 'r' in open() calls
v1.1.6: HySDS commons utils version 1.1.6
- Minor search utils doc fix (#64)
Very minor documentation update to SearchUtility.search_by_id's id
kwarg parameter to address discrepancy between docstring and code.
v1.1.5: HySDS commons utils version 1.1.5
- HC-562: Pin numpy<2.0.0 (#62)
This is due to > 2.0.0 being incompatible with the pinned versions of elasticsearch. Otherwise this error appears during cluster provisioning:
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: Traceback (most recent call last):
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/ops/grq2/scripts/install_base_es_template.py", line 13, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: from grq2 import grq_es
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/ops/grq2/grq2/__init__.py", line 11, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: from hysds.es_util import get_grq_es, get_mozart_es
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/ops/hysds/hysds/es_util.py", line 8, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: from elasticsearch import RequestsHttpConnection as RequestsHttpConnectionES
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/__init__.py", line 36, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: from .client import Elasticsearch
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 23, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: from ..transport import Transport, TransportError
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/transport.py", line 31, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: from .serializer import DEFAULT_SERIALIZERS, Deserializer, JSONSerializer
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/serializer.py", line 50, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: np.float_,
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: File "/export/home/hysdsops/conda/lib/python3.9/site-packages/numpy/__init__.py", line 397, in __getattr__
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: raise AttributeError(
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: AttributeError: `np.float_` was removed in the NumPy 2.0 release. Use `np.float64` instead.
Co-authored-by: Mike Cayanan michael.d.cayanan@jpl.nasa.gov
v1.1.4: HySDS commons utils version 1.1.4
Bug fixes and enhancements:
- hot-fix: fix failed unit test (#61)
v1.1.3: HySDS commons utils version 1.1.3
Bug fixes and enhancements:
- HC-526: Fix search_by_id function to not throw KeyError: 'hits' error (#60)
v1.1.2: HySDS commons utils version 1.1.2
Bug fixes and enhancements:
- HC-473: Passthru publish_overwrite_ok in resolve_hysds_job (#55)
v1.1.1: HySDS commons utils version 1.1.1
Bug fixes and enhancements:
- HC-503: Fixed an issue where job_iterator could return duplicate results (#59)
v1.1.0: Hysds commons utils version 1.1.0
Specify body of new release. Previous release's body below:
To help you formulate the release body, the list of behind commit messages are provided below:
sha: 62d0747
html_url: 62d0747
message:
HC-484: OpenSearch support (#58)
- split the ES and Opensearch Utility into 2 classes
fixed bug in _pit where size defaults to 10 when not given
added opensearch-py to setup.py
bumped minor version to 1.1.0
-
able to use multiple hosts in elasticsearch
-
added multi-host to OpenSearchUtility
-
es-oss doesnt support PIT so defaulting to scroll
if user calls _pit, it will then use the search_after w/o _pit
Co-authored-by: dustinlo dustin.k.lo@jpl.nasa.gov