-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Description
for this dataset, when getting temporal extent using aodn_dataset.get_temporal_extent(), it has error:
---------------------------------------------------------------------------
ArrowNotImplementedError Traceback (most recent call last)
/tmp/ipykernel_1200924/2364202892.py in <cell line: 0>()
----> 1 aodn_dataset.get_temporal_extent()
~/github_repo/aodn_cloud_optimised/notebooks/DataQuery.py in get_temporal_extent(self)
1437 A tuple containing the minimum and maximum pandas Timestamp objects.
1438 """
-> 1439 return get_temporal_extent(self.dataset)
1440
1441 def get_temporal_extent_from_timestamp_partition(
~/github_repo/aodn_cloud_optimised/notebooks/DataQuery.py in get_temporal_extent(dataset)
140
141 expr = pc.field("timestamp") == np.int64(unique_timestamps.max())
--> 142 table = dataset.to_table(filter=expr, columns=[time_varname])
143 df = table.to_pandas()
144 time_max = df[time_varname].max()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/_dataset.pyx in pyarrow._dataset.Dataset.to_table()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/_dataset.pyx in pyarrow._dataset.Dataset.scanner()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/_dataset.pyx in pyarrow._dataset.Scanner.from_dataset()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/_dataset.pyx in pyarrow._dataset.Scanner._make_scan_options()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/_dataset.pyx in pyarrow._dataset._populate_builder()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/_compute.pyx in pyarrow._compute._bind()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/error.pxi in pyarrow.lib.pyarrow_internal_check_status()
~/miniforge3/envs/AodnCloudOptimised/lib/python3.12/site-packages/pyarrow/error.pxi in pyarrow.lib.check_status()
ArrowNotImplementedError: Function 'equal' has no kernel matching input types (string, int64)
Metadata
Metadata
Assignees
Labels
No labels