Skip to content

Mac use hdfs 2.6.0 connect datanode failed #188

@HaoXuan40404

Description

@HaoXuan40404

my client can use namenode(like mkdir or ls), but cannot use datanode,(like download or upload), my network work right
this python code run right in centos and ubuntu,but failed with python 3.9 hdfs-2.6.0 macos12.3.1

if __name__ == '__main__':
    hdfs_client = HdfsApi()
    local_path = "./test_data.csv"
    print(hdfs_client.client.list('/'))
    print(hdfs_client.client.list('/ppc'))
    hdfs_path = "/root/LICENSE.txt"
    hdfs_client.get_dataset(hdfs_path, local_path)

when I run it, get

['ppc', 'root']
['LICENSE.txt']
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/hdfs/client.py", line 830, in download
    raise err
  File "/usr/local/lib/python3.9/site-packages/hdfs/client.py", line 817, in download
    _download(fpath_tuple)
  File "/usr/local/lib/python3.9/site-packages/hdfs/client.py", line 759, in _download
    with self.read(_remote_path, **kwargs) as reader:
  File "/usr/local/Cellar/python@3.9/3.9.1_6/Frameworks/Python.framework/Versions/3.9/lib/python3.9/contextlib.py", line 117, in __enter__
    return next(self.gen)
  File "/usr/local/lib/python3.9/site-packages/hdfs/client.py", line 687, in read
    res = self._open(
  File "/usr/local/lib/python3.9/site-packages/hdfs/client.py", line 118, in api_handler
    raise err
hdfs.util.HdfsError: b''

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions