Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot read dataset: 'H5Coro' object has no attribute 'offsetsize' #27

Open
mattjala opened this issue Feb 7, 2024 · 2 comments
Open

Comments

@mattjala
Copy link

mattjala commented Feb 7, 2024

I built H5Coro from source with python 3.9.18 on Ubuntu 22.04. I am attempting to use it read a publicly accessible file, ou_process.h5.

The program that results in the error:

import h5coro
from h5coro import h5coro, s3driver

bucket = "docs.hdfgroup.org"
filepath = "hdf5/h5/ou_process.h5"

h5obj = h5coro.H5Coro(resource=f'{bucket}/{filepath}', driver_class=s3driver.S3Driver)

dsets = [{'dataset': '/dataset', 'startrow':0, 'numrows': h5coro.H5Dataset.ALL_ROWS}]
promise = h5obj.readDatasets(datasets=dsets, block=True)

Running this program results in the error 'H5Coro' object has no attribute 'offsetsize'. Full stack trace output:
test_output.txt

In case this is due to something about the file itself, here is the h5dump output for the ou_process.h5 file, when read through the ROS3 VFD:
h5dump_output.txt

I thought that offsetsize might be a typo'd version of offsetSize, but replacing the capitalization and running the program again results in this error:

  File "/home/matthewlarson/Downloads/h5coro/h5coro/h5dataset.py", line 1466, in readSymbolTable
    self.readObjHdr(obj_hdr_addr, dlvl + 1)
TypeError: readObjHdr() takes 2 positional arguments but 3 were given
@jpswinski
Copy link
Member

@mattjala Thank you for reporting this issue and for the very clear write up. I was able to drill down on the problem and I've committed a fix for it on the netcdf-2 branch that is holding some substantial changes which should be merged in the next day or so.

I'm glad to see you are interested in this effort, and any and all involvement is welcome! Please be aware that this code is still in the early stages and is not ready for any sort of production environment. The current main branch has known issues, including lack of support for 2 dimensional datasets (which the netcdf-2 branch is looking to fix).

If you are interested in getting involved, feel free to keep the discussion open here. Or you can take the discussion offline and email me directly at [email protected].

@mattjala
Copy link
Author

mattjala commented Feb 8, 2024

Thanks for the quick response! I encountered this while setting up an example with H5Coro as part of the HDF5 tutorials projects. Our goal is to sample the different interfaces and libraries that HDF5 files can be accessed through.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants