Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fromArrow -> Unrecognized type: "undefined" #334

Open
carlopi opened this issue Jul 21, 2023 · 0 comments
Open

fromArrow -> Unrecognized type: "undefined" #334

carlopi opened this issue Jul 21, 2023 · 0 comments

Comments

@carlopi
Copy link

carlopi commented Jul 21, 2023

Hi!

I was updating the benchmarks for @duckdb-wasm, and somehow in our benchmark infrastructure arquero support has somehow broken, either while bumping arrow or arquero itself.

Failure seems to happening in an line like:

this.tables['lineitem'] = aq.fromArrow(lineitem);

(here: https://github.com/duckdb/duckdb-wasm/blob/master/packages/benchmarks/src/system/arquero_benchmarks.ts#L46)
with stack trace like:

Error: Unrecognized type: "undefined"
    at typeFromJSON (/node_modules/apache-arrow/srcipc/metadata/json.ts:205:11)
    at Function.fieldFromJSON (/node_modules/apache-arrow/srcipc/metadata/json.ts:109:16)
    at <anonymous> (/node_modules/apache-arrow/srcipc/metadata/json.ts:59:76)
    at Array.map (<anonymous>)
    at schemaFieldsFromJSON (/node_modules/apache-arrow/srcipc/metadata/json.ts:59:54)
    at Function.schemaFromJSON (/node_modules/apache-arrow/srcipc/metadata/json.ts:34:9)
    at Message._createHeader (/node_modules/apache-arrow/srcipc/metadata/message.ts:216:54)
    at Message.header (/node_modules/apache-arrow/srcipc/metadata/message.ts:131:35)
    at RecordBatchJSONReaderImpl.next (/node_modules/apache-arrow/srcipc/reader.ts:430:36)
    at RecordBatchStreamReader.readAll (/node_modules/apache-arrow/srcipc/reader.ts:209:35)

and seems similar to this error to be found here: https://observablehq.com/@jheer/arquero-to-arrow-serialization

Writing to signal this, not particular urgent on our side, but would be nice to have it working properly.

Thanks, let me know if any more informations could be useful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant