Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

investigation: automatic schema mapping for parquet file source #18001

Closed
wcy-fdu opened this issue Aug 12, 2024 · 2 comments
Closed

investigation: automatic schema mapping for parquet file source #18001

wcy-fdu opened this issue Aug 12, 2024 · 2 comments

Comments

@wcy-fdu
Copy link
Contributor

wcy-fdu commented Aug 12, 2024

Recently we support parquet file source, for example:

CREATE table parquet_table(
     id int,
     name string,
)
WITH (
    connector = 's3_v2',
    match_pattern = '*.parquet',
    xxx,
) FORMAT PLAIN ENCODE PARQUET;

Since the parquet file itself has metadata that records its schema, perhaps we do not need to define the schema of the parquet source. We may pre-read the meta of a parquet file when create source. Open this issue for investigation.

@wcy-fdu wcy-fdu self-assigned this Aug 12, 2024
@github-actions github-actions bot added this to the release-2.0 milestone Aug 12, 2024
@wcy-fdu wcy-fdu removed this from the release-2.0 milestone Aug 19, 2024
Copy link
Contributor

This issue has been open for 60 days with no activity.

If you think it is still relevant today, and needs to be done in the near future, you can comment to update the status, or just manually remove the no-issue-activity label.

You can also confidently close this issue as not planned to keep our backlog clean.
Don't worry if you think the issue is still valuable to continue in the future.
It's searchable and can be reopened when it's time. 😄

@wcy-fdu
Copy link
Contributor Author

wcy-fdu commented Oct 28, 2024

Duplicate with tvf

@wcy-fdu wcy-fdu closed this as completed Oct 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant