Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support clone operations for BQ lineage #18637

Open
DovileKr opened this issue Nov 14, 2024 · 0 comments
Open

Support clone operations for BQ lineage #18637

DovileKr opened this issue Nov 14, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@DovileKr
Copy link

Is your feature request related to a problem? Please describe.
Data Lineage is not captured for GCP BQ Table Clone Operations.

Describe the solution you'd like
Q Table Clone Operation in Information Schema Jobs seems to have all the information to extract lineage, however it doesn't seem to create one.

Information Schema Jobs data

  • job_type: QUERY
  • statement_type: CREATE_TABLE
  • query
CREATE OR REPLACE TABLE project.dataset.clone_name
CLONE project.dataset.base_name;
  • destination_table: project.dataset.clone_name
  • referenced_tables: project.dataset.base_name

Describe alternatives you've considered
Have to post this manually - not a prefered option, existing BQ extractor already uses Information Schema Jobs

Additional context
Add any other context or screenshots about the feature request here.

@DovileKr DovileKr added the enhancement New feature or request label Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant