Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataprep sqlx support #1891

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Dataprep sqlx support #1891

wants to merge 1 commit into from

Conversation

fernst
Copy link
Collaborator

@fernst fernst commented Jan 13, 2025

No description provided.

@fernst fernst requested a review from a team as a code owner January 13, 2025 20:27
@fernst fernst requested review from Tuseeq1 and removed request for a team January 13, 2025 20:27
@fernst fernst force-pushed the dataprep-sqlx-support branch from 93ec3e1 to accdf6d Compare January 22, 2025 02:59
@fernst fernst requested review from Ekrekr and kolina and removed request for Tuseeq1 January 22, 2025 03:00
# Conflicts:
#	core/utils.ts
@fernst fernst force-pushed the dataprep-sqlx-support branch from accdf6d to 1307b28 Compare January 22, 2025 03:57
} from "df/core/utils";
import { dataform } from "df/protos/ts";

// Brings the properties for the destination table
export interface IDataPreparationConfig
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Elias is getting rid of non-proto action configs. So I think you should not create this for new SQLX actions.

Copy link
Collaborator Author

@fernst fernst Jan 24, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does it make sense to remove these now, or wait until all other configs are removed as well?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's better to not use a legacy way if you can afford it.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please, stick to proto at the source of truth where possible. Remaining actions following this were converted in #1780

core/actions/data_preparation.ts Show resolved Hide resolved
dataPreparationSqlx
);

const result = runMainInVm(coreExecutionRequestFromPath(projectDir));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should you pass actual overrides here?


FROM x
-- Ensure y is positive
$\{validate("y > 0")\}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd add other context functions usage to validate that they're working.

@@ -98,5 +98,6 @@
"**/nth-check": "^2.0.1",
"**/node-fetch": "^2.6.7",
"**/markdown-it": "^12.3.2"
}
},
"packageManager": "[email protected]+sha512.a6b2f7906b721bba3d67d4aff083df04dad64c399707841b7acf00f6b133b7ac24255f2652fa22ae3534329dc6180534e98d17432037ff6fd140556e2bb3137e"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is this for?

} from "df/core/utils";
import { dataform } from "df/protos/ts";

// Brings the properties for the destination table
export interface IDataPreparationConfig
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please, stick to proto at the source of truth where possible. Remaining actions following this were converted in #1780

@Ekrekr Ekrekr requested review from Ekrekr and removed request for Ekrekr January 27, 2025 11:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants