Skip to content

Commit

Permalink
Merge pull request #113 from addelany/main
Browse files Browse the repository at this point in the history
fix python formatting
  • Loading branch information
addelany authored Oct 25, 2024
2 parents f2466b1 + 72b9e8a commit 1f95fc8
Showing 1 changed file with 17 additions and 18 deletions.
35 changes: 17 additions & 18 deletions R/generate_model_assets.R
Original file line number Diff line number Diff line change
Expand Up @@ -43,24 +43,23 @@ generate_model_assets <- function(full_var_df, aws_path, model_code_link){
"/variable=", full_var_df$variable[i],
"/model_id=", m,
"?endpoint_override=",config$endpoint,'"'),")\ndf <- all_results |> dplyr::collect()\n\n```
\n\nYou can use dplyr operations before calling `dplyr::collect()` to `summarise`, `select` columns, and/or `filter` rows prior to pulling the data into a local `data.frame`. Reducing the data that is pulled locally will speed up the data download speed and reduce your memory usage.\n\n\n### Python\n\n```
{python}\n# Use code below\n\nall_results\n\nimport ibis\n
con = ibis.duckdbf.connect()\n\n
con.raw_sql(f'''\n
CREATE OR REPLACE SECRET secret (\n
TYPE S3,\n
ENDPOINT '",config$endpoint,"',\n
URL_STYLE 'path'\n\n
);/n
'''\n\n
path = ",
paste0('"',"s3://",
aws_path,
"/project_id=", full_var_df$project_id[i],
"/duration=", full_var_df$duration[i],
"/variable=", full_var_df$variable[i],
"/model_id=", m,'"'),
"\ncon.read_parquet(path + \"/**\")")
\n\nYou can use dplyr operations before calling `dplyr::collect()` to `summarise`, `select` columns, and/or `filter` rows prior to pulling the data into a local `data.frame`. Reducing the data that is pulled locally will speed up the data download speed and reduce your memory usage.\n\n\n### Python\n\n```# Use code below\n\n\nimport ibis\n
con = ibis.duckdbf.connect()\n\n
con.raw_sql(f'''\n
CREATE OR REPLACE SECRET secret (\n
TYPE S3,\n
ENDPOINT '",config$endpoint,"',\n
URL_STYLE 'path'\n\n
);/n
'''\n\n
path = ",
paste0('"',"s3://",
aws_path,
"/project_id=", full_var_df$project_id[i],
"/duration=", full_var_df$duration[i],
"/variable=", full_var_df$variable[i],
"/model_id=", m,'"'),
"\ncon.read_parquet(path + \"/**\")")
)
)

Expand Down

0 comments on commit 1f95fc8

Please sign in to comment.