Skip to content

Commit

Permalink
Updated existing tasks to preserve file structure
Browse files Browse the repository at this point in the history
  • Loading branch information
MitchellAV committed Dec 19, 2024
1 parent 7d70bfc commit 08a730a
Show file tree
Hide file tree
Showing 8 changed files with 5 additions and 65 deletions.
4 changes: 2 additions & 2 deletions ec2/.gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
**/data/files/*
**/data/ground-truth/*
**/data/files/*.csv
**/data/ground-truth/*.csv
25 changes: 1 addition & 24 deletions ec2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,28 +72,6 @@ Example JSON:
"mean_absolute_error_time_series",
"data_sampling_frequency",
"issue"
],
"plots": [
{
"type": "histogram",
"x_val": "mean_absolute_error_time_series",
"color_code": "issue",
"title": "Time Series MAE Distribution by Issue",
"save_file_path": "mean_absolute_error_time_series_dist.png"
},
{
"type": "histogram",
"x_val": "mean_absolute_error_time_series",
"color_code": "data_sampling_frequency",
"title": "Time Series MAE Distribution by Sampling Frequency",
"save_file_path": "mean_absolute_error_time_series_dist.png"
},
{
"type": "histogram",
"x_val": "run_time",
"title": "Run Time Distribution",
"save_file_path": "run_time_dist.png"
}
]
}
```
Expand All @@ -111,12 +89,11 @@ Example JSON:
- The formatting is as follows `<performance_metric>_<ground_truth_type>`
- e.g. `mean_absolute_error_time_series`
- "allowable_kwargs" - kwargs for the submission function that are allowed
- "ground_truth_compare" - comparrison type that is used for calculating metrics
- "ground_truth_compare" - results from submission function
- "public_results_table" - name of json result file that contains information about submission results
- "private_results_columns" - name of columns that will be in final dataframe that is passed to marimo template
- will need to contain final metric name to be used in marimo template
- The formatting is as follows `<metric_operation>_<performance_metric>_<ground_truth_type>`
- "plots" - not currently used as marimo template is most recent way to visualize results

### system_metadata.csv

Expand Down
2 changes: 2 additions & 0 deletions ec2/analysis-tasks/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# Analysis Task Structure

39 changes: 0 additions & 39 deletions ec2/analysis-tasks/az-tilt-estimation/config.json
Original file line number Diff line number Diff line change
Expand Up @@ -58,44 +58,5 @@
"error_tilt",
"issue",
"number_days"
],
"plots": [
{
"type": "histogram",
"x_val": "absolute_error_azimuth",
"title": "Azimuth Absolute Error Distribution",
"save_file_path": "absolute_error_az_dist.png"
},
{
"type": "histogram",
"x_val": "absolute_error_tilt",
"title": "Tilt Absolute Error Distribution",
"save_file_path": "absolute_error_tilt_dist.png"
},
{
"type": "histogram",
"x_val": "error_azimuth",
"title": "Azimuth Error Distribution",
"save_file_path": "absolute_error_az_dist.png"
},
{
"type": "histogram",
"x_val": "error_tilt",
"title": "Tilt Error Distribution",
"save_file_path": "error_tilt_dist.png"
},
{
"type": "histogram",
"x_val": "run_time",
"title": "Run Time Distribution",
"save_file_path": "run_time_dist.png"
},
{
"type": "scatter_plot",
"x_val": "run_time",
"y_val": "number_days",
"title": "Run Time vs. Number Days in Data Set",
"save_file_path": "run_time_number_days.png"
}
]
}
Empty file.
Empty file.
Empty file.
Empty file.

0 comments on commit 08a730a

Please sign in to comment.