Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1108 {shinytest2} feature branch #1126

Merged
merged 62 commits into from
May 10, 2024
Merged

1108 {shinytest2} feature branch #1126

merged 62 commits into from
May 10, 2024

Conversation

m7pr
Copy link
Contributor

@m7pr m7pr commented Apr 22, 2024

Closes #1108

A unified branch for all partial PRs that will solve #1108

Merge at the end. Place where we can unify PRs

@m7pr m7pr added the bug Something isn't working label Apr 22, 2024
@m7pr m7pr assigned m7pr and kartikeyakirar and unassigned m7pr Apr 22, 2024
Copy link
Contributor

@kartikeyakirar kartikeyakirar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Blocking to prevent unexpected merge

@m7pr m7pr added core and removed bug Something isn't working labels Apr 22, 2024
@averissimo
Copy link
Contributor

averissimo commented Apr 24, 2024

Is there a reason not to add TESTING_DEPTH=5 to .github/workflows/check.yaml?

I didn't do this on my previous PR, but it may live here

Copy link
Contributor

github-actions bot commented Apr 24, 2024

Unit Tests Summary

    1 files     70 suites   58m 35s ⏱️
  720 tests   610 ✅ 110 💤 0 ❌
1 983 runs  1 761 ✅ 222 💤 0 ❌

Results for commit e8dc8b4.

♻️ This comment has been updated with latest results.

Copy link
Contributor

github-actions bot commented Apr 25, 2024

Unit Test Performance Difference

Test Suite $Status$ Time on main $±Time$ $±Tests$ $±Skipped$ $±Failures$ $±Errors$
shinytest2-tm_a_gee 👶 $+128.96$ $+48$ $0$ $0$ $0$
shinytest2-tm_g_barchart_simple 👶 $+235.12$ $+73$ $0$ $0$ $0$
shinytest2-tm_g_ci 👶 $+102.18$ $+41$ $0$ $0$ $0$
shinytest2-tm_g_forest_rsp 👶 $+171.43$ $+48$ $0$ $0$ $0$
shinytest2-tm_g_forest_tte 👶 $+62.20$ $+31$ $+5$ $0$ $0$
shinytest2-tm_g_ipp 👶 $+115.46$ $+45$ $0$ $0$ $0$
shinytest2-tm_g_km 👶 $+248.07$ $+80$ $0$ $0$ $0$
shinytest2-tm_g_lineplot 👶 $+105.80$ $+39$ $0$ $0$ $0$
Additional test case details
Test Suite $Status$ Time on main $±Time$ Test Case
shinytest2-tm_a_gee 👶 $+7.79$ e2e_tm_a_gee_Change_in_arm_var_changes_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+7.34$ e2e_tm_a_gee_Deselection_of_arm_var_throws_validation_error.
shinytest2-tm_a_gee 👶 $+7.42$ e2e_tm_a_gee_Deselection_of_conf_level_throws_validation_error.
shinytest2-tm_a_gee 👶 $+7.18$ e2e_tm_a_gee_Deselection_of_cor_struct_does_not_throw_validation_error.
shinytest2-tm_a_gee 👶 $+7.24$ e2e_tm_a_gee_Deselection_of_id_var_throws_validation_error.
shinytest2-tm_a_gee 👶 $+7.30$ e2e_tm_a_gee_Deselection_of_paramcd_throws_validation_error.
shinytest2-tm_a_gee 👶 $+7.77$ e2e_tm_a_gee_Deselection_of_visit_var_throws_validation_error.
shinytest2-tm_a_gee 👶 $+7.57$ e2e_tm_a_gee_Module_initializes_in_teal_without_errors_and_produces_table_output.
shinytest2-tm_a_gee 👶 $+7.72$ e2e_tm_a_gee_Selection_of_conf_level_changes_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+7.22$ e2e_tm_a_gee_Selection_of_conf_level_out_of_0_1_range_throws_validation_error.
shinytest2-tm_a_gee 👶 $+7.69$ e2e_tm_a_gee_Selection_of_cor_struct_changes_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+8.02$ e2e_tm_a_gee_Selection_of_cov_var_changes_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+8.15$ e2e_tm_a_gee_Selection_of_id_var_does_not_change_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+7.71$ e2e_tm_a_gee_Selection_of_output_table_changes_the_table_and_doesn_t_throw_validation_error.
shinytest2-tm_a_gee 👶 $+7.88$ e2e_tm_a_gee_Selection_of_paramcd_changes_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+7.90$ e2e_tm_a_gee_Selection_of_visit_var_does_not_change_the_table_and_does_not_throw_validation_errors.
shinytest2-tm_a_gee 👶 $+7.07$ e2e_tm_a_gee_Starts_with_specified_label_id_var_arm_var_visit_var_paramcd_cov_var_conf_level_and_conf_struct.
shinytest2-tm_g_barchart_simple 👶 $+10.33$ e2e_tm_g_barchart_simple_Changing_barlayout_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+10.19$ e2e_tm_g_barchart_simple_Changing_expand_y_range_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+10.09$ e2e_tm_g_barchart_simple_Changing_facet_scale_x_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+10.34$ e2e_tm_g_barchart_simple_Changing_facet_scale_y_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+9.57$ e2e_tm_g_barchart_simple_Changing_flip_axis_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+10.50$ e2e_tm_g_barchart_simple_Changing_label_bars_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+12.93$ e2e_tm_g_barchart_simple_Changing_rotate_bar_labels_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+9.75$ e2e_tm_g_barchart_simple_Changing_rotate_x_label_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+9.73$ e2e_tm_g_barchart_simple_Changing_rotate_y_label_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+10.00$ e2e_tm_g_barchart_simple_Changing_show_n_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_barchart_simple 👶 $+10.49$ e2e_tm_g_barchart_simple_De_selection_of_fill_dataset_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+9.74$ e2e_tm_g_barchart_simple_De_selection_of_x_facet_dataset_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+9.66$ e2e_tm_g_barchart_simple_De_selection_of_y_facet_dataset_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+8.22$ e2e_tm_g_barchart_simple_Deselection_of_x_throws_validation_error.
shinytest2-tm_g_barchart_simple 👶 $+9.55$ e2e_tm_g_barchart_simple_Duplicate_between_x_and_fill_selection_throws_validation_error
shinytest2-tm_g_barchart_simple 👶 $+10.34$ e2e_tm_g_barchart_simple_Duplicate_between_x_and_x_facet_selection_throws_validation_error
shinytest2-tm_g_barchart_simple 👶 $+10.50$ e2e_tm_g_barchart_simple_Duplicate_between_x_and_y_facet_selection_throws_validation_error
shinytest2-tm_g_barchart_simple 👶 $+7.76$ e2e_tm_g_barchart_simple_Module_initializes_in_teal_without_errors_and_produces_output.
shinytest2-tm_g_barchart_simple 👶 $+12.88$ e2e_tm_g_barchart_simple_Selection_of_fill_dataset_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+10.18$ e2e_tm_g_barchart_simple_Selection_of_x_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+12.20$ e2e_tm_g_barchart_simple_Selection_of_x_facet_dataset_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+11.63$ e2e_tm_g_barchart_simple_Selection_of_y_facet_dataset_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_barchart_simple 👶 $+8.54$ e2e_tm_g_barchart_simple_Starts_with_specified_label_id_var_arm_var_visit_var_paramcd_cov_var_conf_level_and_conf_struct.
shinytest2-tm_g_ci 👶 $+7.20$ e2e_tm_g_ci_Deselecting_AVISIT_filter_value_throws_validation_error.
shinytest2-tm_g_ci 👶 $+7.12$ e2e_tm_g_ci_Deselecting_PARAMCD_filter_value_throws_validation_error.
shinytest2-tm_g_ci 👶 $+7.41$ e2e_tm_g_ci_Deselecting_color_column_changes_plot_output_and_doesn_t_throw_validation_error.
shinytest2-tm_g_ci 👶 $+7.19$ e2e_tm_g_ci_Deselecting_x_var_column_throws_validation_error.
shinytest2-tm_g_ci 👶 $+7.01$ e2e_tm_g_ci_Deselecting_y_var_column_throws_validation_error.
shinytest2-tm_g_ci 👶 $+7.12$ e2e_tm_g_ci_Module_initializes_with_specified_label_x_var_y_var_ADLB_filters_color_conf_level_and_stat.
shinytest2-tm_g_ci 👶 $+7.30$ e2e_tm_g_ci_Selecting_AVISIT_filter_value_doesn_t_throw_validation_errors.
shinytest2-tm_g_ci 👶 $+7.54$ e2e_tm_g_ci_Selecting_PARAMCD_filter_value_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ci 👶 $+7.76$ e2e_tm_g_ci_Selecting_color_column_changes_plot_output_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ci 👶 $+7.51$ e2e_tm_g_ci_Selecting_confidence_interval_value_changes_plot_and_doesn_t_throw_any_errors.
shinytest2-tm_g_ci 👶 $+7.48$ e2e_tm_g_ci_Selecting_statistic_to_use_changes_a_plot_and_doesn_t_throw_any_errors.
shinytest2-tm_g_ci 👶 $+7.57$ e2e_tm_g_ci_Selecting_x_var_column_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ci 👶 $+7.26$ e2e_tm_g_ci_Selecting_y_var_column_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ci 👶 $+6.72$ e2e_tm_g_ci_example_ci_module_initializes_in_teal_without_errors_and_produces_plot_output.
shinytest2-tm_g_forest_rsp 👶 $+9.90$ e2e_tm_g_forest_rsp_Changing_font_size_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+9.41$ e2e_tm_g_forest_rsp_Changing_rel_width_forest_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+8.77$ e2e_tm_g_forest_rsp_Deselecting_arm_var_throws_validation_error.
shinytest2-tm_g_forest_rsp 👶 $+9.00$ e2e_tm_g_forest_rsp_Deselecting_conf_level_or_selecting_outside_the_range_of_0_1_throws_validation_error.
shinytest2-tm_g_forest_rsp 👶 $+8.58$ e2e_tm_g_forest_rsp_Deselecting_paramcd_throws_validation_error.
shinytest2-tm_g_forest_rsp 👶 $+8.90$ e2e_tm_g_forest_rsp_Deselecting_responders_throws_validation_error.
shinytest2-tm_g_forest_rsp 👶 $+9.82$ e2e_tm_g_forest_rsp_Deselecting_strata_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+9.48$ e2e_tm_g_forest_rsp_Deselecting_subgroup_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+8.22$ e2e_tm_g_forest_rsp_Module_initializes_in_teal_without_errors_and_produces_plot_output.
shinytest2-tm_g_forest_rsp 👶 $+8.70$ e2e_tm_g_forest_rsp_Module_initializes_with_specified_label_arm_var_paramcd_aval_var_responders_subgroup_var_strata_var_conf_level_fixed_symbol_size_rel_width_forest_font_size.
shinytest2-tm_g_forest_rsp 👶 $+8.77$ e2e_tm_g_forest_rsp_Selecting_a_non_factors_column_in_subgroup_var_throws_validation_error.
shinytest2-tm_g_forest_rsp 👶 $+10.02$ e2e_tm_g_forest_rsp_Selecting_arm_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+9.89$ e2e_tm_g_forest_rsp_Selecting_conf_level_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+11.58$ e2e_tm_g_forest_rsp_Selecting_paramcd_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+10.08$ e2e_tm_g_forest_rsp_Selecting_responders_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+10.16$ e2e_tm_g_forest_rsp_Selecting_strata_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+10.24$ e2e_tm_g_forest_rsp_Selecting_subgroup_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_rsp 👶 $+9.91$ e2e_tm_g_forest_rsp_Unsetting_fixed_symbol_size_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_forest_tte 👶 $+0.01$ e2e_tm_g_forest_tte_Deselecting_aval_var_throws_validation_error.
shinytest2-tm_g_forest_tte 👶 $+0.01$ e2e_tm_g_forest_tte_Deselecting_cnsr_var_throws_validation_error.
shinytest2-tm_g_forest_tte 👶 $+8.29$ e2e_tm_g_forest_tte_Deselection_of_paramcd_filter_throws_validation_error.
shinytest2-tm_g_forest_tte 👶 $+8.55$ e2e_tm_g_forest_tte_Deselection_of_paramcd_var_throws_validation_error.
shinytest2-tm_g_forest_tte 👶 $+7.79$ e2e_tm_g_forest_tte_Module_initializes_in_teal_without_errors_and_produces_output.
shinytest2-tm_g_forest_tte 👶 $+0.09$ e2e_tm_g_forest_tte_Selecting_aval_var_does_not_throw_validation_errors_and_changes_a_plot.
shinytest2-tm_g_forest_tte 👶 $+0.01$ e2e_tm_g_forest_tte_Selecting_cnsr_var_does_not_throw_validation_errors_and_changes_a_plot.
shinytest2-tm_g_forest_tte 👶 $+8.49$ e2e_tm_g_forest_tte_Selecting_conf_level_does_not_throw_validation_errors_and_changes_a_plot.
shinytest2-tm_g_forest_tte 👶 $+0.01$ e2e_tm_g_forest_tte_Selecting_time_unit_variable_does_not_throw_validation_errors_and_changes_a_plot.
shinytest2-tm_g_forest_tte 👶 $+10.35$ e2e_tm_g_forest_tte_Selection_of_arm_var_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_forest_tte 👶 $+9.90$ e2e_tm_g_forest_tte_Selection_of_paramcd_changes_the_element_and_does_not_throw_validation_errors
shinytest2-tm_g_forest_tte 👶 $+8.69$ e2e_tm_g_forest_tte_Starts_with_specified_label_paramcd_arm_var_buckets_paramcd_subgroup_var_strata_var_and_plot_settings
shinytest2-tm_g_ipp 👶 $+8.76$ e2e_tm_g_ipp_Changing_add_avalu_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+9.08$ e2e_tm_g_ipp_Changing_add_baseline_hline_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+8.97$ e2e_tm_g_ipp_Changing_separate_by_obs_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+8.35$ e2e_tm_g_ipp_Changing_suppress_legend_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+7.55$ e2e_tm_g_ipp_Deselecting_arm_var_column_throws_validation_error.
shinytest2-tm_g_ipp 👶 $+7.65$ e2e_tm_g_ipp_Deselecting_aval_var_throws_validation_error.
shinytest2-tm_g_ipp 👶 $+7.56$ e2e_tm_g_ipp_Deselecting_paramcd_throws_validation_error.
shinytest2-tm_g_ipp 👶 $+7.53$ e2e_tm_g_ipp_Deselecting_visit_var_throws_validation_error.
shinytest2-tm_g_ipp 👶 $+7.13$ e2e_tm_g_ipp_Module_initializes_in_teal_without_errors_and_produces_plot_output.
shinytest2-tm_g_ipp 👶 $+8.73$ e2e_tm_g_ipp_Selecting_arm_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+8.54$ e2e_tm_g_ipp_Selecting_aval_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+8.87$ e2e_tm_g_ipp_Selecting_paramcd_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+8.94$ e2e_tm_g_ipp_Selecting_visit_var_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_ipp 👶 $+7.79$ e2e_tm_g_ipp_Starts_with_specified_label_parentname_arm_var_paramcd_id_var_visit_var_aval_var_avalu_var_baseline_var_add_baseline_hline_separate_by_obs_suppress_legend_add_avalu.
shinytest2-tm_g_km 👶 $+9.80$ e2e_tm_g_km_Changing_arm_var_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+9.37$ e2e_tm_g_km_Changing_compare_arms_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+10.01$ e2e_tm_g_km_Changing_conf_level_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+10.59$ e2e_tm_g_km_Changing_facet_var_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+9.68$ e2e_tm_g_km_Changing_font_size_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+9.66$ e2e_tm_g_km_Changing_paramcd_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+9.41$ e2e_tm_g_km_Changing_pval_method_coxph_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+9.48$ e2e_tm_g_km_Changing_rel_height_plot_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+10.10$ e2e_tm_g_km_Changing_show_ci_ribbon_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+9.51$ e2e_tm_g_km_Changing_show_km_table_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+9.41$ e2e_tm_g_km_Changing_strata_var_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+9.37$ e2e_tm_g_km_Changing_ties_coxph_changes_the_plot_without_errors.
shinytest2-tm_g_km 👶 $+9.74$ e2e_tm_g_km_Changing_xlab_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+10.75$ e2e_tm_g_km_Changing_xticks_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+9.76$ e2e_tm_g_km_Changing_yval_changes_the_plot_and_does_not_throw_validation_errors.
shinytest2-tm_g_km 👶 $+8.03$ e2e_tm_g_km_Deselecting_arm_var_throws_validation_error.
shinytest2-tm_g_km 👶 $+9.37$ e2e_tm_g_km_Deselecting_compare_arms_sets_it_to_FALSE.
shinytest2-tm_g_km 👶 $+8.31$ e2e_tm_g_km_Deselecting_conf_level_throws_validation_error.
shinytest2-tm_g_km 👶 $+7.94$ e2e_tm_g_km_Deselecting_paramcd_throws_validation_error.
shinytest2-tm_g_km 👶 $+9.81$ e2e_tm_g_km_Deselecting_pval_method_coxph_gives_no_validation_error.
shinytest2-tm_g_km 👶 $+9.44$ e2e_tm_g_km_Deselecting_strata_var_does_not_throw_errors.
shinytest2-tm_g_km 👶 $+9.76$ e2e_tm_g_km_Deselecting_ties_coxph_gives_no_validation_error.
shinytest2-tm_g_km 👶 $+7.35$ e2e_tm_g_km_Module_initializes_in_teal_without_errors_and_produces_plot_output.
shinytest2-tm_g_km 👶 $+8.20$ e2e_tm_g_km_Starts_with_specified_collapsed_additional_plot_settings.
shinytest2-tm_g_km 👶 $+7.95$ e2e_tm_g_km_Starts_with_specified_collapsed_comparison_settings.
shinytest2-tm_g_km 👶 $+7.54$ e2e_tm_g_km_Starts_with_specified_groups.
shinytest2-tm_g_km 👶 $+7.72$ e2e_tm_g_km_Starts_with_specified_paramcd_aval_var_cnsr_var_facet_var_arm_var_compare_arms_strata_var.
shinytest2-tm_g_lineplot 👶 $+10.02$ e2e_tm_g_lineplot_Deselecting_conf_level_validation_error.
shinytest2-tm_g_lineplot 👶 $+9.91$ e2e_tm_g_lineplot_Deselecting_param_level_throws_validation_error.
shinytest2-tm_g_lineplot 👶 $+10.06$ e2e_tm_g_lineplot_Deselecting_strata_variable_throws_validation_error.
shinytest2-tm_g_lineplot 👶 $+10.20$ e2e_tm_g_lineplot_Deselecting_y_variable_throws_validation_error.
shinytest2-tm_g_lineplot 👶 $+9.35$ e2e_tm_g_lineplot_Module_initializes_in_teal_without_errors.
shinytest2-tm_g_lineplot 👶 $+11.49$ e2e_tm_g_lineplot_Selecting_conf_level_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_lineplot 👶 $+11.38$ e2e_tm_g_lineplot_Selecting_param_level_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_lineplot 👶 $+11.55$ e2e_tm_g_lineplot_Selecting_strata_variable_changes_plotand_doesn_t_throw_validation_errors.
shinytest2-tm_g_lineplot 👶 $+11.49$ e2e_tm_g_lineplot_Selecting_y_variable_changes_plot_and_doesn_t_throw_validation_errors.
shinytest2-tm_g_lineplot 👶 $+10.34$ e2e_tm_g_lineplot_Starts_with_specifiedlabel_param_strata_y_variable_x_variable_mid_interval_incl_screenplot_settings_and_table_settings

Results for commit 0428dd8

♻️ This comment has been updated with latest results.

averissimo and others added 9 commits April 25, 2024 15:24
# Pull Request

Part of #1108 

### What is being tested
- Default values that can be changed
- Selecting `x` variable
- Deselecting `x` variable should give error
- Deselecting others does not throw error
- Selecting same variables as `x` has a validation error

---------

Signed-off-by: André Veríssimo <[email protected]>
Co-authored-by: kartikeya kirar <[email protected]>
…ors` (#1135)

Helper functions to test whether plot or table were changed, based on a
value change in specific input.

---------

Signed-off-by: Marcin <[email protected]>
Signed-off-by: André Veríssimo <[email protected]>
Co-authored-by: André Veríssimo <[email protected]>
Co-authored-by: Vedha Viyash <[email protected]>
Co-authored-by: kartikeya kirar <[email protected]>
Co-authored-by: Dawid Kałędkowski <[email protected]>
Part of #1108

---------

Signed-off-by: Marcin <[email protected]>
Co-authored-by: m7pr <[email protected]>
Co-authored-by: Marcin <[email protected]>
Co-authored-by: kartikeya kirar <[email protected]>
vedhav and others added 4 commits May 7, 2024 16:47
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Signed-off-by: Vedha Viyash <[email protected]>
Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
@vedhav vedhav marked this pull request as draft May 7, 2024 11:17
vedhav and others added 10 commits May 7, 2024 16:48
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
Part of #1108

---------

Co-authored-by: unknown <[email protected]>
linksto  #1108

---------

Signed-off-by: kartikeya kirar <[email protected]>
Co-authored-by: vedhav <[email protected]>
Co-authored-by: kartikeya kirar <[email protected]>
Co-authored-by: Vedha Viyash <[email protected]>
# Pull Request

Part of #1108

Module has very specific set of variables that don't allow for many
choices

Fields not 100% tested:

- `cmdecod`: selected variable needs to be named CMDECOD due to
limitation in module's logic
- `cmtrt`: Could not manipulate data for this field to have any change
on output.
  - It seems that it is only used when CMDECOD has long values

---------

Co-authored-by: Vedha Viyash <[email protected]>
Co-authored-by: vedhav <[email protected]>
Merge branch 'main' into shinytest2@main

# Conflicts:
#	DESCRIPTION
@vedhav vedhav marked this pull request as ready for review May 9, 2024 04:27
vedhav and others added 2 commits May 9, 2024 04:27
Part of #1108

---------

Signed-off-by: Vedha Viyash <[email protected]>
Signed-off-by: kartikeya kirar <[email protected]>
Co-authored-by: unknown <[email protected]>
.github/workflows/check.yaml Outdated Show resolved Hide resolved
vedhav and others added 2 commits May 10, 2024 11:12
- [x] Rename `get_active_module_pws_output` with
`get_active_module_plot_output` respectively after
insightsengineering/teal#1210 is merged.
@kartikeyakirar
- [x] Rename `get_active_module_tws_output` with
`get_active_module_table_output` @vedhav
- [x] Replace `rvest::html_table()` and use
`get_active_module_table_output` for DT tables. @kartikeyakirar
- [x] Check if all the tests have skip_if_too_deep(5) and
app_driver$stop() @kartikeyakirar
- [x] Make sure the test description is standard: Begin with a Capital
letter and end with . uses variables like arm_var instead of
arm_var-variable or ARM variable @vedhav
- [x] Verify that all the module params are covered in the test.
Especially check for cases with fixed data transform. (leave parameter
with deprecated status) @kartikeyakirar
- [x] prefix teal.data:: for teal_data(), datanames() and join_keys
where ever its missing. @kartikeyakirar
@vedhav vedhav dismissed kartikeyakirar’s stale review May 10, 2024 06:42

unblocked as we merged all the branches to this feature branch

@vedhav vedhav enabled auto-merge (squash) May 10, 2024 06:43
@vedhav vedhav disabled auto-merge May 10, 2024 06:54
@vedhav
Copy link
Contributor

vedhav commented May 10, 2024

teal.modules.clinical| F W  S  OK | Context|        147 | examples [236.5s]
✔ |          4 | facet_grid_formula|         48 | shinytest2-tm_a_gee [158.7s]
✔ |        309 | shinytest2-tm_a_mmrm [619.1s]
✔ |         73 | shinytest2-tm_g_barchart_simple [191.1s]
✔ |         41 | shinytest2-tm_g_ci [88.4s]
✔ |         48 | shinytest2-tm_g_forest_rsp [149.6s]
✔ |         26 | shinytest2-tm_g_forest_tte [52.5s]
✔ |         45 | shinytest2-tm_g_ipp [88.2s]
✔ |         80 | shinytest2-tm_g_km [198.6s]
✔ |         39 | shinytest2-tm_g_lineplot [70.9s]
✔ |         48 | shinytest2-tm_g_pp_adverse_events [108.4s]
✔ |         74 | shinytest2-tm_g_pp_patient_timeline [185.3s]
✔ |         59 | shinytest2-tm_g_pp_therapy [152.6s]
✔ |         34 | shinytest2-tm_g_pp_vitals [71.6s]
✔ |         27 | shinytest2-tm_t_abnormality [55.0s]
✔ |         27 | shinytest2-tm_t_abnormality_by_worst_grade [53.9s]
✔ |         39 | shinytest2-tm_t_ancova [77.0s]
✔ |         38 | shinytest2-tm_t_binary_outcome [59.7s]
✔ |         32 | shinytest2-tm_t_coxreg [56.7s]
✔ |         25 | shinytest2-tm_t_events [47.0s]
✔ |         31 | shinytest2-tm_t_events_by_grade [91.9s]
✔ |         22 | shinytest2-tm_t_events_patyear [42.9s]
✔ |   8     24 | shinytest2-tm_t_events_summary [85.4s]
✔ |         29 | shinytest2-tm_t_exposure [91.5s]
✔ |         27 | shinytest2-tm_t_logistic [72.0s]
✔ |         20 | shinytest2-tm_t_mult_events [71.7s]
✔ |         16 | shinytest2-tm_t_pp_basic_info [46.0s]
✔ |         47 | shinytest2-tm_t_pp_laboratory [132.9s]
✔ |         28 | shinytest2-tm_t_pp_medical_history [83.2s]
✔ |         29 | shinytest2-tm_t_pp_prior_medication [99.1s]
✔ |         25 | shinytest2-tm_t_shift_by_arm [70.4s]
✔ |         37 | shinytest2-tm_t_shift_by_arm_by_worst [118.6s]
✔ |         28 | shinytest2-tm_t_shift_by_grade [109.0s]
✔ |         25 | shinytest2-tm_t_smq [61.7s]
✔ |         18 | shinytest2-tm_t_summary [29.6s]
✔ |         33 | shinytest2-tm_t_summary_by [63.0s]
✔ |         32 | shinytest2-tm_t_tte [50.7s]
✔ |          1 | string_ops|          9 | substitute_names|          8 | tm_a_gee|         10 | tm_a_mmrm|          8 | tm_g_ci|          2 | tm_g_forest_rsp|          2 | tm_g_forest_tte|          4 | tm_g_ipp|          6 | tm_g_km|          4 | tm_g_lineplot|          6 | tm_t_abnormality|          5 | tm_t_abnormality_by_worst_grade|         14 | tm_t_ancova|         16 | tm_t_binary_outcome|          6 | tm_t_coxreg|         12 | tm_t_events|         16 | tm_t_events_by_grade|          6 | tm_t_events_patyear|          4 | tm_t_events_summary|          6 | tm_t_exposure|          6 | tm_t_logisitic|         12 | tm_t_mult_events|          9 | tm_t_pp_medical_history|          6 | tm_t_shift_by_arm|          6 | tm_t_shift_by_arm_by_worst|          6 | tm_t_shift_by_grade|          4 | tm_t_smq|         10 | tm_t_summary|         10 | tm_t_summary_by|          8 | tm_t_tte|         50 | utils|          6 | validate_standard_inputs

══ Results ═══════════════════════════════════════════════════════════════════════════════════════════════════════════════════════
Duration: 4044.2 s

[ FAIL 0 | WARN 8 | SKIP 0 | PASS 2012 ]

@vedhav vedhav merged commit 1cdbc7c into main May 10, 2024
29 checks passed
@vedhav vedhav deleted the shinytest2@main branch May 10, 2024 08:18
@github-actions github-actions bot locked and limited conversation to collaborators May 10, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement shinytest2 for tmc
6 participants