Data

Raw

Raw data were taken from Brimacombe, C. (2023, March 30). Shortcomings of using freely available open species interaction networks produced by different publications. https://doi.org/10.17605/OSF.IO/MY9TV

Processed

Network data

• 📁 link-predict ← root folder
  • 📁 data
    • 📁 processed
      • 📁 features
        • 📄 features_py.csv ← features generated by python script
        • 📄 features_R.csv ← features generated by R script
      • 📁 networks
        • 📄 subsamples_edge_lists.csv ← sub-sampled networks (inc original networks)
        • 📄 subsamples_metadata.csv ← sub-sampled networks metadata

features_py.csv & features_R.csv

fields:

• link_ID - Auto generated ID of link (existing an non-existing)

Other fields are the features themselves, where they differ between the two files as different features are computed by two different scripts, a python script and a R script.

subsamples_metadata.csv

fields:

• subsample_ID - Auto generated ID of a sampled network
• name - Name of the network
• community - Ecological community (Plant-Pollinator, Plant-Seed Dispersers, etc..)
• fraction - Represent the proportion of observed links after sub-sampling. currently have only 0.8 (80% observed links) and 1.0 (Original network)
• type - Deprecated
• layer - Deprecated
• repetition - Deprecated

subsamples_edge_lists.csv

fields:

• link_ID - Auto generated ID of link (existing an non-existing)
• subsample_ID - Auto generated ID of a sampled network
• higher_level - Name of species of the higher trophic level
• lower_level - Name of species of the lower trophic level
• weight - weight of the link, but currently not used so it is converted to binary so 1.0
• class - link (1), non-links(0), and subsampled-links(-1) which are converted to 1 or 0 depending on the step (0 for feature extraction, 1 in test set..)

Results data

/results/ directory is described by the following files tree. The folders and code files are ordered according to the execution steps.

• 📁 results

  • 📄 results_preprocess.Rmd ← Loading and process the results data, so each fig will have its own prepared dataset.

  • 📄 results_figs.Rmd ← Loading the output of results_preprocess.Rmd and generate figures

  • 📁 raw ← Contains the "raw" results, which are mainly the output of the ML pipeline

    • 📄 results_domains.csv ← Contains results from a ML model trained and tested on varying groups (network domains/communities) combinations to assess cross-group generalization.
    • 📄 results_models.csv ← Contains results from different ML models
    • 📄 results_other_models.csv ← Contains results from different predictive models
    • 📄 feature_importance.csv ← Feature importances of all ML models

  • 📁 intermediate ← Contains intermediate processed fils, mainly the output of results_preproccessing

    • 📄 df_pred_heatmap.csv ← Result of a specific network in the test set, intended for demonstration figure.
    • 📄 metrics_df_long.csv ← Evaluation metrics of each network, long format
    • 📄 metrics_multi_df_long.csv ← Evaluation metrics of each network with multiple models, long format
    • 📄 metrics_type_df_long.csv ← Evaluation metrics of each network with varying group, long format
    • 📄 compare_other_models_metrics_df.csv ← Results of different predictive models
    • 📄 network_lvl_features.csv ← Features (network level only) for EDA
    • 📄 pr_df.csv ← Results of precision-recall curve
    • 📄 roc_df.csv ← Results of roc curve
    • 📄 auc_df.csv ← AUC values of roc and pr curves
    • 📄 test_data.csv ← Test set(link ids in test set) with metadata
    • 📄 bounds_summary_df.csv ← Results of theoretical bounds of each metric
    • 📄 pca_df.csv ← PCA components of network-level features

  • 📁 final ← Contains the final figures and table, mainly the output of results_figs

    • 📄 communities.pdf ← Distributions of performance measures - by community
    • 📄 eval_all.pdf ← Distributions of performance measures
    • 📄 features.csv ← Information about each feature
    • 📄 importance_pres.pdf ← Feature importance for tested ML model (RandomForest)
    • 📄 kruskal_wallis.csv ← Results of Kruskal Wallis test, comparing metrics of different communities
    • 📄 mann_whitney.csv ← Results of Mann-Whitney U Tests comparing the distributions of some metrics for various training and test combinations
    • 📄 networks_table.csv ← Information (source) about each network
    • 📄 networks_summary_properties.csv ← Summary of network properties
    • 📄 predictions.pdf ← Link prediction example for a host-parasite network
    • 📄 ROC.pdf ← ROC curve + PR curve
    • 📄 split_set.pdf ← Link prediction within and between community types
    • 📄 SI_community.pdf ← Distribution of link probabilities across different ecological communities
    • 📄 SI_complete ← Comparing learning from complete vs subsampled networks
    • 📄 SI_features_hist.pdf ← Histogram of selected network properties
    • 📄 SI_importance.pdf ← Feature importance for all tested ML models
    • 📄 SI_models.pdf ← ML models performance comparison, multiple evaluation metrics
    • 📄 SI_probabilities.pdf ← Distribution of link probabilities obtained from the model
    • 📄 SI_sensitivity ← Comparing performance for different fraction of removed linked
    • 📄 SI_sensitivity_com ← Comparing performance for different fraction of removed linked, for each community
    • 📄 SI_tradeoff.pdf ← The precision-recall tradeoff as a function of classification threshold

common fields in csvs:

• link_ID - Auto generated ID of link (existing an non-existing)
• community - Ecological community (Plant-Pollinator, Plant-Seed Dispersers, etc..)
• name - Name of the network
• fold - number of the cv fold the instance are from (usually between 1-5 or 1-3)
• model - name of the ML model used
• y_proba - probability of link of the instance, given by the model
• metric - name of the evaluation metric used
• feature - name of the feature
• importance - importance value of the feature
• SBM_Prob - probability of link of the instance, given by SBM model
• C_Prob - probability of link of the instance, given by connectance model
• type_train - links of which communities are forming the train data
• type_test - links of which communities are forming the test data