Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Receive models from emission eval private data #945

Closed
wants to merge 133 commits into from
Closed

Receive models from emission eval private data #945

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
133 commits
Select commit Hold shift + click to select a range
207946e
Initial commit
shankari Jul 30, 2017
f192843
Check in the framework for such evaluation
shankari Nov 21, 2017
f2dd02d
Check in the first evaluation instance, which is for the TRB paper
shankari Nov 21, 2017
f69a28b
Merge pull request #1 from shankari/trb_2017
shankari Dec 1, 2017
3a4a227
Check in the percom analysis before we forget
shankari Mar 7, 2018
3fe973c
Support setting the HOME via environment variable here too
shankari Mar 7, 2018
11059dd
Merge pull request #2 from shankari/trb_2017
shankari Mar 7, 2018
386c182
Fix indentation
shankari Mar 7, 2018
78a3494
Make the setup and teardown generic and update the README to reflect …
shankari Mar 7, 2018
dbfb545
Merge pull request #3 from shankari/trb_2017
shankari Mar 7, 2018
b5bab6f
Have the teardown delete current conf, not the e-mission conf!
shankari Mar 7, 2018
b6645d4
Merge pull request #4 from shankari/fix_setup_teardown
shankari Mar 7, 2018
8064c39
Create a new directory with new setup and teardown scripts
shankari Mar 8, 2018
25496b3
Merge pull request #5 from shankari/fix_setup_teardown
shankari Jun 11, 2018
7bbca3f
Add the setup and teardown directories for the tripaware paper
shankari Jun 11, 2018
a378a8c
Merge pull request #6 from shankari/add_tripaware_dir
shankari Jun 11, 2018
59a9442
Add guidelines on checking in notebooks
shankari Jun 11, 2018
0afbfe1
adding notebooks
jesbu1 Jul 3, 2018
d08608b
made cleared outputs and uncleared outputs folders
jesbu1 Jul 3, 2018
dee70d6
pulled out stats functions
jesbu1 Jul 9, 2018
af167db
Merge pull request #7 from jesbu1/master
shankari May 27, 2019
c6d6639
Fix the copyright
shankari Jun 27, 2020
9196df4
Add a list of open source licenses
shankari Jun 27, 2020
68f8313
Merge pull request #10 from shankari/fix_license
shankari Jun 27, 2020
51e2dcb
Auto-merge bulk update of org policies
shankari Jan 14, 2021
2ed6aa0
Fix setup (#12)
shankari Jan 27, 2021
8a615ff
Ignore conf files and improve instructions to run the evaluations (#13)
shankari Jan 27, 2021
cd1fd72
Pull out visualization code from the similarity detection (#14)
shankari Jan 28, 2021
65743ca
plot graphs for all users (#15)
corinne-hcr Jan 31, 2021
badbe70
Fix errors in setup instructions (#17)
shankari Feb 8, 2021
8961264
Bins and clusters (#16)
corinne-hcr Feb 13, 2021
969ed67
cannot extract user_input, need help (#18)
corinne-hcr Feb 21, 2021
349eec3
Refactor filtering and featurization (#20)
corinne-hcr May 27, 2021
fc3e00f
check codes (#21)
corinne-hcr May 31, 2021
84967e9
add some changes (#22)
corinne-hcr Jun 1, 2021
34f4696
Add a notebook to explore various parameters for the radius
shankari Jul 22, 2021
95bcf8f
Add simple script to federate multiple datasets and save them to a csv
shankari Jul 22, 2021
dec7f75
Merge pull request #26 from shankari/tune_clustering_params
shankari Jul 22, 2021
9d7df22
Merge pull request #27 from shankari/tune_clustering_params
shankari Jul 23, 2021
25b1a84
Removing the image attachements so we can publish this successfully
shankari Jul 23, 2021
97551b2
Save as JSON + reset index
shankari Jul 23, 2021
a9acdc7
Using DBSCAN for the trip clustering as well
shankari Jul 23, 2021
98e8385
Finally, compare multiple datasets against each other
shankari Jul 23, 2021
2f15429
Deep dive into the similarity code
shankari Jul 23, 2021
bb21c7a
check in notebook code (#23)
corinne-hcr Jul 24, 2021
bfe3856
Update the notebook to match the new similarity definition
shankari Jul 24, 2021
8f2b5b6
Evaluate the similarity code with multiple parameters and regimes
shankari Jul 25, 2021
496cd6a
Split the model generation from the result creation
shankari Jul 25, 2021
da7434d
Finish the multi-dataset visualizations, at least for now
shankari Jul 25, 2021
4212e35
Try alternate methods of handling noisy trips in the h-score
shankari Jul 27, 2021
d725f72
Revert "Try alternate methods of handling noisy trips in the h-score"
shankari Jul 30, 2021
2dbca24
Explore multiple h-scores + improve h-score and request count calcula…
shankari Jul 30, 2021
e272cb1
Fix the notebook so it can run from the top
shankari Aug 2, 2021
6a33a55
Use the passed in parameter instead of a global variable from before
shankari Aug 6, 2021
18e6f04
Add a sample notebook to explore OpenPATH geojson exports
shankari Mar 19, 2022
dac01c0
Merge pull request #29 from shankari/geojson_example
shankari Mar 19, 2022
350171d
Finish checking in all the pending notebooks for the clustering
shankari Jun 7, 2022
cf100a7
Finish checking in all the pending notebooks for the clustering
shankari Jun 7, 2022
6071c5d
Merge branch 'master' of https://github.com/e-mission/e-mission-eval-…
shankari Jun 7, 2022
ee4b03e
Move all the obsolete analysis out
shankari Jun 7, 2022
b54330d
Merge pull request #28 from shankari/tune_clustering_params
shankari Jun 7, 2022
9ae3120
explore a modified homogeneity score
hlu109 Jun 14, 2022
64d35bd
Explore various improvements for clustering
hlu109 Jul 5, 2022
9a9ee70
Evaluate performance of current label assist alg
hlu109 Jul 5, 2022
9964a71
Further clustering work:
hlu109 Jul 7, 2022
28cc8ca
Update label-assist models:
hlu109 Jul 19, 2022
f5cf6f6
fix incorrect parameter name being passed
hlu109 Jul 19, 2022
eb13d0c
update old_clustering_predictor to accept dataframes
hlu109 Jul 19, 2022
dd5667b
Update label-assist models:
hlu109 Jul 25, 2022
020f200
Update performance evaluation
hlu109 Jul 25, 2022
014ce9e
Compare performance of various classifiers
hlu109 Jul 25, 2022
7a14228
tune random forest hyperparameters
hlu109 Jul 25, 2022
8a33107
Implement basic classifier with random forests (no clustering)
hlu109 Jul 26, 2022
ced9ae5
Visualize decision trees
hlu109 Jul 26, 2022
cceff5c
Evaluate model performance by dataset size; add comments
hlu109 Jul 26, 2022
97faa93
fix missing import
hlu109 Jul 26, 2022
6b46f34
Visualize SVM subclusters without any threshold requirements
hlu109 Jul 27, 2022
5c3e104
Update map aesthetic and remove street names
hlu109 Jul 28, 2022
e0865a5
Set default DBSCAN minPts to 1
hlu109 Jul 28, 2022
90b909c
Fix discrepancy in prediction count
hlu109 Jul 28, 2022
595de4e
Fix indexing issue for labels from oursim
hlu109 Jul 29, 2022
cb780a7
Simplify DBSCAN+SVM clustering
hlu109 Jul 29, 2022
8c2f7b6
Merge branch 'master' of https://github.com/e-mission/e-mission-eval-…
shankari Jul 30, 2022
c229c48
Merge branch 'master' of https://github.com/hlu109/e-mission-eval-pri…
shankari Jul 30, 2022
1c58ab0
Plot the results from a csv into a nice plot
shankari Jul 30, 2022
3d0f251
Merge pull request #1 from shankari/hannah_clustering
hlu109 Jul 30, 2022
8870da9
Merge branch 'master' of https://github.com/hlu109/e-mission-eval-pri…
hlu109 Jul 31, 2022
4519729
remove extraneous code
hlu109 Jul 31, 2022
1766421
update hyperparameters for final analyses
hlu109 Jul 31, 2022
0862202
update model parameters for analysis
hlu109 Jul 31, 2022
9f47530
create folder for TRB label assist code
hlu109 Aug 1, 2022
28f2f60
Refactor model classes:
hlu109 Aug 12, 2022
05e95d1
fix prediction dataframe column names
hlu109 Aug 12, 2022
750c337
use trip distance in confusion matrices; update evaluation functions …
hlu109 Aug 12, 2022
fb6787a
fix formatting of long docstrings/comments
hlu109 Aug 12, 2022
a8e1092
add note about class probabilities; remove extraneous import code
hlu109 Aug 12, 2022
91bb34d
update model names and parameters
hlu109 Aug 12, 2022
68035f7
fix indexing issue
hlu109 Aug 12, 2022
a57f94d
add copy of code used in TRB paper
hlu109 Aug 12, 2022
d84f17d
fix typo
hlu109 Aug 12, 2022
bac5294
update variable/function names
hlu109 Aug 12, 2022
1a33d19
update classification performance analysis
hlu109 Aug 12, 2022
8d823a9
Merge branch 'master' of https://github.com/hlu109/e-mission-eval-pri…
hlu109 Aug 12, 2022
c6c0500
demonstrate functions to evaluate classification performance
hlu109 Aug 12, 2022
ece0b91
handle minor classification bugs
hlu109 Aug 17, 2022
b38d230
add code to generate updates for poster
hlu109 Dec 16, 2022
9ee36db
update user uuid lookup
hlu109 Dec 16, 2022
2c9cdf6
update user uuid lookup; add documentation note
hlu109 Dec 16, 2022
74cc90d
Merge remote-tracking branch 'origin/master' into poster_update
hlu109 Dec 16, 2022
9d2e10a
update code to generate new figs for poster
hlu109 Dec 17, 2022
54b6d72
update usage instructions
hlu109 Jan 18, 2023
b5b9d78
count usable trips for cross-validation
hlu109 Feb 13, 2023
9cf0cd3
update SVM notebook to reflect latest data
hlu109 Feb 13, 2023
9d5b16e
add cluster quality comparisons
hlu109 Feb 13, 2023
9082a3b
replaced old notebook
hlu109 Feb 13, 2023
e486ec7
Merge branch 'master' of https://github.com/hlu109/e-mission-eval-pri…
shankari Feb 14, 2023
7f8bbb6
Minor changes to the classification performance code
shankari Feb 15, 2023
4121a52
Add additional logging to the calculation so that we can monitor the …
shankari Feb 15, 2023
60caf2e
Add a simple script to regenerate all the classification performance …
shankari Feb 15, 2023
1a7bc5a
Merge branch 'poster_update'
hlu109 Feb 17, 2023
c656a2c
Merge branch 'master' of https://github.com/hlu109/e-mission-eval-pri…
shankari Feb 17, 2023
a1c893f
Add a simple notebook indicating how to work with location data from …
shankari Jun 6, 2023
2686c6e
Minor changes to ensure that all the notebooks run out of the box
shankari Jun 7, 2023
1d15bb5
Merge pull request #34 from hlu109/poster_update
shankari Jun 7, 2023
226c25e
Covering up a possible error : db.conf NOT FOUND (#36)
humbleOldSage Aug 14, 2023
06ec370
Update clustering.py (#37)
humbleOldSage Nov 25, 2023
7a1a3af
Merge remote-tracking branch 'destination/move-models-to-e-mission-se…
humbleOldSage Nov 30, 2023
15106da
Removing unnecessary files
humbleOldSage Dec 1, 2023
2ef6346
Cleanup
humbleOldSage Dec 1, 2023
3524096
More Cleanup
humbleOldSage Dec 1, 2023
5c49f29
Even more cleanup
humbleOldSage Dec 1, 2023
6863e99
Update inter-file dependencies for relocated files
humbleOldSage Dec 1, 2023
87c09c0
Minor Fixes
humbleOldSage Dec 1, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading