Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Frequent Directions Modules #329

Open
wants to merge 61 commits into
base: main
Choose a base branch
from
Open

Frequent Directions Modules #329

Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
f2f968a
Added frequent directions module
Jul 17, 2023
7a589c3
Checkpoint. Not sure what has been changed, but parallel FD should be…
Jul 18, 2023
0a1df81
Updated freqdir
Jul 19, 2023
8514877
Checkpoint
Jul 19, 2023
4d752b4
Merge branch 'lcls-users:main' into main
john-winnicki Jul 19, 2023
f11a31f
Fixed gather command.
Jul 20, 2023
3b1f4a8
Merge branch 'main' of https://github.com/john-winnicki/btx
Jul 20, 2023
be8d312
checkpoint
Jul 21, 2023
7b26c0e
Added rank adaptive and tree merge. Both have not been tested yet
Jul 21, 2023
b8270aa
Parallel Rank Adaptive and Merge Tree appear to run. Can't say for su…
Jul 21, 2023
d5b8abd
Fixed treemerge and parallel rank adaptive FD. Things seem to work. N…
Jul 21, 2023
c204c3f
Separated FreqDir to create Merge Tree and also projection module. Sa…
Jul 25, 2023
07d624e
Checkpoint
Jul 28, 2023
1f801ef
Cleaned up code
Jul 28, 2023
222ba0b
Checkpoint. I don't think any significant changes have been made
Jul 30, 2023
fb68d4b
Refactored code and addressed many of the code review comments.
Aug 3, 2023
c0f4a42
Addressed more pull comments, fixed mean bug, and added more document…
Aug 3, 2023
a05ca8b
Added additional documentation for MergeTree and ApplyCompression mod…
Aug 4, 2023
832226d
Checkpoint. Not sure what has been changed
Aug 8, 2023
2a298ba
Checkpoint
Aug 9, 2023
d321fab
Added priority sampling in previous commit. Addressed minor comments …
Aug 10, 2023
ed9e9ea
Checkpoint. Didn't really change anythnig other than initial steps to…
Aug 16, 2023
79894e5
Set up parent class for dimension reduction called DimRed. Shared fun…
Aug 20, 2023
2c57322
Cleaned up code and added documentation where appropriate.
Aug 23, 2023
a3a25ed
Added UMAP visualization and wrapper class to FD module. Set up paren…
Aug 28, 2023
b3b57b6
Changed data grabbing to only retrieve data once at the beginning. Al…
Aug 31, 2023
e75809c
124 hz officially a achieved. Permission denied and h5 truncated, h5 …
Sep 2, 2023
697723e
Everything working and produces 120 hz processing speed. Added modula…
Sep 3, 2023
5a08eff
Fixed UMAP html
Sep 3, 2023
4692ae3
Fixed img range processed tracking and counting bug. Also moved data …
Sep 4, 2023
aa1b561
Cleaned up code. Produces 130hz with nice clustering.
Sep 4, 2023
7b182bd
Cleaned up code and made it so that you don't need to evenly divide e…
Sep 6, 2023
eb2c66d
Checkpoint. Not sure what changed
Sep 14, 2023
07c3ee8
disabling common mode correction in FredDir DataRetriever. Seems to b…
fredericpoitevin Sep 14, 2023
6f5fa51
typo
fredericpoitevin Sep 14, 2023
999a1f9
fixed cmpars behavior to disable common mode correction if requested
fredericpoitevin Sep 14, 2023
97a0af9
Merge pull request #1 from lcls-users/main-john
john-winnicki Sep 14, 2023
b4551fe
created FD sketch tasks and workflow.
fredericpoitevin Sep 14, 2023
71748da
created FD sketch tasks and workflow.
fredericpoitevin Sep 14, 2023
26531dd
Merge pull request #2 from lcls-users/main-john
john-winnicki Sep 15, 2023
d0b8545
Moved psana. Resolved cmpar bug. 430hz processing time not including …
Sep 15, 2023
8dd6ccc
Fixed reconstruction error. Removed double psana initialization. Move…
Sep 17, 2023
b8f9ab4
Checkpoint. I don't think there are any major changes.
Sep 24, 2023
0683896
Checkpoint. Runs well and synthetic data fixed.
Oct 3, 2023
9ccfb95
Separated visualization from sketching file
Oct 3, 2023
a64ccb0
Reverted separation changes.
Oct 3, 2023
260fe9a
Removing UMAP and HDBSCAN dependency from freqdir module. Also made d…
fredericpoitevin Oct 3, 2023
0bbad24
attempt at only having psana dependency where needed in freqdir
fredericpoitevin Oct 3, 2023
704a76e
Drafting FD tasks.
fredericpoitevin Oct 4, 2023
b4a7793
Fixed bug in importing btx and other libraries. Minor other changes I…
Oct 5, 2023
04195d8
Checkpoint
Oct 17, 2023
3c91bd0
added some logger INFO to ischeduler
fredericpoitevin Oct 20, 2023
c2b7ea5
when a conda environment is activated in write_dependencies (in ische…
fredericpoitevin Oct 20, 2023
5de1268
Some of these settings produced good visualization. I think you have …
Nov 8, 2023
64cabbf
Everything is working. It runs and produces beam profiles using scali…
Dec 29, 2023
e4ac86e
run, script, scalingscript, scalingrun. Fixed bug where images were n…
Dec 31, 2023
8f81c98
Checkpoint. This is working nice.
Jan 11, 2024
931de83
Pushing as a checkpoint. Not too sure what changed, but this code see…
Mar 12, 2024
c4abf71
Modified the script to allow for elog submission.
Mar 12, 2024
a254014
I don't think I changed anything.
Mar 12, 2024
1449dac
Not sure what changed
Jul 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,6 @@ adhoc/
__pycache__/

# cli -tmp yaml
tutorial/*-tmp.yaml
tutorial/*-tmp.yaml

*.h5
Loading