New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GSoC: going deeper! #46

Open

JulienPeloton opened this issue Jun 18, 2018 · 2 comments

Member

JulienPeloton commented Jun 18, 2018

First steps logbook: #6

Week 5:

Added Octree Partitioned RDD support Added Octree Partitioned RDD support #36
Add SphereRDD SphereRDD #38
Code refactoring: Replace Sphere by ShellEnvelope, Shape3D heritage, and move everything under geometryObjects Code refactoring: Replace Sphere by ShellEnvelope, Shape3D heritage, and move everything under geometryObjects #40
v0.1.1 v0.1.1 #43
Remove confusion between cartesian and spherical coordinates for ShellEnvelope and BoxEnvelope Remove confusion between cartesian and spherical coordinates for ShellEnvelope and BoxEnvelope #44

A few TODO for week 6:

Fix bug while loading Octree Fix for a minor bug while partitioning using Octree #45
Treatment of objects at the border of partitions (see Overlapping shells for OnionPartitioning #25)
Multi-resolution algorithm for cross-match (see Multi-resolution search #26)
Tackling large shuffle? Tackling large shuffle? #32
Implement RangeQuery methods (to find neighbours).
spark3D website

JulienPeloton changed the title ~~GSoC: second month!~~ GSoC: going deeper!

Member Author

JulienPeloton commented Jul 13, 2018

Weeks 6 & 7 & 8:

0.1.4

Unify the IO: One constructor to rule them all! (Unify the IO: One constructor to rule them all! #69)
Octree and Geometry Objects Bug Fixes (Octree and Geometry Objects Bug Fixes #67)

0.1.3

Add KNN routines (Knn #59, KNN #60, Added a KNNEfficient implementation with takeOrdered #62)
Unify API to load data (Unified api: Point3DRDD #63, Uniform sphere API #64)
Speed-up cross-match methods by using native Scala methods (Speed-up cross-match methods by using native Scala methods #58)
Add a new website + spark3D belongs to AstroLab Software (website)
Update tutorials (tuto).
Many fixes! (see GSoC: going deeper! #46 - Add the new spark3D website #47)

Member Author

JulienPeloton commented Jul 30, 2018

Week 9:

0.1.5

Allow user to cache the rawRDD while loading data to speed-up re-partitioning. (Allow user to cache the rawRDD while loading data to speed-up re-partitioning. #81)
Script to benchmark the partitioning (Script to benchmark the partitioning #72)
Several minor fix (samle size fix #71, fix for elements missing after repartitioning RDD with Octree Partitioner #76, KNN ordering issue #80)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment