Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memolanes archive export v2 #110

Merged
merged 7 commits into from
Nov 30, 2024
Merged

Memolanes archive export v2 #110

merged 7 commits into from
Nov 30, 2024

Conversation

CaviarChen
Copy link
Owner

This feature will read all snapshots stored in your Fog Machine, then convert and optimize them one by one. After that, they will be merged into an archive file that can be read by MemoLanes (mldx).
Specifically:
1. All snapshots will be processed in the order of snapshot time and converted into journeys in MemoLanes.
2. Each journey's date is based on the snapshot time and your current time zone.
3. We subtract the previous snapshot from each snapshot, so each journey will only contain the diff.
4. Area that exists in a snapshot but not in the final snapshot will be removed. If you've used the eraser, ensure the final snapshot doesn't contain areas you don't want.
5. Snapshots that are too small will be ignored.

with the current optimization, it rought takes ~10s (instead of 60s) with my full data in debug (2s in release). We might need more memory on the server tho.

@CaviarChen CaviarChen merged commit 553eb49 into main Nov 30, 2024
5 checks passed
@CaviarChen CaviarChen deleted the memolanes-archive-v2 branch November 30, 2024 12:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant