using ghcr.io/kbase img for standalone spark deployment

[Tianhao-Gu]

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 48.76%. Comparing base (1d4f084) to head (d3482c2).
Report is 3 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main      #75   +/-   ##
=======================================
  Coverage   48.76%   48.76%           
=======================================
  Files           4        4           
  Lines         121      121           
=======================================
  Hits           59       59           
  Misses         62       62           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[MrCreosote]

This is just the prelude to pulling things out of the image to slim it down? What can you actually remove? You still need the spark libs right?

[MrCreosote]

Does this fix the mac issues?

[Tianhao-Gu]

No. Without this, docker compose won't run on Mac machines since it cannot find the arm64 version. I used to manually modify docker-compose file before running it.

[MrCreosote]

LGTM in any case

[Tianhao-Gu]

This is just the prelude to pulling things out of the image to slim it down? What can you actually remove? You still need the spark libs right?

I will test and see if I can remove any spark libs in the next PRs. I want to do this little by little so that I can test in CI since local yarn doesn't work for me.