You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Consider support for Apache Arrow Flight - data as a service paradigm
When combining "big data" / data science applications with microservices there is an impedance in how such big data is to be marshaled (both format and efficiency).
Apache Arrow aims to create a "shared runtime" between JVM, Python and R and used advanced techniques like "zero copy", memory mapping, etc.
Consider support for
Apache Arrow Flight
- data as a service paradigmWhen combining "big data" / data science applications with microservices there is an impedance in how such big data is to be marshaled (both format and efficiency).
Apache Arrow
aims to create a "shared runtime" between JVM, Python and R and used advanced techniques like "zero copy", memory mapping, etc.This will allow writing distributed, polyglot algorithms (the "business logic" of data science apps)
https://www.slideshare.net/wesm/data-science-without-borders-jupytercon-2017
https://www.youtube.com/watch?v=wdmf1msbtVs&feature=youtu.be&t=790
Apache Arrow Flight
aims to extend that performance to services.https://www.slideshare.net/JacquesNadeau5/apache-arrow-flight-overview
Seems to me that
Mu
is a great place to introduce that support to the Scala world.Please advise if this makes sense.
The text was updated successfully, but these errors were encountered: