Skip to content

Latest commit

 

History

History
17 lines (9 loc) · 561 Bytes

spark-cachemanager.adoc

File metadata and controls

17 lines (9 loc) · 561 Bytes

Cache Manager

Cache Manager in Spark is responsible for passing RDDs partition contents to Block Manager and making sure a node doesn’t load two copies of an RDD at once.

It keeps reference to Block Manager.

Caution
FIXME Review the CacheManager class.

In the code, the current instance of Cache Manager is available under SparkEnv.get.cacheManager.

Caching Query (cacheQuery method)

Caution
FIXME

Uncaching Query (uncacheQuery method)

Caution
FIXME