Skip to content

bigfootproject/sahara-image-elements

 
 

Repository files navigation

Sahara image elements project (Spark experimental fork)

This repository has been forked to develop the Spark support in Sahara. The images created with this version of the DIB should be used together with the Sahara version available here: https://github.com/bigfootproject/sahara

The changes from the upstream repository include:

  • support for more recent versions of Spark
  • Use the Cloudera element to install HDFS from CDH 5.3
  • Install Spark Notebook along with Spark
  • Other non-Spark elements and image types to support project related to Bigfoot

To create images for Spark on CDH4 HDFS and for all the other Sahara plugins use the standard Sahara DIB.

You should only need to run this command:

tox -e venv -- sahara-image-create

Note: More information about script diskimage-create

This research work is part of the Bigfoot project: http://bigfootproject.eu/

Pre-prepared images

These images have been generated by the modified image builder and are available for download for your convenience.

  • Spark: contains Spark 1.5.0 and HDFS from Cloudera 5.3, can be used to create also Spark-only or HDFS-only clusters
  • DiNoDB

About

Disk image elements for Savanna

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Shell 95.8%
  • Python 4.2%