Please utilize https://www.python.org/dev/peps/pep-0008/ for coding guides. IntelliJ defaults to this style for python as well.
Environment Variables in Run Configuration
- PYTHONPATH=/Users/hnat/Downloads/spark-2.0.2-bin-hadoop2.7/python:/Users/hnat/Downloads/spark-2.0.2-bin-hadoop2.7/python/lib/py4j-0.10.3-src.zip
- SPARK_HOME=/Users/hnat/Downloads/spark-2.0.2-bin-hadoop2.7/
- PYSPARK_SUBMIT_ARGS=--packages com.datastax.spark:spark-cassandra-connector_2.11:2.0.1 pyspark-shell
Add pyspark.zip to your project libraries:
http://stackoverflow.com/questions/13994846/intellij-python-plugin-run-classpath
- Go to File -> Project Structure
- Now select Modules and then "Dependencies" tab
- Click the "+" icon and select "Library"
- Click "New Library" and select Java (I know it's weird...)
- Now choose multiple modules / egg and "OK".
- Select "Classes" from categories.
- Give your new library a name, "My Python not Java Library"
- And finally click "Add Selected"