A common set of python libraries for DataBricks.
This package can not be run or tested without access to pyspark. However, installing pyspark as part of our installer gave issues when other versions of pyspark were needed. Hence we took out the dependency from our installer.
Get it from PyPi
pip install atc-dataplatform
To prepare for development please install these additional requirements:
- Java 8
pip install -r test_requirements.txt
Then install the package locally
python setup.py develop
After installing the dev-requirements, execute tests by running
pytest tests
If these tests don't pass, PRs will not be accepted. If you add features, please include tests for these features.
