Releases: mrpowers-io/spark-daria
Releases · mrpowers-io/spark-daria
v0.5.0
Summary of changes:
- Update the
createDF
method to use the terse syntax of thetoDF
method with the control of thecreateDataFrame
method
Full list of changes: v0.4.0...v0.5.0
v0.4.0
Summary of changes:
- Added a
SparkSession#createDF
method to create DataFrames with a syntax that's less verbose.
Diff of changes: v0.3.0...v0.4.0
v0.3.0
Summary of changes:
- Add a
validateAbsenceOfColumns
to theDataFrameValidator
to raise errors if DataFrames contain prohibited columns
Full diff of changes: 0.2.0...v0.3.0
v0.2.0
Summary of changes:
-
Added a
validateSchema
to theDataFrameValidator
trait to validate the presence of all StructFields in a DataFrame. -
Added the scalariform plugin to automatically format the code consistently
-
Renamed variables to be consistent with the spark-style-guide
Full diff of changes: 0.1.0...v0.2.0
Version 0.1.0
Refactored DataFrameValidator to be a trait, so it's easier to include in classes.
First official release
0.0.1 Clean up the code a bit