Skip to content

Commit

Permalink
Update readme. Prepare for release.
Browse files Browse the repository at this point in the history
  • Loading branch information
morazow committed Mar 22, 2019
1 parent c98ea2c commit 7f75a6c
Showing 1 changed file with 24 additions and 0 deletions.
24 changes: 24 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ can contact our support team.

* [Overview](#overview)
* [Getting started](#getting-started)
* [Storage Formats](#data-storage-formats)
* [Import](#import)
* [Export](#export)
* [Building from source](#building-from-source)
Expand Down Expand Up @@ -110,6 +111,28 @@ CREATE OR REPLACE JAVA SET SCRIPT EXPORT_TABLE(...) EMITS (ROWS_AFFECTED INT) AS
Please do not forget to change the bucket name or latest jar version according
to your setup.

## Data Storage Formats

When performing import or export, the default data format is set as [Apache
Parquet][parquet] format. However, you can specify the format using
`DATA_FORMAT` configuration property.

For example in order to import [Apache Avro][avro] format:

```sql
IMPORT INTO MY_SALES_POSITIONS_TABLE
FROM SCRIPT ETL.IMPORT_PATH WITH
BUCKET_PATH = 's3a://exa-bucket/data/avro/retail/sales_positions/*'
DATA_FORMAT = 'AVRO'
...
PARALLELISM = 'nproc()';
```

### Supported storage formats

* [Apache Parquet][parquet]
* [Apache Avro][avro]: currently only import is supported

## IMPORT

Please follow instructions below in order to import from different cloud
Expand Down Expand Up @@ -268,4 +291,5 @@ The packaged jar should be located at
[gcs]: https://cloud.google.com/storage/
[azure]: https://azure.microsoft.com/en-us/services/storage/blobs/
[parquet]: https://parquet.apache.org/
[avro]: https://avro.apache.org/
[jars]: https://github.com/exasol/cloud-storage-etl-udfs/releases

0 comments on commit 7f75a6c

Please sign in to comment.