Skip to content

Commit

Permalink
"Created by snbot"
Browse files Browse the repository at this point in the history
  • Loading branch information
streamnativebot committed Aug 12, 2023
1 parent bb72dbd commit 26ea1e1
Show file tree
Hide file tree
Showing 3 changed files with 42 additions and 76 deletions.
18 changes: 9 additions & 9 deletions docs/lakehouse-sink.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ To build the Lakehouse sink connector from the source code, follow these steps.

```bash
ls target
pulsar-io-lakehouse-{{connector:version}}.nar
pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar
```

# How to configure
Expand Down Expand Up @@ -127,7 +127,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-hudi-pulsar"
],
"archive": "connectors/pulsar-io-hudi-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-hudi-3.1.0-SNAPSHOT.nar",
"processingGuarantees": "EFFECTIVELY_ONCE",
"parallelism": 1,
"configs": {
Expand All @@ -151,7 +151,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-hudi-pulsar"
],
"archive": "connectors/pulsar-io-hudi-{{connector:version}}-cloud.nar",
"archive": "connectors/pulsar-io-hudi-3.1.0-SNAPSHOT-cloud.nar",
"parallelism": 1,
"processingGuarantees": "EFFECTIVELY_ONCE",
"configs": {
Expand Down Expand Up @@ -179,7 +179,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-iceberg-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"iceberg",
Expand Down Expand Up @@ -207,7 +207,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-iceberg-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}-cloud.nar",
"archive": "connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT-cloud.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"iceberg",
Expand Down Expand Up @@ -238,7 +238,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-delta-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"delta",
Expand All @@ -260,7 +260,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"inputs": [
"test-delta-pulsar"
],
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}-cloud.nar",
"archive": "connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT-cloud.nar",
"processingGuarantees":"EFFECTIVELY_ONCE",
"configs":{
"type":"delta",
Expand Down Expand Up @@ -330,7 +330,7 @@ This example describes how to use the Lakehouse sink connector to fetch data fro
1. Copy the NAR package to the Pulsar connectors directory.
```
cp pulsar-io-lakehouse-{{connector:version}}.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar
```
2. Start Pulsar in standalone mode.
Expand Down Expand Up @@ -363,7 +363,7 @@ This example explains how to create a Lakehouse sink connector in an on-premises
1. Copy the NAR package of the Lakehouse sink connector to the Pulsar connectors directory.
```bash
cp pulsar-io-lakehouse-{{connector:version}}.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar
```
2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/).
Expand Down
10 changes: 5 additions & 5 deletions docs/lakehouse-source.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ To build the Lakehouse source connector from the source code, follow these steps

```bash
ls target
pulsar-io-lakehouse-{{connector:version}}.nar
pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar
```

# How to configure
Expand Down Expand Up @@ -90,7 +90,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"parallelism":1,
"topicName": "delta_source",
"processingGuarantees":"ATLEAST_ONCE",
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}.nar",
"archive": "connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar",
"configs":{
"type":"delta",
"checkpointInterval": 180,
Expand All @@ -115,7 +115,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you
"parallelism":1,
"topicName": "delta_source",
"processingGuarantees":"ATLEAST_ONCE",
"archive": "connectors/pulsar-io-lakehouse-{{connector:version}}-cloud.nar",
"archive": "connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT-cloud.nar",
"configs":{
"type":"delta",
"checkpointInterval": 180,
Expand Down Expand Up @@ -175,7 +175,7 @@ This example describes how to use the Lakehouse source connector to fetch data f
1. Copy the NAR package to the Pulsar connectors directory.
```
cp pulsar-io-lakehouse-{{connector:version}}.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar
```
2. Start Pulsar in standalone mode.
Expand Down Expand Up @@ -206,7 +206,7 @@ This example explains how to create a Lakehouse source connector in an on-premis
1. Copy the NAR package of the Lakehouse source connector to the Pulsar connectors directory.
```
cp pulsar-io-lakehouse-{{connector:version}}.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-{{connector:version}}.nar
cp pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.1.0-SNAPSHOT.nar
```
2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/).
Expand Down
Loading

0 comments on commit 26ea1e1

Please sign in to comment.