Skip to content

Commit

Permalink
release 1.1.1
Browse files Browse the repository at this point in the history 
* 1.1.1 release

* 1.1.1 release

* 1.1.1 release
  • Loading branch information
@wolfboys
wolfboys authored Jul 14, 2021
1 parent 8cf430e commit 5cd7f5c
Show file tree
Hide file tree
Showing 124 changed files with 2,055 additions and 1,290 deletions.
60 changes: 39 additions & 21 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -31,22 +31,25 @@
English | [中文](README_CN.md)

# StreamX

Make Flink|Spark easier

> A magical framework that makes Flink development easier
## 🚀 Introduction

The original intention of `StreamX` is to make the development of `Flink` easier. `StreamX` focuses on the management of development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.
The original intention of `StreamX` is to make the development of `Flink` easier. `StreamX` focuses on the management of
development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing,
batch processing, data warehouse and data laker.

[![StreamX video](http://assets.streamxhub.com/streamx_player.png)](http://assets.streamxhub.com/streamx.mp4)

![](http://assets.streamxhub.com/streamx-main.png?12345)

![](http://assets.streamxhub.com/streamx-sql.png?12345)


## 🎉 Features

* Scaffolding
* Out-of-the-box connectors
* Support maven compilation
Expand All @@ -70,21 +73,28 @@ The original intention of `StreamX` is to make the development of `Flink` easier

![](http://assets.streamxhub.com/streamx1.png)


### 1️⃣ streamx-core

`streamx-core` is a framework that focuses on coding, standardizes configuration, and develops in a way that is better than configuration by convention. Also it provides a development-time `RunTime Content` and a series of `Connector` out of the box.
At the same time, it extends `DataStream` some methods, and integrates `DataStream` and `Flink sql` api to simplify tedious operations, focus on the business itself, and improve development efficiency and development experience.
`streamx-core` is a framework that focuses on coding, standardizes configuration, and develops in a way that is better
than configuration by convention. Also it provides a development-time `RunTime Content` and a series of `Connector` out
of the box. At the same time, it extends `DataStream` some methods, and integrates `DataStream` and `Flink sql` api to
simplify tedious operations, focus on the business itself, and improve development efficiency and development
experience.

### 2️⃣ streamx-pump

`streamx-pump` is a planned data extraction component, similar to `flinkx`. Based on the various `connector` provided in `streamx-core`, the purpose is to create a convenient, fast, out-of-the-box real-time data extraction and migration component for big data, and it will be integrated into the `streamx-console`.
`streamx-pump` is a planned data extraction component, similar to `flinkx`. Based on the various `connector` provided
in `streamx-core`, the purpose is to create a convenient, fast, out-of-the-box real-time data extraction and migration
component for big data, and it will be integrated into the `streamx-console`.

### 3️⃣ streamx-console

`streamx-console` is a stream processing and `Low Code` platform, capable of managing `Flink` tasks, integrating project compilation, deploy, configuration, startup, `savepoint`, `flame graph`, `Flink SQL`, monitoring and many other features. Simplify the daily operation and maintenance of the `Flink` task.
`streamx-console` is a stream processing and `Low Code` platform, capable of managing `Flink` tasks, integrating project
compilation, deploy, configuration, startup, `savepoint`, `flame graph`, `Flink SQL`, monitoring and many other
features. Simplify the daily operation and maintenance of the `Flink` task.

Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.
Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data
warehouse and data laker.

* [Apache Flink](http://flink.apache.org)
* [Apache YARN](http://hadoop.apache.org)
Expand All @@ -101,35 +111,45 @@ Our ultimate goal is to build a one-stop big data solution integrating stream pr
* [Monaco Editor](https://microsoft.github.io/monaco-editor/)
* ...

Thanks to the above excellent open source projects and many outstanding open source projects that are not mentioned, for giving the greatest respect, special thanks to [Apache Zeppelin](http://zeppelin.apache.org), [IntelliJ IDEA](https://www.jetbrains.com/idea/),
Thanks to the [fire-spark](https://github.com/GuoNingNing/fire-spark) project for the early inspiration and help.
Thanks to the above excellent open source projects and many outstanding open source projects that are not mentioned, for
giving the greatest respect, special thanks to [Apache Zeppelin](http://zeppelin.apache.org)
, [IntelliJ IDEA](https://www.jetbrains.com/idea/), Thanks to
the [fire-spark](https://github.com/GuoNingNing/fire-spark) project for the early inspiration and help.

### 🚀 Quick Start

```
git clone https://github.com/streamxhub/streamx.git
cd Streamx
mvn clean install -DskipTests -Denv=prod
```

click [Document](http://www.streamxhub.com/zh/doc/) for more information

## 👻 Why not...❓

### Apache Zeppelin

[Apache Zeppelin](https://zeppelin.apache.org) is a Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Java, Scala and more.
[Apache Zeppelin](https://zeppelin.apache.org) is a Web-based notebook that enables data-driven, interactive data
analytics and collaborative documents with SQL, Java, Scala and more.

At the same time we also need a one-stop tool that can cover `development`, `test`, `package`, `deploy`, and `start`.
`streamx-console` solves these pain points very well, positioning is a one-stop stream processing platform, and has developed more exciting features (such as `Flink SQL WebIDE`, `dependency isolation`, `task rollback `, `flame diagram` etc.)
`streamx-console` solves these pain points very well, positioning is a one-stop stream processing platform, and has
developed more exciting features (such as `Flink SQL WebIDE`, `dependency isolation`, `task rollback `, `flame diagram`
etc.)

### FlinkX

[FlinkX](http://github.com/DTStack/flinkx) is a distributed offline and real-time data synchronization framework based on flink widely used in DTStack, which realizes efficient data migration between multiple heterogeneous data sources.
[FlinkX](http://github.com/DTStack/flinkx) is a distributed offline and real-time data synchronization framework based
on flink widely used in DTStack, which realizes efficient data migration between multiple heterogeneous data sources.

`StreamX` focuses on the management of development phases and tasks. The `streamx-pump` module is also under planning, dedicated to solving data source migration, and will eventually be integrated into the `streamx-console`.
`StreamX` focuses on the management of development phases and tasks. The `streamx-pump` module is also under planning,
dedicated to solving data source migration, and will eventually be integrated into the `streamx-console`.

## 🍼 Feedback

You can quickly submit an issue. Before submitting, please check the problem and try to use the following contact information! Maybe your question has already been asked by others, or it has already been answered. Thank you!
You can quickly submit an issue. Before submitting, please check the problem and try to use the following contact
information! Maybe your question has already been asked by others, or it has already been answered. Thank you!

You can contact us or ask questions via:

Expand All @@ -140,14 +160,13 @@ You can contact us or ask questions via:

Are you **enjoying this project** ? 👋

If you like this framework, and appreciate the work done for it to exist, you can still support the developers by donating ☀️ 👊
If you like this framework, and appreciate the work done for it to exist, you can still support the developers by
donating ☀️ 👊

| WeChat Pay | Alipay |
|:----------|:----------|
| <img src="http://assets.streamxhub.com/1617938114478.jpg?12345" alt="Buy Me A Coffee" width="150"> | <img src="http://assets.streamxhub.com/1617938216431.jpg?12345" alt="Buy Me A Coffee" width="150"> |



## 🏆 My sponsors (Coffee Suppliers)

### 💜 Monthly Supplier
Expand All @@ -174,7 +193,6 @@ Welcome individuals and enterprises to sponsor, your support will help us better
<a href="https://github.com/zhaizhirui" alt="zhaizhirui"><img src="https://avatars.githubusercontent.com/u/39609947?v=4" height="50" width="50"></a>
</p>


### 🏅 Backers

Thank you to all our backers!
Expand All @@ -186,12 +204,12 @@ Thank you to all our backers!

<div align="center">

![Stargazers over time](https://starchart.cc/streamxhub/streamx.svg)
![Stargazers over time](https://starchart.cc/streamxhub/streamx.svg)

</div>

<div align="center">
<img src="http://assets.streamxhub.com/joinus0627.png" alt="Join the Group" width="200"><br>
<img src="http://assets.streamxhub.com/joinus0714.png" alt="Join the Group" width="200"><br>
<span>join us</span>
</div>

Expand Down
Loading

0 comments on commit 5cd7f5c

Please sign in to comment.