Skip to content

wormhole-0.5.3-beta release 更新

Compare
Choose a tag to compare
@Liuwenli11 Liuwenli11 released this 18 Sep 09:17
· 97 commits to 0.5 since this release

wormhole-0.5.3-beta release更新, 欢迎下载试用~~

链接:https://pan.baidu.com/s/1-mpCBC5EgJ0ptAARJiq6Jg 密码:kk4s

wormhole用户手册https://edp963.github.io/wormhole

具体步骤及使用步骤请参考用户手册

新功能:
[新增功能]flinkx增加feedback termination和heardbeat
[解决bug]lookup hbase时,sql中字段类型大小写不匹配问题
[优化]页面配置spark stream的jvm参数调整,将driver和executorjvm配置分开

注意:升级至0.5.3-beta版本,须将执行以下SQL语句,修改数据库表。
#stream表更新
ALTER TABLE stream ADD COLUMN jvm_driver_config VARCHAR(1000) NULL;
ALTER TABLE stream ADD COLUMN jvm_executor_config VARCHAR(1000) NULL;
ALTER TABLE stream ADD COLUMN others_config VARCHAR(1000) NULL;
UPDATE stream SET jvm_driver_config=substring_index(stream_config,",",1);
UPDATE stream SET jvm_executor_config=substring_index(substring_index(stream_config,",",2),",",-1);
UPDATE stream SET others_config=substring(substring_index(stream_config,substring_index(stream_config,",",2),-1),2);

#job表更新
ALTER TABLE job MODIFY COLUMN spark_config VARCHAR(2000);
ALTER TABLE job MODIFY COLUMN source_config VARCHAR(4000);
ALTER TABLE job MODIFY COLUMN sink_config VARCHAR(4000);
ALTER TABLE job ADD COLUMN jvm_driver_config VARCHAR(1000) NULL;
ALTER TABLE job ADD COLUMN jvm_executor_config VARCHAR(1000) NULL;
ALTER TABLE job ADD COLUMN others_config VARCHAR(1000) NULL;
UPDATE job SET jvm_driver_config=substring_index(spark_config,",",1);
UPDATE job SET jvm_executor_config=substring_index(substring_index(spark_config,",",2),",",-1);
UPDATE job SET others_config=substring(substring_index(spark_config,substring_index(spark_config,",",2),-1),2);

#udf表更新
ALTER TABLE udf ADD COLUMN stream_type VARCHAR(100) NULL;
UPDATE udf SET stream_type='spark';