Skip to content

0.9.1
Compare
Choose a tag to compare
@Adamyuanyuan Adamyuanyuan released this 02 Apr 05:51
· 3784 commits to master since this release
0.9.1
6e3c045

DSS 0.9.1 is a version led by ChinaTelecom Ctyun Big Data Platform Team with the help of WeBank.

This is the next release based on DSS 0.9.0 . This version aims to reduce the operation and maintenance costs of WeDataSphere components such as DSS, Linkis, and Schedulis for community users through the new feature of "new user initialization", so that DSS can use "new user initialization" to automatically initialize the execution environment of new created users.

Since 0.9.0, this version contains 7 improvements and enhancements.

Enhancement

  • [DataSphereStudio-274] Adding account creation function. Support users to customize configuration according to their own environment,currently available to create include(LDAP，management node account，HDFS&Linux directory ，scheduling account，hive database，keytab), because the environments of community users are quite different, users can also add new implementations or modify scripts to adapt to their own environment.

  • [DataSphereStudio - 288] Support creating users on the master machine

  • [DataSphereStudio - 289] Support creating workspace for the newly added user(support Linux and HDFS) and HDFS

  • [DataSphereStudio - 290] Support adding users to the Schedulis configuration and immediately overriding.

  • [DataSphereStudio - 291] Support initializing the environment needed by Hive for newly added users.

  • [DataSphereStudio - 292] Support for creating and distributing keytab files in Kerberos clusters for new users.

  • [DataSphereStudio - 293] Support adding users to the LDAP based system

Credits

The release of DSS 0.9.1 is inseparable from the contributors from the WeDataSphere community. They selflessly contribute their code and actively communicate with community partners. Without their help, DSS 0.9.1 cannot be successfully released. Thanks to all the community contributors! Rank in no particular order:

luxl : Basic code and workspace module, scheduling authorization, and part of the front-end development of account creation.
HanTang:LDAP module and Hadoop master node account creation function.
lvjw: Documentation contribution.
schumiyi : Fix the problem that the application prompts that it is not open source after the initial installation.
tomshy1 : Front-end development of account creation .
JsonLiuUp: Keytab creation and distribution, hive database activation and authorization.
ldtong:Scheduling authorization.

Upgrade Guide

This version involves adjustments to some JARs. If DSS is running in your production environment, you only need to simply replace some of DSS Jars to upgrade. For details, please refer to: DSS 0.9 .1 Upgrade Guide.
Please note: This version provides a new feature called "new user initialization" . In order to use this feature properly, please keep notice of DSS0.9.1 New User Initialization Usage Document.

Cloud Resource

DSS + Linkis + Qualitis + Visualis + Azkaban one-click installation package
URL：dss_linkis.zip

DSS 0.9.1 是在微众银行的倾力帮助下，由 天翼云 主导完成的一个版本。

这是基于 DSS 0.9.0 的下一个发行版本。该版本旨在通过新增“新用户初始化”特性，为社区用户降低运维DSS、Linkis和Schedulis等WeDataSphere组件的运维成本，让DSS在新增新登录用户时，可以使用“新用户初始化”功能自动完成新用户的所有环境初始化操作。

本次版本包含了7个改进和增强。

特性增强

  • [DataSphereStudio-274] 新增新用户初始化特性。不同的环境，支持配置化创建新用户所需的所有环境信息，目前包括：LDAP、管理节点账号、HDFS和Linux目录、调度账号、hive库、keytab等，且预留了相关接口，允许用户自己新增实现，或者修改脚本适配自己的环境。
  • [DataSphereStudio-288] 新增在主控机上创建用户特性。
  • [DataSphereStudio-289] 支持给新用户创建工作空间（支持Linux和HDFS）。
  • [DataSphereStudio-290] 支持在Schedulis的配置中添加用户，并立刻重载。
  • [DataSphereStudio-291] 支持给新用户初始化HIVE所需环境信息。
  • [DataSphereStudio-292] 支持为新用户在Kerberos集群创建和分发keytab文件。
  • [DataSphereStudio-293] 支持给基于LDAP体系新增用户。

新贡献者

DSS 0.9.1 的发布，离不开WeDataSphere社区的贡献者，他们无私地贡献自己的代码，积极地与社区伙伴进行技术交流，有了他们的助力，DSS 0.9.1 才能顺利地发布，在此感谢各位社区的贡献者! 排名不分先后:

luxl：本次版本的社区主导者。基础代码和工作空间模块，调度授权，以及创建账号部分前端开发。
HanTang：LDAP模块和hadoop主节点账号创建功能。
lvjw：贡献文档。
schumiyi：修复初始化安装后进入应用提示未开源的问题。
tomshy1：创建账号前端开发。
JsonLiuUp：keytab创建和分发，hive库开通和授权。
ldtong：调度授权。

升级指南

本次版本涉及对一部分JAR包进行了调整，如果您已经在生产环境使用了DSS，并且不想重新安装DSS的话，只需要对其中的几个Jar进行简单替换即可，具体请参考：DSS 0.9.1升级指南。

请注意：本次版本提供了新用户初始化的大特性，为了使您能正常使用该特性，请在安装和升级前，先阅读 DSS0.9.1新用户初始化使用文档。

云资源

DSS + Linkis + Qualitis + Visualis + Azkaban一键安装包
链接：dss_linkis.zip

Assets 2
Loading