Releases: sodafoundation/soda
SODA v1.1.1 Hawaii Pre-Release
Version Summary
Version Number : v1.1.1 [tag: v1.1.1]
Version Name: Hawaii Pre-Release
Date: 06-Jan-2020
Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples
Release Summary :
SODA Hawaii Pre-Release is an incremental release on Greenland Release(v1.1.0) of SODA Foundation.
The earlier stable release Greenland, you can get here.
SODA Hawaii will focus on providing heterogeneous framework for storage monitoring and management with enhanced features and drivers over the last release. (Hawaii is known for its beauty and fertile soil. Hawaii is comprised of 130+ islands (ref: wikipedia)).
Hawaii: Working with heterogeneous, and providing a unified solution!
This is a pre-release for Hawaii for testing/demo only
Changelog
This changelog is based on SODA release Greenland.
SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.
-
Overall Features:
- Heterogeneous SPM (Storage Performance Monitoring) with Anomaly Detection
- SPM Visualization (Grafana integration)
- IBM SVC, HDS VSP, EMC Unity
- Enhanced Multi-cloud:
- Block(AWS, Huawei)
- File(AWS, GCP, Azure, Huawei)
- Hybrid Data Archival /Retrieval (Onprem-AWS)
-
Delfin: SODA Infrastructure Management
- Storage Performance monitoring visualization (Grafana integrated)
- Alert exporter (Kafka)
- Drivers :IBM Storwize/SVC | Hitachi VSP | EMC Unity
- Code improvements and optimization
-
Multi-Cloud
- Block:
- EVS support for Huawei Cloud
- Current Block support for AWS, Huawei tested
- File:
- EFS support for Huawei Cloud
- Current File Support for AWS, GCP, Huawei, Azure
- Object:
- Support continued for AWS, GCP, Azure, Huawei, IBM, AliBaba, Ceph, YIG-Ceph
- Validation for register cloud backend
- Hybrid Data Archival / Retrieval:
- On-Prem to Cloud Archival and retrieval support for AWS
- Block:
-
SODA Drivers
- S3 API compatibility for snapshot backup to Cloud
- IBM Storwize/SVC | Hitachi VSP | EMC Unity for Delfin added
-
SODA Experience & Quality
- Dashboard :
- Performance metric collection and visualization(Grafana integrated) | support for fetching Delfin alerts from Alertmanager API | Data archival and retrieval support for mult-icloud | Huawei Cloud EVS and EFS support
- Installer :
- srm toolchain (Grafana, Prometheus) installation for Delfin performance metric visualization
- QA:
- More tests and test cases
- Dashboard :
SODA Projects/Repos part of this release:
Key projects part of this SODA Release
SODA Framework Core Projects:
| Project | Release Link |
|---|---|
| delfin | delfin release v1.1.0-rc2 |
| api | api release v1.0.0 |
| controller | controller release v1.0.0 |
| dock | dock release v1.2.0-rc2 |
| multi-cloud | multicloud release v1.2.0-rc2 |
SODA Experience Projects
| Project | Release Link |
|---|---|
| installer | installer release v1.2.0-rc2 |
| dashboard | dashboard release v1.2.0-rc2 |
SODA Other Projects
| Project | Release Link |
|---|---|
| orchestration | orchestration release v0.12.0 |
| anomaly-detection | anomaly detection release v0.10.0 |
| nbp | nbp release v1.0.1 |
How to use the Release:
Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.1.1)
SODA Documentation
Issues and Suggestions
Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues
For all other issues/suggestions, please raise to the respective project repositories.
SODA v1.1.0 Greenland Release
Version Summary
Version Number : v1.1.0 [tag: v1.1.0]
Version Name : SODA Greenland Release
Date : 30-Sep-2020
Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples, design-specs
Release Summary :
SODA Greenland Release is an incremental release on Faroe Release(v1.0.0) of SODA Foundation.
The earlier stable release Faroe, you can get here.
SODA Greenland will focus on providing a heterogeneous framework for storage monitoring and management with enhanced features and drivers over the last release. (Greenland is the world's largest island located between the Arctic and Atlantic oceans and an autonomous territory (ref: Wikipedia)).
SODA Open Data Framework (ODF) Greenland release adds unified storage performance monitoring, and integrates with Prometheus and Kafka to offer deep visibility and insights into cloud native environments. ODF delivers integrated data management and enables seamless data mobility between on-premise and multicloud
It also provides the first experiment for Edge Data Management with SODA along with KubeEdge, a Kubernetes native edge computing platform & a CNCF project
Greenland: Together we can meet the challenge and grow to the best!
Changelog
This changelog is based on SODA release Faroe.
-
Overall
- The SODA releases repository has been renamed to github.com/sodafoundation/soda
(Earlier it was github.com/sodafoundation/releases. The old link will redirect to the new) - SODA releases will provide the key use cases, integrations, and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.
- The SODA releases repository has been renamed to github.com/sodafoundation/soda
-
Delfin: SODA Infrastructure Management
- Enhanced the resource and alert management framework with new features and fixes.
- Overall: OpenAPI updated | SSH backend interface | Configurations for exporter | Removed plain text password caching
- Resource Management: Raw capacity | Subscribed Capacity | DB Model enhancements
- Alert Management: Clear Alert | Model and SNMP improvements | List Alerts | Query Alert
- Drivers : HP 3PAR StoreServ | SSL support | VMAX driver improvements
- Basic Performance Monitoring Framework: Register | Scheduler | Metrics Collection with Fake Driver | Exporter to Prometheus |Exporter to Kafka| PoC with Prometheus and Kafka
-
Multi Cloud
- Added Fileshare support for GCP Filestore (Create/Update/List/Get/Delete and Credential encryption support)
- New APIs for AWS Block Service (Update/Get/Delete)
- Data Persistence DB Sync for Fileshare Create and Update APIs
- Create & List API enhancements AWS Block Service
- Bug Fixes
-
NBP:
- CSI Plug n Play- Updated design alternatives for CSI plug and play
- New design based PoC with LVM and IBM drivers
-
SODA Drivers
- HP3par for Delfin
- NetApp NAS Fileshare driver support for Data ONTAP (CRUD)
-
SODA Experience
- Dashboard : Added support for Delfin | Collapsible Sidebar | Multicloud Fileshare for GCP | Multicloud AWS Block enhanced | Improved warning messages | Bug Fixes | UX improvements
- Installer : NetApp NAS Backend Installation | CentOS support | Delfin Performance | Delfin-Multicloud coexist fix
- Documentation: pdf embedding for easy reading | fixes and improvements | Documentation for new features | Quick start guide updated
-
Examples / Use case Demos
-
Quality Improvements
- CI improvements : CI with code coverage for Multicloud(55% code coverage reached) | Static Code Check for Delfin CI
- More tests / UT
Notes:
a) Delfin performance monitoring framework is a beta feature and PoC has been done with Prometheus and Kafka exporters
b) Old telemetry feature has been deprecated.
Find more details here CHANGELOG-v1.1.0
SODA Projects/Repos part of this release:
Key projects part of this SODA Release
SODA Framework Core Projects:
| Project | Release Link |
|---|---|
| delfin | delfin release v1.0.0 |
| api | api release v1.0.0 |
| controller | controller release v1.0.0 |
| dock | dock release v1.1.0 |
| nbp | nbp release v1.1.0 |
| multi-cloud | multicloud release v1.1.0 |
SODA Experience Projects
| Project | Release Link |
|---|---|
| installer | installer release v1.1.0 |
| dashboard | dashboard release v1.1.0 |
| examples | SODA Basic Integration with KubeEdge PoC; CSI Plug and Play ; Delfin with Prometheus/Kafka |
SODA Other Projects
| Project | Release Link |
|---|---|
| orchestration | orchestration release v0.12.0 |
| anomaly-detection | anomaly detection release v0.10.0 |
How to use the Release:
-
Quick installation from the release binaries: https://docs.sodafoundation.io/soda-gettingstarted/quickstart/
-
Configuration & Installation If you want more config control, you can follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/
Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.1.0 for Greenland Release)
SODA Documentation
Issues and Suggestions
Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues
For all other issues/suggestions, please raise to the respective project repositories.
SODA v1.0.1 Greenland Pre-Release
Version Summary
Version Number : v1.0.1 [tag: v1.0.1]
Version Name : Greenland Pre-Release
Date : 22-Sep-2020
Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples
Release Summary :
SODA Greenland Pre-Release is an incremental release on Faroe Release(v1.0.0) of SODA Foundation.
The earlier stable release Faroe, you can get here.
SODA Greenland will focus on providing heterogeneous framework for storage monitoring and management with enhanced features and drivers over the last release. (Greenland is the world's largest island located between the Arctic and Atlantic oceans and an autonomous territory (ref: wikipedia)).
Greenland: Together we can meet the challenge and grow to the best!
This is a pre-release for Greenland for testing/demo only
Changelog
This changelog is based on SODA release Faroe.
-
Overall
- The SODA releases repository has been renamed to github.com/sodafoundation/soda
(Earlier it was github.com/sodafoundation/releases. Old link will continue to work redirect to the new) - SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.
- The SODA releases repository has been renamed to github.com/sodafoundation/soda
-
Delfin : SODA Infrastructure Management
- Enhanced the resource and alert manamgent framework with new features and fixes.
- Overall : OpenAPI updated | SSH backend interface | Configurations for exporter | Removed plain text password caching
- Resource Management : Raw capacity | Subscribed Capacity | DB Model enhancements
- Alert Management : Clear Alert | Model and SNMP improvements | List Alerts | Query Alert
- Drivers : HP 3PAR StoreServ | SSL support | VMAX driver improvements
- Basic Performance Monitoring Framework : Register | Scheduler | Metrics Collection with Fake Driver | Exporter to Prometheus | PoC with Prometheus
Note : Delfin performance monitoring framework is under development and hence its release has been made from separately under a branch. Details in the project tables below
-
Multi Cloud
- Added Fileshare support for GCP Filestore (Create/Update/List/Get/Delete and Credential encryption support)
- New APIs for AWS Block Service (Update/Get/Delete)
- Data Persistence DB Sync for FileShare Create and Update APIs
- Create & List API enhancements AWS Block Service
- Bug Fixes
-
NBP: Enhance cloud native support - CSI Plug n Play
- Updated design alternatives for CSI plug and play
- New design based PoC with LVM and IBM drivers
-
SODA Drivers
- HP3par for Delfin
- NetApp NAS Fileshare driver support for Data ONTAP (CRUD)
-
SODA Experience
- Dashboard : Added support for Delfin | Collapsible Sidebar | Multicloud Fileshare for GCP | Multicloud AWS Block enhanced | Improved warning messages | Bug Fixes
- Installer : NetApp NAS Backend Installation | CentOS support | Delfin-Multicloud co exist fix
- Documentation: pdf embedding for easy reading | fixes and improvements | Documentation for new features
-
Examples / Use case Demos
-
Quality Improvements
- CI improvements : CI with code coverage for Multicloud(55% code coverage reached) | Static Code Check for Delfin CI
- More tests / UT
SODA Projects/Repos part of this release:
Key projects part of this SODA Release
SODA Framework Core Projects:
SODA Experience Projects
| Project | Release Link |
|---|---|
| installer | installer release v1.0.1 |
| dashboard | dashboard release v1.0.1 |
| examples | CSI Plug and Play ; Delfin with Prometheus |
SODA Other Projects
| Project | Release Link |
|---|---|
| orchestration | orchestration release v0.10.0 |
| anomaly-detection | anomaly detection release v0.10.0 |
How to use the Release:
Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.0.1)
SODA Documentation
Issues and Suggestions
Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues
For all other issues/suggestions, please raise to the respective project repositories.
SODA v1.0.0 Faroe Release
SODA Faroe Release
Version Summary
Version Number : v1.0.0 [tag: v1.0.0]
Version Name : Faroe
Date : 29-Jun-2020
Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection
Release Summary :
This is the first major version release “v1.0.0” of SODA Foundation. It is based on the earlier release Elba.
SODA Faroe focuses on simplifying management and telemetry across heterogeneous storage for cloud native and more. (Faroe is a group of self governing & beautiful islands within the Kingdom of Denmark).
Faroe : Together we can make the world better managed & more beautiful!
This overall release version has been upgraded to v1.0.0 and can be used for product trial integrations / solution development. Please check out the specific project versions when you integrate.
Changelog
This changelog is based on SODA release Elba.
-
Overall
- From Elba release onwards, the SODA Releases will be maintained by SODA Foundation at github.com/sodafoundation/releases
- SODA Releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases.
-
New Project Added : SODA Infrastructure Management [delfin]
- Unified Storage Resource Management and Telemetry Framework across heterogeneous backends:
- Provides resource monitoring and alarm handling
- Tested with
Dell EMC VMax3andHuawei OceanStor 18500
Note : Based on the availability of real storage backend, the support can be added to SODA Infrastructure Framework
-
Multi Cloud
- Alibaba Cloud Backend support added for OSS (Object Storage Service)
- Basic File Service API Support (AWS EFS, Azure File share)
- Basic Block Service API Support (AWS EBS)
- Bug fixes, API updates
-
Improved User Experience
- Dashboard Improvements: Added all Multi Cloud features; Help Tour and Help Doc sections are added; Main screen updated for SODA Foundation; Alibaba Cloud support added.
- Installer : Further simplified and modularised
-
SODA API Specifications
- Released draft v0.0.1 of SODA API Standards for Data and Storage (https://docs.sodafoundation.io/api-specs/)
- Block&File API Specification (on premise)
- SODA Infrastructure Manager API Specification (on premise)
- Multi Cloud API Specification(Object, Block and File)
-
CSI Plug & Play
- Experimental prototype of CSI plug and play
- This will help to explore further on the CSI plug and play to support single SODA CSI plugin and connect to all available CSI drivers.
-
Quality Improvements
- Project level and integration level testing and improvements
- API Test framework (experimental) added and multi-cloud tests added (https://github.com/sodafoundation/qa)
- Overall testing and coverage improved.
-
Documentations
- Layout and contents updated for docs.sodafoundation.io
- Documentations are updated for the migration from OpenSDS to SODA Foundation and project updates.
Projects/Repos part of this release:
Key projects part of this SODA Release
SODA Core Projects:
| Project | Release Link |
|---|---|
| delfin | delfin release v0.1.0 |
| api | api release v1.0.0 |
| controller | controller release v1.0.0 |
| dock | dock release v1.0.0 |
| nbp | nbp release v1.0.0 |
| multi-cloud | multicloud release v1.0.0 |
SODA Other Projects
| Project | Release Link |
|---|---|
| orchestration | orchestration release v0.10.0 |
| anomaly-detection | anomaly detection release v0.10.0 |
| installer | installer release v1.0.0 |
| dashboard | dashboard release v1.0.0 |
How to use the Release:
-
Quick installation from the release binaries: https://docs.sodafoundation.io/soda-gettingstarted/quickstart/#install-soda-v1-0-0-faroe-release-jun-2020
-
Configuration & Installation If you want more config control, you can follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/
Important Note for Dashboard
Please edit the Dashboard configuration fileansible/group_vars/dashboard.yml.
Search for the line withdashboard_docker_image
Replace the existing with the following line:sodafoundation/dashboard:latest dashboard_docker_image: sodafoundation/dashboard:{{ release_version }}
Master version may not be backward compatible, as dashboard will be updated with new features supported from the backend. Else all projects to be taken from the master
SODA Documentation
Issues and Suggestions
Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/releases/issues
For all other issues/suggestions, please raise to the respective project repositories.
SODA v0.20.0 Elba Release
SODA Elba Release
Version Summary
Version Number : v0.20.0 [tag: v0.20.0]
Version Name : Elba
Date : 13-April-2020
Projects / Repos Included : api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection
Release Summary :
This is the first release after the OpenSDS project transformed as The SODA Foundation. However currently we continue the release naming alphabetically based on island names:). So this is a ‘E’ release and named as “Elba” (island in Italy and symbolically representing our solidarity to the global fight against covid-19 virus)
This is a SODA Release comprising the corresponding projects or repositories of SODA Landscape.
All the SODA Releases will be made from github.com/sodafoundation/releases from now onwards. As per the current plan, we will be starting our quarterly releases starting from Elba release.
This release is mainly based on the Daito release from OpenSDS projects. There are some project/repository reorganizations, updates on certain projects along with some quality improvements. There are no big feature enhancements in this release.
This release version number 0.20.x has been selected to indicate the beginning of SODA releases (also disconnect from OpenSDS release sequence) . Each project will follow its own release version numbering, tags, names etc. SODA Release will mention the list and links of all the projects considered within the specific release.
We plan to have the major release of SODA in 2020. (v1.0.0)
Changelog
This changelog is based on OpenSDS release Daito.
-
Overall
-
All the projects under this release are SODA Core projects maintained
under github.com/sodafoundation. They are all migrated from
github.com/opensds -
SODA Releases will be maintained by SODA Foundation Community
directly and the releases are from github.com/sodafoundation/releases -
SODA Releases will provide the key use cases, integrations and overall solution based on SODA Landscape projects. It will give all
the respective project releases under the scope of each of the SODA
releases.
-
-
OpenSDS Project Reorganization
-
Earlier github.com/opensds/opensds project which was known as hotpot, was managing the on-prem data management connecting platforms on the north side and storage backends on the south side. This project has been decoupled into Three Different projects/repositories - api, controller and dock. Please see the readme of each project for more details.
(github.com/opensds/opensds has been migrated to github.com/sodafoundation/opensds and this project has been decoupled to github.com/sodafoundation/api , github.com/sodafoundation/controller and github.com/sodafoundation/dock)
-
api : Decoupled to handle the SODA API interface. This will contain the API server and api services going forward. Currently, all the APIs which were working earlier in Daito releases are decoupled and tested.
-
controller: Decoupled to handle all the control services (like metadata management, scheduler, other bookkeeping, utils etc)
-
dock: Decoupled to handle all the heterogeneous storage driver interfaces and related modules.
-
Currently the decoupled projects are verified for all the basic APIs (from api→ controller → dock) from Kubernetes, Dashboard and CLI
-
Telemetry feature is unchanged
-
-
MultiCloud
-
YIG Integration has been further optimized
-
S3 compatibility for APIs
-
SSE support improved
-
Multiple Bug Fixes.
-
-
nbp:
-
multiple fixes in CSI as well as VMWare plugin for feature stability and performance improvement.
-
Unit tests for Vmware NBP
-
-
Installer
-
Updated to handle the project migration & project decoupling
-
Optimization and bug fixes
-
-
Quality Improvements
-
Specific test cycles on various projects to improve the quality
-
api/controller/dock - Input validation of APIs; Improved Swagger API spec; Improved CLI help and more flags added for better usability; Multiple Initiator support from connector side ; Support secure connection between etcd and api/controller; Handle batch volume operations; Avoid redundant pool and dock while provisioning; No fstab modification required while mount/un-mount the FS
-
-
CSI Plug & Play
- To support the CSI Standard drivers, the initial design has been prepared. Please refer here. We will be implementing the same in the coming releases. If you want to join this work, please join the soda slack and ask in the ‘general’ channel.
-
Documentations
- Documentations are updated for the migration from OpenSDS to SODA Foundation and projects updates.
Known Issue:
Multicloud s3 compatible API integration with dashboard has a signature mismatch issue. Hence, the dashboard in this release cannot support the latest multicloud with s3 compatible APIs. Hence, the latest multicloud cannot be experienced from the Dashboard for multicloud object operations.
1. Options to use the latest multicloud from elba:
-
There is no limitation on the usage of mulicloud using any other client through which s3 compatible apis can be accessed
-
We have provided a postman based demo setup information for a reference and experience the latest multicloud with s3 compatible APIs here
2. If you want to use elba release with previous version of multicloud without s3 compatible api support (to experience the features through dashboard)
-
Edit configuration file for multicloud (gelato.yml) from the
installer repo
https://github.com/sodafoundation/installer/blob/master/ansible/group_vars/gelato.yml -
Update gelato_image_tag: “v0.10.0”
-
Follow the build steps from docs.sodafoundation.io
Use cases/Demo/Integrations in this release
-
Streaming Usecase Demo
- Added streaming use case demo using the multicloud project
- To check out this demo and how to use etc, all the details here.
-
Features in Dashboard
- The Dashboard provides all the basic features supported by api, controller, dock end 2 end, features of multicloud(Daito), features of telemetry, features of orchestration etc.
Projects/Repos part of this release:
Key projects part of this SODA Release
SODA Core Projects:
SODA Native Projects:
Projects are under review. Will be added from next release. If you want to submit your project to SODA Foundation to leverage better branding, networking, users, testing and enhance the community OR you want to know more about it, please mail to [email protected]
Other Projects/Repos:
| Project | Release Link |
|---|---|
| installer | installer release v0.12.0 |
| dashboard | dashboard release v0.10.0 |
| documentation | documentation release v0.12.0 |
How to use the Release:
- This release has been verified on Ubuntu 16.04LTS (Recommended)
Quick Test using Release Binaries
- Pre-requisite packages (If these packages are already available, you could skip the repective ones. Running may not harm anyways)
- ATTN: Need to be root to complete the installation; The the v...