Skip to content

Commit

Permalink
Merge pull request #3782 from zowe/user/markackert/v1-staging-to-rc
Browse files Browse the repository at this point in the history
User/markackert/v1 staging to rc
  • Loading branch information
MarkAckert authored Mar 28, 2024
2 parents 7c8279b + 25b5821 commit e883d42
Show file tree
Hide file tree
Showing 42 changed files with 369 additions and 270 deletions.
9 changes: 5 additions & 4 deletions .github/scripts/cicd_test/make_matrix.sh
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,7 @@ case $install_test_choice in
;;

"Zowe Release Tests")
test_file="$ZOWE_RELEAE_TESTS_FULL"
test_file="$ZOWE_RELEASE_TESTS_FULL"
dont_parse_test_server=true
;;

Expand All @@ -78,17 +78,18 @@ esac

if [[ -z "$dont_parse_test_server" ]]; then
if [[ "$test_server" == "Any zzow servers" ]]; then
test_server="zzow0"$(echo $(($RANDOM % 3 + 2)))
test_server="zzow0"$(echo $(($RANDOM % 3 + 6)))
fi
TEST_FILE_SERVER="$test_file($test_server)"
else
any_occurrence=$(echo $test_file | grep -o "(any)" | wc -l)
interim_test_file_server=$test_file
for i in $(seq $any_occurrence); do
interim_test_file_server=$(echo $interim_test_file_server | sed "s#(any)#(zzow0$(echo $(($RANDOM % 3 + 2))))#")
interim_test_file_server=$(echo $interim_test_file_server | sed "s#(any)#(zzow0$(echo $(($RANDOM % 3 + 6))))#")
done

TEST_FILE_SERVER=$(echo $interim_test_file_server | sed "s#(all)#(zzow02,zzow03,zzow04)#g")
TEST_FILE_SERVER=$(echo $interim_test_file_server | sed "s#(all)#(zzow06,zzow07,zzow08)#g")

fi

# this is the final string that can be recognizable by the matrix processing script down below
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,24 +14,24 @@ TEST_SERVER=$(echo "$MATRIX_SERVER" | cut -d "-" -f2)

case $TEST_SERVER in

"zzow02")
TEST_SERVER_NICKNAME=marist-2
;;
"zzow06")
TEST_SERVER_NICKNAME=marist-6
;;

"zzow03")
TEST_SERVER_NICKNAME=marist-3
;;
"zzow07")
TEST_SERVER_NICKNAME=marist-7
;;

"zzow04")
TEST_SERVER_NICKNAME=marist-4
;;
"zzow08")
TEST_SERVER_NICKNAME=marist-8
;;

*)
printf "${RED}[Check 2 ERROR] Something went wrong when parsing test server nickname\n"
exit 1
;;
printf "${RED}[Check 2 ERROR] Something went wrong when parsing test server nickname\n"
exit 1
;;
esac

assert_env_var "TEST_SERVER"
assert_env_var "TEST_SERVER_NICKNAME"
printf "${GREEN}[Check 2/$TOTAL_CHECK] Test server name processing complete!${NC}\n"
printf "${GREEN}[Check 2/$TOTAL_CHECK] Test server name processing complete!${NC}\n"
3 changes: 2 additions & 1 deletion .github/workflows/build-packaging.yml
Original file line number Diff line number Diff line change
Expand Up @@ -264,7 +264,7 @@ jobs:
with:
lock-repository: ${{ github.repository }}
github-token: ${{ secrets.GITHUB_TOKEN }}
lock-resource-name: zowe-psi-build-zzow03-lock
lock-resource-name: zowe-psi-build-zzow07-lock
lock-avg-retry-interval: 60

- name: '[SMPE Pax 4] Build PSWI'
Expand All @@ -277,6 +277,7 @@ jobs:
env:
ZOSMF_USER: ${{ secrets.ZOWE_PSWI_BUILD_USR }}
ZOSMF_PASS: ${{ secrets.ZOWE_PSWI_BUILD_PASSWD }}
ZZOW_SSH_PORT: ${{ secrets.SSH_MARIST_ALLSYS_PORT }}
VERSION: ${{ env.P_VERSION }}

- name: '[TP_DOCKER] Copy zowe.pax to prepare for building Docker images'
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/cicd-test-readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@ This guide will describe how you should input into Github Actions workflow input

Currently we support three testing z/OS servers:

- zzow02 (ACF2)
- zzow03 (Top Secret/TSS)
- zzow04 (RACF)
- zzow06 (ACF2)
- zzow07 (Top Secret/TSS)
- zzow08 (RACF)

Testing pipeline is running tests in parallel. The workflow will try to acquire the resource lock if available. If the resource lock is occupied, the workflow will wait until the lock is succesfully acquired.

Expand All @@ -17,7 +17,7 @@ Workflow trigger is at [cicd-test](https://github.com/zowe/zowe-install-packagin
### Choose Test Server

- This input is a choice, and it's mandatory.
- You can choose from one of `zzow02`, `zzow03`, `zzow04`, `zzow02,zzow03,zzow04` (if you want to run the test on all zzow servers), or `Any zzow servers` (pick any zzow servers, potentially help reduce wait time)
- You can choose from one of `zzow06`, `zzow07`, `zzow08`, `zzow06,zzow07,zzow08` (if you want to run the test on all zzow servers), or `Any zzow servers` (pick any zzow servers, potentially help reduce wait time)
- Default is `Any zzow servers`

### Choose Install Test
Expand Down Expand Up @@ -120,7 +120,7 @@ Background: CICD testing relies on a `zowe.pax` or `zowe-smpe.zip` (for SMPE ins
When running CICD integration tests during RC stage, the following string will be parsed into the Github Actions matrix. As a result, a total of 19 independent jobs will be spawned.
```
basic/install.ts(zzow02,zzow03,zzow04);basic/install-ptf.ts(zzow02,zzow03,zzow04);basic/install-docker.ts(zzow04);basic/install-ext.ts(zzow03);extended/keyring.ts(zzow02,zzow03,zzow04);extended/node-versions/node-v16.ts(zzow02,zzow03,zzow04);extended/certificates/nonstrict-verify-external-certificate.ts(zzow02);extended/caching-storages/infinispan-storage.ts
basic/install.ts(zzow06,zzow07,zzow08);basic/install-ptf.ts(zzow06,zzow07,zzow08);basic/install-docker.ts(zzow08);basic/install-ext.ts(zzow07);extended/keyring.ts(zzow06,zzow07,zzow08);extended/node-versions/node-v16.ts(zzow06,zzow07,zzow08);extended/certificates/nonstrict-verify-external-certificate.ts(zzow06);extended/caching-storages/infinispan-storage.ts
```
Total elapsed time when running in parallel is approximately 3.5 hours on paper idealy if all parallel jobs are executing at the same time. In reality, from numerous tests performed, total elapsed time is around 4 hours.
Expand Down
18 changes: 9 additions & 9 deletions .github/workflows/cicd-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,10 +9,10 @@ on:
default: 'Any zzow servers'
options:
- Any zzow servers
- zzow02
- zzow03
- zzow04
- zzow02,zzow03,zzow04
- zzow06
- zzow07
- zzow08
- zzow06,zzow07,zzow08
install-test:
description: 'Choose Install Test'
type: choice
Expand Down Expand Up @@ -60,8 +60,8 @@ env:
DEFAULT_ZOWE_EXT_ARTIFACTORY_PATTERN: libs-snapshot-local/org/zowe/{ext-name}/*/{ext-name}-*.pax

# can be overwritten, adjusted by DevOps only
ZOS_NODE_VERSION: v14.21.3
# ZOS_NODE_VERSION more to choose from: v14.21.3, v16.19.1
ZOS_NODE_VERSION: v16.20.2
# ZOS_NODE_VERSION more to choose from: v16.20.2
CLIENT_NODE_VERSION: v12.18.3
INSTALL_TEST_DEBUG_INFORMATION: zowe-install-test:*
SANITY_TEST_DEBUG_INFORMATION: zowe-sanity-test:*
Expand All @@ -79,8 +79,8 @@ env:
VSAM_CACHING_STORAGE_METHOD_TESTFILE: extended/caching-storages/vsam-storage.ts
INFINISPAN_CACHING_STORAGE_METHOD_TESTFILE: extended/caching-storages/infinispan-storage.ts
GENERAL_API_DOCUMENTATION_TESTFILE: basic/install-api-gen.ts
ZOWE_RELEAE_TESTS_FULL: basic/install.ts(all);basic/install-ptf.ts(all);basic/install-docker.ts(any);basic/install-ext.ts(any);extended/keyring.ts(all);extended/node-versions/node-v16.ts(any);extended/certificates/nonstrict-verify-external-certificate.ts(any);extended/caching-storages/infinispan-storage.ts(any)
ZOWE_NIGHTLY_TESTS_FULL: basic/install.ts(all);basic/install-ptf.ts(all);basic/install-docker.ts(any)
ZOWE_NIGHTLY_TESTS_FULL: basic/install.ts(all);basic/install-ptf.ts(all)
ZOWE_RELEASE_TESTS_FULL: basic/install.ts(all);basic/install-ptf.ts(all);basic/install-ext.ts(any);extended/keyring.ts(all);extended/node-versions/node-v16.ts(any):extended/certificates/nonstrict-verify-external-certificate.ts(any);extended/caching-storages/infinispan-storage.ts(any)

jobs:
display-dispatch-event-id:
Expand Down Expand Up @@ -132,7 +132,7 @@ jobs:
- name: '[Prep 2] Setup Node'
uses: actions/setup-node@v3
with:
node-version: '14'
node-version: '18'

- name: '[Prep 3] Cache node modules'
uses: actions/cache@v2
Expand Down
2 changes: 1 addition & 1 deletion .pax/pre-packaging.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ set -x
# ./content/zowe-${ZOWE_VERSION}/

# use node v14 to build
export NODE_HOME=/ZOWE/node/node-v14.21.3-os390-s390x
export NODE_HOME=/ZOWE/node/node-v16.20.2-os390-s390x

# ---------------------------------------------------------------------
# --- create JCL files
Expand Down
1 change: 0 additions & 1 deletion bin/apiml_cm.sh
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,6 @@
# IBM Java keytool documentation:
# https://www.ibm.com/support/knowledgecenter/en/SSYKE2_8.0.0/com.ibm.java.security.component.80.doc/security-component/keytoolDocs/keytool_overview.html
#

BASE_DIR=$(dirname "$0")
PARAMS="$@"
PWD=`pwd`
Expand Down
3 changes: 1 addition & 2 deletions bin/zowe-init.sh
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,6 @@

# This script checks to see whether they are set, and if not tries to locate them,
# and if they can't be found prompt for them before setting them

echo "<zowe-init.sh>" >> $LOG_FILE

# process input parameters.
Expand Down Expand Up @@ -167,7 +166,7 @@ then
rc=$?
if [[ -n "$hn" && $rc -eq 0 ]]
then
ZOWE_IP_ADDRESS=`$ping_bin -A ipv4 $hn|sed -n 's/.* (\(.*\)).*/\1/p'`
ZOWE_IP_ADDRESS=`$ping_bin -A ipv4 $hn|sed -n '1 s/.* (\(.*\)).*/\1/p'`
if [[ ! -n "$ZOWE_IP_ADDRESS" ]]
then
echo Error: $ping_bin $hn command failed to find IP
Expand Down
1 change: 0 additions & 1 deletion bin/zowe-setup-certificates.sh
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,6 @@
# - COMPONENT_LEVEL_CERTIFICATES - optional - if you want to generate dedicated certificates for certain components.
# - EXTERNAL_COMPONENT_CERTIFICATES - optional - external certificates for each of components listed in COMPONENT_LEVEL_CERTIFICATES
# - EXTERNAL_COMPONENT_CERTIFICATE_ALIASES - optional - external certificate aliases for each of components listed in COMPONENT_LEVEL_CERTIFICATES

function detectExternalCAs {
echo "Detecting external CAs ... STARTED"
EXTERNAL_ROOT_CA=
Expand Down
Loading

0 comments on commit e883d42

Please sign in to comment.