Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Production Helm Migration TGB Enabled #3208

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Production Helm Migration TGB Enabled #3208

wants to merge 2 commits into from

Conversation

P0NDER0SA
Copy link
Contributor

@P0NDER0SA P0NDER0SA commented Dec 17, 2024 •
edited
Loading

What happens when your PR merges?

Our migration for Notify API, Admin, Doc Download, Documentation and Celery are fully migrated off of Kustomize and onto Helmfile, and deployed on production.

What are you changing?

  • Changing our deployments to use Helmfile rather than Kustomize on Production for the above components

Provide some background on the changes

TBD

Checklist if making changes to Kubernetes

  • I know how to get kubectl credentials in case it catches on fire

After merging this PR

  • I have verified that the tests / deployment actions succeeded
  • I have verified that any affected pods were restarted successfully
  • I have verified that I can still log into Notify production
  • I have verified that the smoke tests still pass on production
  • I have communicated the release in the #notify Slack channel.

@P0NDER0SA P0NDER0SA marked this pull request as ready for review December 17, 2024 13:53
@github-actions GitHub Actions
Copy link

github-actions bot commented Dec 17, 2024 •
edited
Loading 

ingress	nginx    	17      	2024-12-17 20:32:03.509529501 +0000 UTC	deployed	nginx-ingress-1.1.2	3.4.2      

xray-daemon	xray     	16      	2024-12-17 20:32:02.228304849 +0000 UTC	deployed	aws-xray-4.0.8	3.3.12     

Comparing release=notify-documentation, chart=charts/notify-documentation
Comparing release=notify-api, chart=charts/notify-api
Comparing release=notify-admin, chart=charts/notify-admin
Comparing release=notify-document-download, chart=charts/notify-document-download
Comparing release=notify-celery, chart=charts/notify-celery
notification-canada-ca, notify-celery-beat, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment-beat.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-beat
    name: notify-celery-beat
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-beat
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-beat
      spec:
        nodeSelector: 
          eks.amazonaws.com/capacityType: ON_DEMAND
        serviceAccountName: notify-celery
        priorityClassName: 
        initContainers:
          - name: init-postgres
            image: alpine
            command:
              [
                "sh",
                "-c",
                "until nslookup $(POSTGRES_HOST); do echo waiting for postgres; sleep 2; done;",
              ]
            env:  
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
        containers:
          - image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            name: notify-celery-beat
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-beat-dev
+               value: notification-celery-beat-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_beat.sh"]
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 30
  status: {}
notification-canada-ca, notify-celery-email-send-primary, Deployment (apps) has changed:
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-email-send-primary
    name:  notify-celery-email-send-primary
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-email-send-primary
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-email-send-primary
      spec:
        nodeSelector: 
          eks.amazonaws.com/capacityType: ON_DEMAND
        serviceAccountName: notify-celery
        priorityClassName: high-priority
        initContainers:
        - name: wait-cwagent-ready
          env:
            - name: STATSD_HOST
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          image: "public.ecr.aws/cds-snc/notify-api:latest"
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh"]
          args: ["-c", "sh /app/scripts/cwcheck.sh"]
        containers:
          - name: notify-celery-email-send-primary
            image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-email-send-primary-dev
+               value: notification-celery-email-send-primary-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            lifecycle:
              preStop:
                exec:
                  command:
                  - /bin/bash
                  - -c
                  - /app/scripts/run_celery_exit.sh
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_send_email.sh"]
            resources:
              requests:
                cpu: 100m
                memory: 500Mi
              limits:
                cpu: 550m
                memory: 1024Mi
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}
notification-canada-ca, notify-celery-email-send-scalable, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-email-send-scalable
    name:  notify-celery-email-send-scalable
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-email-send-scalable
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-email-send-scalable
      spec:
        nodeSelector: 
          karpenter.sh/capacity-type: spot
        serviceAccountName: notify-celery
        priorityClassName: celery
        initContainers:
        - name: wait-cwagent-ready
          env:
            - name: STATSD_HOST
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          image: "public.ecr.aws/cds-snc/notify-api:latest"
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh"]
          args: ["-c", "sh /app/scripts/cwcheck.sh"]
        containers:
          - name: notify-celery-email-send-scalable
            image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-email-send-scalable-dev
+               value: notification-celery-email-send-scalable-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            lifecycle:
              preStop:
                exec:
                  command:
                  - /bin/bash
                  - -c
                  - /app/scripts/run_celery_exit.sh
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_send_email.sh"]
            resources:
              requests:
                cpu: 100m
                memory: 500Mi
              limits:
                cpu: 550m
                memory: 1024Mi
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}
notification-canada-ca, notify-celery-primary, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-primary
    name:  notify-celery-primary
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-primary
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-primary
      spec:
        nodeSelector: 
          eks.amazonaws.com/capacityType: ON_DEMAND
        serviceAccountName: notify-celery
        priorityClassName: high-priority
        initContainers:
        - name: wait-cwagent-ready
          env:
            - name: STATSD_HOST
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          image: "public.ecr.aws/cds-snc/notify-api:latest"
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh"]
          args: ["-c", "sh /app/scripts/cwcheck.sh"]
        containers:
          - name: notify-celery-primary
            image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-main-primary-dev
+               value: notification-celery-main-primary-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            lifecycle:
              preStop:
                exec:
                  command:
                  - /bin/bash
                  - -c
                  - /app/scripts/run_celery_exit.sh
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_core_tasks.sh"]
            resources:
              requests:
                cpu: 100m
                memory: 500Mi
              limits:
                cpu: 550m
                memory: 1024Mi
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}
notification-canada-ca, notify-celery-scalable, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-scalable
    name:  notify-celery-scalable
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-scalable
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-scalable
      spec:
        nodeSelector: 
          karpenter.sh/capacity-type: spot
        serviceAccountName: notify-celery
        priorityClassName: celery
        initContainers:
        - name: wait-cwagent-ready
          env:
            - name: STATSD_HOST
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          image: "public.ecr.aws/cds-snc/notify-api:latest"
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh"]
          args: ["-c", "sh /app/scripts/cwcheck.sh"]
        containers:
          - name: notify-celery-scalable
            image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-main-scalable-dev
+               value: notification-celery-main-scalable-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            lifecycle:
              preStop:
                exec:
                  command:
                  - /bin/bash
                  - -c
                  - /app/scripts/run_celery_exit.sh
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_core_tasks.sh"]
            resources:
              requests:
                cpu: 100m
                memory: 500Mi
              limits:
                cpu: 550m
                memory: 1024Mi
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}
notification-canada-ca, notify-celery-sms, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment-beat.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-sms
    name: notify-celery-sms
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-sms
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-sms
      spec:
        nodeSelector: 
          eks.amazonaws.com/capacityType: ON_DEMAND
        serviceAccountName: notify-celery
        priorityClassName: 
        initContainers:
          - name: init-postgres
            image: alpine
            command:
              [
                "sh",
                "-c",
                "until nslookup $(POSTGRES_HOST); do echo waiting for postgres; sleep 2; done;",
              ]
            env:  
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
        containers:
          - image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            name: notify-celery-sms
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-sms-dev
+               value: notification-celery-sms-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_beat.sh"]
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}
notification-canada-ca, notify-celery-sms-send-primary, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-sms-send-primary
    name:  notify-celery-sms-send-primary
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-sms-send-primary
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-sms-send-primary
      spec:
        nodeSelector: 
          eks.amazonaws.com/capacityType: ON_DEMAND
        serviceAccountName: notify-celery
        priorityClassName: high-priority
        initContainers:
        - name: wait-cwagent-ready
          env:
            - name: STATSD_HOST
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          image: "public.ecr.aws/cds-snc/notify-api:latest"
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh"]
          args: ["-c", "sh /app/scripts/cwcheck.sh"]
        containers:
          - name: notify-celery-sms-send-primary
            image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-sms-send-primary-dev
+               value: notification-celery-sms-send-primary-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            lifecycle:
              preStop:
                exec:
                  command:
                  - /bin/bash
                  - -c
                  - /app/scripts/run_celery_exit.sh
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_send_sms.sh"]
            resources:
              requests:
                cpu: 100m
                memory: 500Mi
              limits:
                cpu: 550m
                memory: 1024Mi
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}
notification-canada-ca, notify-celery-sms-send-scalable, Deployment (apps) has changed:
  # Source: notify-celery/templates/deployment.yaml
  apiVersion: apps/v1
  kind: Deployment
  metadata:
    labels:
      app: notify-celery-sms-send-scalable
    name:  notify-celery-sms-send-scalable
    namespace: notification-canada-ca
  spec:
    replicas: 3
    revisionHistoryLimit: 5
    selector:
      matchLabels:
        app: notify-celery-sms-send-scalable
    strategy:
      rollingUpdate:
        maxSurge: 25%
        maxUnavailable: 25%
      type: RollingUpdate
    template:
      metadata:
        labels:
          app: notify-celery-sms-send-scalable
      spec:
        nodeSelector: 
          karpenter.sh/capacity-type: spot
        serviceAccountName: notify-celery
        priorityClassName: celery
        initContainers:
        - name: wait-cwagent-ready
          env:
            - name: STATSD_HOST
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          image: "public.ecr.aws/cds-snc/notify-api:latest"
          imagePullPolicy: IfNotPresent
          command: ["/bin/sh"]
          args: ["-c", "sh /app/scripts/cwcheck.sh"]
        containers:
          - name: notify-celery-sms-send-scalable
            image: "public.ecr.aws/cds-snc/notify-api:latest"
            imagePullPolicy: Always
            volumeMounts:
              - name: secrets-store-inline
                mountPath: "/mnt/secrets-store"
                readOnly: true  
            env:
              # Includes specific ENV Variables
              - name: NEW_RELIC_APP_NAME
-               value: notification-celery-sms-send-scalable-dev
+               value: notification-celery-sms-send-scalable-staging
              - name: STATSD_HOST
                valueFrom:
                  fieldRef:
                    fieldPath: spec.nodeName
              # Includes common ENV Variables
              - name: ADMIN_BASE_URL
                value: "https://staging.notification.cdssandbox.xyz"
              - name: ALLOW_HTML_SERVICE_IDS
                value: "4de8b784-03a8-4ba8-a440-3bfea1b04fe6,ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: API_HOST_NAME
                value: "https://api.staging.notification.cdssandbox.xyz"
              - name: ASSET_DOMAIN
                value: "https://assets.staging.notification.cdssandbox.xyz"
              - name: ASSET_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-asset-upload"
              - name: AWS_PINPOINT_REGION
                value: "us-west-2"
              - name: AWS_REGION
                value: "ca-central-1"
              - name: AWS_US_TOLL_FREE_NUMBER
                value: "+18449521252"
              - name: AWS_XRAY_CONTEXT_MISSING
                value: "LOG_WARNING"
              - name: AWS_XRAY_DAEMON_ADDRESS
                value: "xray-daemon-aws-xray.xray.svc.cluster.local:2000"
              - name: AWS_XRAY_SDK_ENABLED
                value: "true"
              - name: BATCH_INSERTION_CHUNK_SIZE
                value: "10"
              - name: BULK_SEND_TEST_SERVICE_ID
                value: "ea608120-148a-4eba-a64c-4d9a8010e7b0"
              - name: CELERY_CONCURRENCY
                value: "4"
              - name: CSV_UPLOAD_BUCKET_NAME
                value: "notification-canada-ca-staging-csv-upload"
              - name: DOCUMENT_DOWNLOAD_API_HOST
                value: "http://notify-document-download.notification-canada-ca.svc.cluster.local:7000"
              - name: FF_ANNUAL_LIMIT
                value: "false"
              - name: FF_CLOUDWATCH_METRICS_ENABLED
                value: "True"
              - name: FIDO2_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: HC_EN_SERVICE_ID
                value: "c2fe9fac-2f28-40ca-b152-08ee41cd6843"
              - name: HC_FR_SERVICE_ID
                value: "changeme"
              - name: NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
                value: "true"
              - name: NEW_RELIC_MONITOR_MODE
                value: "true"
              - name: NOTIFICATION_QUEUE_PREFIX
                value: "eks-notification-canada-ca"
              - name: NOTIFY_EMAIL_DOMAIN
                value: "staging.notification.cdssandbox.xyz"
              - name: NOTIFY_ENVIRONMENT
                value: "staging"
              - name: REDIS_ENABLED
                value: "true"
              - name: SENTRY_URL
                value: "https://[email protected]/1522933"
              - name: env
                value: "staging"
              # Includes secret ENV Variables
              - name: ADMIN_CLIENT_SECRET
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: ADMIN_CLIENT_SECRET
              - name: DANGEROUS_SALT
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: DANGEROUS_SALT
              - name: NEW_RELIC_LICENSE_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: NEW_RELIC_LICENSE_KEY
              - name: POSTGRES_HOST
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: POSTGRES_HOST
              - name: REDIS_PUBLISH_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_PUBLISH_URL
              - name: REDIS_URL
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: REDIS_URL
              - name: SECRET_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SECRET_KEY
              - name: SENDGRID_API_KEY
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SENDGRID_API_KEY
              - name: SQLALCHEMY_DATABASE_READER_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_READER_URI
              - name: SQLALCHEMY_DATABASE_URI
                valueFrom:
                  secretKeyRef:
                    name: notify-celery
                    key: SQLALCHEMY_DATABASE_URI
            lifecycle:
              preStop:
                exec:
                  command:
                  - /bin/bash
                  - -c
                  - /app/scripts/run_celery_exit.sh
            command: ["/bin/sh"]
            args: ["-c", "sh /app/scripts/run_celery_send_sms.sh"]
            resources:
              requests:
                cpu: 100m
                memory: 500Mi
              limits:
                cpu: 550m
                memory: 1024Mi
            
        volumes:
          - name: secrets-store-inline
            csi:
              driver: secrets-store.csi.k8s.io
              readOnly: true
              volumeAttributes:
                secretProviderClass: notify-celery
           
        dnsPolicy: ClusterFirst
        restartPolicy: Always
        schedulerName: default-scheduler
        securityContext: {}
        terminationGracePeriodSeconds: 60
  status: {}

Comparing release=k8s-event-logger, chart=/tmp/helmfile1167406145/amazon-cloudwatch/staging/k8s-event-logger/k8s-event-logger/1.1.8/k8s-event-logger
Comparing release=karpenter-crd, chart=/tmp/helmfile1167406145/karpenter/staging/karpenter-crd/karpenter-crd/0.36.1/karpenter-crd
Comparing release=karpenter, chart=/tmp/helmfile1167406145/karpenter/staging/karpenter/karpenter/0.36.1/karpenter
Comparing release=karpenter-nodepool, chart=charts/karpenter-nodepool
Comparing release=priority-classes, chart=deliveryhero/priority-class
Comparing release=secrets-store-csi-driver, chart=secrets-store-csi-driver/secrets-store-csi-driver
Comparing release=aws-secrets-provider, chart=aws-secrets-manager/secrets-store-csi-driver-provider-aws
Comparing release=kube-state-metrics, chart=prometheus-community/kube-state-metrics
Comparing release=blazer, chart=stakater/application
Comparing release=ingress, chart=charts/nginx-ingress
Comparing release=xray-daemon, chart=okgolove/aws-xray

@P0NDER0SA P0NDER0SA mentioned this pull request Dec 17, 2024
Open
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jimleroyer jimleroyer Awaiting requested review from jimleroyer jimleroyer is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@P0NDER0SA