Keda Jobs scaling not performing as expected #1708
Unanswered
vidyasagarreddyc
asked this question in
Q&A / Need Help
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am using KEDA with Azure service bus, but scaling is not performing as expected, I am expecting scale to 8 jobs but it is scaling 1 to 3 jobs and remaining in queue.
apiVersion: keda.sh/v1alpha1
kind: TriggerAuthentication
metadata:
name: trigger-auth-service-bus-orders
spec:
secretTargetRef:
name: secrets-order-management
key: servicebus-order-management-connectionstring
apiVersion: v1
kind: Secret
metadata:
name: secrets-order-management
labels:
app: order-processor
data:
servicebus-order-management-connectionstring: xxxxxxxxxxx
apiVersion: keda.sh/v1alpha1
kind: ScaledJob
metadata:
name: order-processor-scaler
spec:
jobTargetRef:
parallelism: 1
completions: 1
activeDeadlineSeconds: 6000
backoffLimit: 2
template:
spec:
containers:
- name: order-processor
image: docker.io/vsr/pythonimage:latest
env:
- name: KEDA_SERVICEBUS_QUEUE_NAME
value: sb_aks_queue
- name: servicebus-order-management-connectionstring
valueFrom:
secretKeyRef:
name: secrets-order-management
key: servicebus-order-management-connectionstring
pollingInterval: 30
maxReplicaCount: 8
successfulJobsHistoryLimit: 0
failedJobsHistoryLimit: 5
triggers:
metadata:
queueName: sb_aks_queue
queueLength: '10'
connectionFromEnv: servicebus-order-management-connectionstring
KEDA logs says 2 jobs running and 7 in queue length below is the logs and I set max replica count to 8, Not sure it is to replace same jobs or scale to 8 jobs, Basically I need to scale max jobs 8 numbers. Is my config is wrong?
2021-03-31T06:24:28.945Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of pending Jobs ": 0}
2021-03-31T06:24:58.960Z INFO scalehandler Active trigger {"Scaler": {}, "isTriggerActive": false}
2021-03-31T06:24:58.960Z INFO scalehandler Scaler targetAverageValue {"Scaler": {}, "targetAverageValue": 5}
2021-03-31T06:24:58.973Z INFO scalehandler QueueLength Metric value {"Scaler": {}, "queueLength": 0}
2021-03-31T06:24:58.973Z INFO scalehandler Scaler maxValue {"maxValue": 0}
2021-03-31T06:24:58.973Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of running Jobs": 0}
2021-03-31T06:24:58.973Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of pending Jobs ": 0}
2021-03-31T06:25:28.986Z INFO scalehandler Active trigger {"Scaler": {}, "isTriggerActive": false}
2021-03-31T06:25:28.986Z INFO scalehandler Scaler targetAverageValue {"Scaler": {}, "targetAverageValue": 5}
2021-03-31T06:25:29.001Z INFO scalehandler QueueLength Metric value {"Scaler": {}, "queueLength": 0}
2021-03-31T06:25:29.001Z INFO scalehandler Scaler maxValue {"maxValue": 0}
2021-03-31T06:25:29.001Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of running Jobs": 0}
2021-03-31T06:25:29.001Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of pending Jobs ": 0}
2021-03-31T06:25:59.015Z INFO scalehandler Active trigger {"Scaler": {}, "isTriggerActive": true}
2021-03-31T06:25:59.015Z INFO scalehandler Scaler targetAverageValue {"Scaler": {}, "targetAverageValue": 5}
2021-03-31T06:25:59.029Z INFO scalehandler QueueLength Metric value {"Scaler": {}, "queueLength": 7}
2021-03-31T06:25:59.029Z INFO scalehandler Scaler is active {"Scaler": {}}
2021-03-31T06:25:59.029Z INFO scalehandler Scaler maxValue {"maxValue": 2}
2021-03-31T06:25:59.029Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of running Jobs": 0}
2021-03-31T06:25:59.029Z INFO scaleexecutor Scaling Jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of pending Jobs ": 0}
2021-03-31T06:25:59.040Z INFO scaleexecutor Creating jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Effective number of max jobs": 2}
2021-03-31T06:25:59.041Z INFO scaleexecutor Creating jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of jobs": 2}
2021-03-31T06:25:59.086Z INFO scaleexecutor Created jobs {"scaledJob.Name": "order-processor-scaler", "scaledJob.Namespace": "jobs", "Number of jobs": 2}
Beta Was this translation helpful? Give feedback.
All reactions