DataDog scaler creates pods but with Terminating status

[raviumishra]

`apiVersion: keda.sh/v1alpha1
kind: ScaledObject
metadata:
name: datadog-scaledobject
namespace: dev-keda-test-ns
spec:
scaleTargetRef:
name: keda-test
minReplicaCount: 1
maxReplicaCount: 3
triggers:

• type: datadog
  metadata:
  query: "sum:nginx.net.request_per_s{*}"
  queryValue: "36"
  authenticationRef:
  name: datadog-trigger-auth
  `
  this scales KEDA but pods are spun with Terminating status
  
  

[arapulido]

Hello @raviumishra. The Datadog scaler or KEDA do not scale the object, HPA does. If a pod is Terminating, is something transitional. A pod will either be created and running, or teminated (if the value is below your target, as it seems it is).

[raviumishra]

Hello @arapulido. I have changed my target value for scaling up as 16 nginx.net.request_per_s. Attached is the historical metric data and also the snapshot shows that at any point of time the metric is above 16. Still the pods are being spun up with Terminating status.

nginx_req_s.csv

[arapulido]

Hello! KEDA nor Datadog Scaler perform the actual creation of the pods, the ReplicaSet controller does.

to debug this, I would recommend you to kubectl describe both the ReplicaSet, and the terminating pods

[raviumishra]

@arapulido

The pods are created with Terminating status -- meaning they just appear and disappear very quickly. Not getting a window to describe them.

clip.mp4

[arapulido]

Can you also describe the HPA object?

[raviumishra]

@arapulido

[arapulido]

Can you ensure the screenshots show all events? Also, it would be useful to describe the Deployment object as well.

[raviumishra]

@arapulido Yes, all events are captured in these screenshots.

[arapulido]

Without having access to your environment it is going to be difficult for me to know what's going on. This requires live debugging. Either KEDA is scaling up and down, or something else. Without access to your logs, I am afraid I am not able to help

[raviumishra]

@arapulido Is there a way we can connect for this OR can you pls give me some debugging steps ?

[zroubalik]

I am happy to help, let's connect.