Kafka Scaler with Azure EventHub using oauthbearer

[juliolopez-mx]

I'm having issues using the Kafka scaler with Azure EventHub. We use oauthbearer to authenticate to the EventHub.

I've configured the following TriggerAuthentication.
apiVersion: v1
kind: Secret
metadata:
name: keda-kafka-secrets
namespace: mynamespace
data:
oauthTokenEndpointUri: https://login.microsoftonline.com/my_tenant_id
sasl: oauthbearer
username: sp_id
password: sp_secret
scopes: https://my-eventhub.servicebus.windows.net/.default

apiVersion: keda.sh/v1alpha1
kind: TriggerAuthentication
metadata:
name: keda-trigger-auth-kafka-credential
namespace: mynamespace
spec:
secretTargetRef:

• parameter: sasl
  name: keda-kafka-secrets
  key: sasl
• parameter: username
  name: keda-kafka-secrets
  key: username
• parameter: password
  name: keda-kafka-secrets
  key: password
• parameter: oauthTokenEndpointUri
  name: keda-kafka-secrets
  key: oauthTokenEndpointUri
• parameter: scopes
  name: keda-kafka-secrets
  key: scopes

I'm using a ScaledJob with these triggers.
triggers:

• type: kafka
  metadata:
  bootstrapServers: my-eventhub.servicebus.windows.net:9093
  consumerGroup: myconsumergroup
  topic: mytopic
  lagThreshold: '1'
  activationLagThreshold: '1'
  offsetResetPolicy: earliest
  authenticationRef:
  name: keda-trigger-auth-kafka-credential

I get the following errors
ERROR scale_handler error resolving auth params {"type": "ScaledJob", "namespace": "mynamespace", "name": "kafka-scaledjob", "triggerIndex": 0, "error": "error creating kafka client: kafka: client has run out of available brokers to talk to: EOF"}

ERROR Error getting scalers {"controller": "scaledjob", "controllerGroup": "keda.sh", "controllerKind": "ScaledJob", "ScaledJob": {"name":"kafka-scaledjob","namespace":"mynamespace"}, "namespace": "mynamespace", "name": "kafka-scaledjob", "reconcileID": "dd40593d-4947-4317-8eac-94dbd2859b42", "error": "error creating kafka client: kafka: client has run out of available brokers to talk to: EOF"}

I'm using:

• KEDA version 2.13
• Azure Kubernetes version 1.27.9

I saw there is an AzureEventHub Scaler however, looking at the documentation I didn't see how to configure oauthbearer authentication. I see that it works with Pod Identity, which I don't have set up currently.

Any help would be appreciated.