Can i use message queue kafka along with async mode: eventlet?

[xiaol]

Sorry ,i am confusing here with the async mode and async server? according the python socketio doc, kafka is not supported in async server.So the answer to this question is no? am i right?

should i change to redis, cuz my pipeline basicly has built on kafka.

[xiaol]

if i run with this config, the server just hang in there ,wait for kafka producer to connect forever.

[xiaol]

Can i just do this?

import socketio
from kafka import KafkaConsumer, KafkaProducer
import json

sio = socketio.Client(logger=True, engineio_logger=True)
# sio = socketio.Client()


@sio.event
def connect():
    print('connection established')
# @sio.on('connect')
# def on_connect():
#     print("I'm connected to the namespace!")

@sio.on('from_server')
def my_message(data):
    print('message received with ', data)

@sio.event
def disconnect():
    print('disconnected from server')


@sio.event
def connect_error(data):
    print("The connection failed!")


# To consume latest messages and auto-commit offsets
consumer = KafkaConsumer("story_ai_dungeon",
                         group_id='my-group',
                         bootstrap_servers=['[::1]:9092'],
                         value_deserializer=lambda m: json.loads(m.decode('ascii')))
producer = KafkaProducer(value_serializer=lambda m: json.dumps(m).encode('ascii'), bootstrap_servers=['[::1]:9092'])

sio.connect('http://localhost:5000', transports='websocket')
for message in consumer:
    # message value and key are raw bytes -- decode if necessary!
    # e.g., for unicode: `message.value.decode('utf-8')`
    print("%s:%d:%d: key=%s value=%s" % (message.topic, message.partition, message.offset, message.key, message.value))

[miguelgrinberg]

You may need to monkey patch the standard library for eventlet compatiblity. See https://eventlet.net/doc/patching.html for details. If that does not work, I'm afraid you'll have to drop either eventlet or kafka.

[xiaol]

Thanks！I have tried this patch, although it won't work. I'll try another method.