Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kytos-sdx containers keep restarting #120

Open
sajith opened this issue Sep 19, 2024 · 1 comment
Open

kytos-sdx containers keep restarting #120

sajith opened this issue Sep 19, 2024 · 1 comment

Comments

@sajith
Copy link
Member

sajith commented Sep 19, 2024

Forking an issue off atlanticwave-sdx/sdx-docs#29. On my setup (Debian 12.7 on x86_64, Docker 27.2.1), kytos-sdx containers keep restarting.

$ docker logs amlight
Starting enhanced syslogd: rsyslogdrsyslog startup failure, child did not respond within startup timeout (60 seconds)
 already started.
/etc/openvswitch/conf.db does not exist ... (warning).
Creating empty database /etc/openvswitch/conf.db.
Starting ovsdb-server.
Configuring Open vSwitch system IDs.
Starting ovs-vswitchd.
Enabling remote OVSDB managers.
Starting Kytos controller in a tmux session: done
tail: cannot open '/var/log/syslog' for reading: No such file or directory
tail: no files remaining

The above log messages keep repeating as the containers keep restarting every minute. When these lines are commented out, the containers keep running:

command: tail -f /var/log/syslog

command: tail -f /var/log/syslog

command: tail -f /var/log/syslog

But I guess the real problem with rsyslogd still remains. I came across a Stack Overflow question about this:

https://stackoverflow.com/questions/35715720/rsyslog-inside-docker-containers-rsyslogd-is-not-running-failed

@sajith
Copy link
Member Author

sajith commented Sep 19, 2024

The likely cause is a rsyslogd bug triggered by a very high number of open file descriptors: rsyslog/rsyslog#5158

We can try either using a base image that has a newer rsyslogd, or use a workaround: https://gist.github.com/vicenterusso/ae6d6c903b790e5dae91c339c1ce2ba8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant