eNMS fails to start Gunicorn and Workers

[jsmith7735]

I have been troubleshooting an issue for the last few weeks and I can't seem to figure out what is going on. When I start the enms service via system startup or using sudo service enms restart. The application fails to load. When inspecting the logs, the last log message shows the enms services loading but that's it.

When looking at netstat output it does not show service listening on port 5000. If I start the service manually from the eNMS directory the service boots but does not have any environment variables required to function properly. This has been working relatively well for the last 8 months with limited issues. I appreciate any assistance that can be provided.

I should also note I had the problem last week (10/27/21) but resolved it by restoring the VM from a backup. I would love to get to the root cause of the issue to prevent it from happening again.

There are no log messages generated during the failure. Can additional logging be enabled in the gunicorn.py config file?

Last good boot after a system restore on 11/1

Logs are not present in startup process
Nov 01 16:13:53 cersrenms01 gunicorn[3340]: [2021-11-01 16:13:53 -0500] [3340] [INFO] Starting gunicorn 20.1.0 Nov 01 16:13:53 cersrenms01 gunicorn[3340]: [2021-11-01 16:13:53 -0500] [3340] [DEBUG] Arbiter booted Nov 01 16:13:53 cersrenms01 gunicorn[3340]: [2021-11-01 16:13:53 -0500] [3340] [INFO] Listening at: http://0.0.0.0:5000 (3340) Nov 01 16:13:53 cersrenms01 gunicorn[3340]: [2021-11-01 16:13:53 -0500] [3340] [INFO] Using worker: sync Nov 01 16:13:53 cersrenms01 gunicorn[3367]: [2021-11-01 16:13:53 -0500] [3367] [INFO] Booting worker with pid: 3367 Nov 01 16:13:53 cersrenms01 gunicorn[3368]: [2021-11-01 16:13:53 -0500] [3368] [INFO] Booting worker with pid: 3368 Nov 01 16:13:54 cersrenms01 gunicorn[3369]: [2021-11-01 16:13:54 -0500] [3369] [INFO] Booting worker with pid: 3369 Nov 01 16:13:54 cersrenms01 gunicorn[3340]: [2021-11-01 16:13:54 -0500] [3340] [DEBUG] 3 workers