-
Notifications
You must be signed in to change notification settings - Fork 37
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add check for oslo.messaging bug LP1934937
- Loading branch information
Showing
2 changed files
with
77 additions
and
0 deletions.
There are no files selected for viewing
57 changes: 57 additions & 0 deletions
57
hotsos/defs/scenarios/openstack/oslo_messaging/lp1934937.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,57 @@ | ||
vars: | ||
expr: 'greenlet.error: cannot switch to a different thread' | ||
msg_part_common: >- | ||
service(s) on this host are affected by this bug which is triggered when | ||
a non-wsgi service that is using greenthreads and has oslo.messaging | ||
heartbeat_in_pthread=True tries to send a heartbeat message to rabbitmq | ||
checks: | ||
# Include non-wsgi services that use oslo.messaging | ||
nova_has_1934937: | ||
input: var/log/nova/*.log | ||
expr: $expr | ||
neutron_has_1934937: | ||
input: var/log/neutron/*.log | ||
expr: $expr | ||
cinder_has_1934937: | ||
input: var/log/cinder/*.log | ||
expr: $expr | ||
gnocchi_has_1934937: | ||
input: var/log/gnocchi/*.log | ||
expr: $expr | ||
conclusions: | ||
nova_1934937: | ||
decision: nova_has_1934937 | ||
raises: | ||
type: LaunchpadBug | ||
bug-id: 1934937 | ||
message: >- | ||
One or more Nova {msg_part_common}. | ||
format-dict: | ||
msg_part_common: $msg_part_common | ||
neutron_1934937: | ||
decision: neutron_has_1934937 | ||
raises: | ||
type: LaunchpadBug | ||
bug-id: 1934937 | ||
message: >- | ||
One or more Neutron {msg_part_common}. | ||
format-dict: | ||
msg_part_common: $msg_part_common | ||
cinder_1934937: | ||
decision: cinder_has_1934937 | ||
raises: | ||
type: LaunchpadBug | ||
bug-id: 1934937 | ||
message: >- | ||
One or more Cinder {msg_part_common}. | ||
format-dict: | ||
msg_part_common: $msg_part_common | ||
gnocchi_1934937: | ||
decision: gnocchi_has_1934937 | ||
raises: | ||
type: LaunchpadBug | ||
bug-id: 1934937 | ||
message: >- | ||
One or more Gnocchi {msg_part_common}. | ||
format-dict: | ||
msg_part_common: $msg_part_common |
20 changes: 20 additions & 0 deletions
20
hotsos/defs/tests/scenarios/openstack/oslo_messaging/lp1934937.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,20 @@ | ||
data-root: | ||
files: | ||
var/log/nova/nova-compute.log: | | ||
2023-06-18 08:42:58.702 1402787 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 101] ENETUNREACH (retrying in 0 seconds): OSError: [Errno 101] ENETUNREACH | ||
Traceback (most recent call last): | ||
File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers | ||
timer() | ||
File "/usr/lib/python3/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ | ||
cb(*args, **kw) | ||
File "/usr/lib/python3/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire | ||
waiter.switch() | ||
greenlet.error: cannot switch to a different thread | ||
copy-from-original: | ||
- sos_commands/date/date | ||
raised-bugs: | ||
https://bugs.launchpad.net/bugs/1934937: >- | ||
One or more Nova service(s) on this host are affected by this bug which is | ||
triggered when a non-wsgi service that is using greenthreads and has | ||
oslo.messaging heartbeat_in_pthread=True tries to send a heartbeat message | ||
to rabbitmq. |