Cancel listen task when setting the Matter fabric label fails (home-a…

…ssistant#127423)

When setting the Matter fabric label fails, the listen task should be
cancelled to prevent the task from running indefinitely.

Follow up for home-assistant#127252.

homeassistant/components/matter/__init__.py

@@ -139,6 +139,7 @@ async def on_hass_stop(event: Event) -> None:
             hass.config.location_name or "Home"
         )
     except (NotConnected, MatterError) as err:
+        listen_task.cancel()
         raise ConfigEntryNotReady("Failed to set default fabric label") from err
 
     if DOMAIN not in hass.data: