How to debug hanging renovate process?

[buffcode]

How are you running Renovate?

Self-hosted Renovate

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

GitLab, renovate/renovate:39

Please tell us more about your question or problem

Multiple times a day the renovate process just stalls and doesn't progress any further for hours. I limited the repositories to two small ones but still cannot get it to run constantly.

I'm running Renovate on trace logging already but it's not helpful in understanding why the process is stalled or what's currently happening.

I've attached the Node debugger, but when pausing, after a short delay it only jumps to node:internal/timers, so there doesn't seem to be any code running any more.

Logs (if relevant)

Logs (last line logged)

2025-01-30T12:40:53.981204409Z {"name":"renovate","hostname":"ae2465654e57","pid":9,"level":10,"logContext":"xzxLBAIXDVbdKod1fF94T","repository":"foobar/eshop","dep":{"versioning":"npm","updates":[],"warnings":[],"sourceUrl":"https://github.com/typeorm/typeorm","registryUrl":"https://registry.npmjs.org","homepage":"https://typeorm.io","currentVersion":"0.3.20","currentVersionTimestamp":"2024-01-26T11:18:29.421Z","currentVersionAgeInDays":370},"msg":"Dependency lookup success","time":"2025-01-30T12:40:23.259Z","v":0}

[astellingwerf]

I don't know the nature of the slowness/hang, but https://docs.renovatebot.com/opentelemetry/ might be helpful? I recently was able to use it and in my case identify that calls to a specific artifactory instance took a minute each.

[buffcode]

I setup OTEL and Jaeger as per the documentation, but it only shows a lot of HTTP requests of which some failed (timeout, usually big npm packages like node, next, react etc.).

The trace ends with the last package request, after which Renovate emits "Dependency lookup success" and stops doing anything.

Interestingly the final span_id from the logs is not shown in Jaeger.

{"name":"renovate","hostname":"4ec2ca57d4b9","pid":8,"level":10,"logContext":"UhlnVnyID0AJ386-IMh8r","repository":"channel21/eshop","dep":{"versioning":"npm","updates":[{"bucket":"minor","newVersion":"3.4.2","newValue":"3.4.2","releaseTimestamp":"2024-12-04T07:04:07.630Z","newVersionAgeInDays":58,"newMajor":3,"newMinor":4,"newPatch":2,"updateType":"minor"}],"warnings":[],"sourceUrl":"https://github.com/prettier/prettier","registryUrl":"https://registry.npmjs.org","homepage":"https://prettier.io","currentVersion":"3.3.3","currentVersionTimestamp":"2024-07-13T12:26:38.008Z","currentVersionAgeInDays":202,"isSingleVersion":true,"fixedVersion":"3.3.3"},"msg":"Dependency lookup success","time":"2025-01-31T13:24:29.557Z","v":0,"trace_id":"ea98b48be5a8152b0e329a02d97ffc65","span_id":"8de6c4d1cafc1544","trace_flags":"01"}