[Support]: Randomly Artifacted image on multiple cameras

[makerwolf]

Describe the problem you are having

Since Frigate 0.14 I'm sometimes having issues viewing streams in the browser (Safai and Chrome alike, multiple different cameras, all Mac OS)

Sometimes the stream looks like this:

Any idea what this could be and maybe even a possible fix?

It sometimes happens, sometimes not, sometimes this camera, then the other. Sometimes in the live stream, then the recording. But it seem the recording itself is unaffected. I'm really having trouble reproducing the behaviour.

Version

0.14.1-f4f3cfa

What browser(s) are you using?

Safari 18.0.1, Chrome 129.0.6668.90

Frigate config file

-

Relevant Frigate log output

nothing

Relevant go2rtc log output

nothing

FFprobe output from your camera

na

Frigate stats

-

Install method

HassOS Addon

docker-compose file or Docker CLI command

-

Object Detector

Coral

Network connection

Wired

Camera make and model

multiple (reolink, tapo, noname)

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

No response

[NickM-27]

If it happens in the recording then it's nothing Frigate is doing as that's copied directly from the camera

[makerwolf]

It does not happen in the recording, as I have indicated.

[NickM-27]

sometimes this camera, then the other. Sometimes in the live stream, then the recording

That implies it does happen in the recording

[makerwolf]

the recording itself is fine, it's only in the playback of the recording in the browser. And only sometimes. That's the weird part. I am absolutely unable to reproduce it if I wanted to. It either happens, or not.

[hawkeye217]

What is your frigate config and what cameras are specifically affected?

[makerwolf]

Phew, that was a bit tricky, had to change the port to 5001 or frigate wouldn't start, because something else is already on 5000 ...

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"15/1","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":1440,"width":2560},{"avg_frame_rate":"0/0","codec_long_name":"AAC (Advanced Audio Coding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"15/1","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":360,"width":640}]}}]

fwiw, right now there is two cameras hicupping on the live stream, and that's their output:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"25/2","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":1440,"width":2560}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"25/2","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":448,"width":800}]}}]

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"25/1","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":1080,"width":1920}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"25/1","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":352,"width":640}]}}]

On both those cameras, If I watch the live output, it has a diagonal and color shift in the live feed. If I watch the recording it's just fine.

[hawkeye217]

So here is your issue:

"height":352,"width":640}
and
"height":448,"width":800}]

These two cameras that are currenty hiccuping have non-standard aspect ratios. You need to explicitly set the detect width and height if this is the case. Otherwise, you'll see the artifacting you're seeing when Frigate is using the jsmpeg player.

See the FAQ, Usage question 15.

[makerwolf]

hmm, I have now added a detect section with the resolutions as per the ffprobe output, but the problem remains the same :(
These 3 lines just below the snapshots section, double checked resolutions match the output.

    snapshots:
      enabled: true
    detect:
      width: 640
      height: 352

[hawkeye217]

Does it improve if you explicitly set it to:

    detect:
      width: 640
      height: 360

[makerwolf]

Indeed, this fixed the issue. Interesting, 352 is divisible by 4 ... this also fixed another camera. Now I only have one more camera left, which is a little bit special, it is 4k, loads fine every time, but after 5 seconds I get a spinning wheel, and it switches to the artifacted image with the diagnoal again. This is the ffprobe output:
[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"299/12","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":3840,"width":2160},{"avg_frame_rate":"0/0","codec_long_name":"AAC (Advanced Audio Coding)"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"10/1","codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","height":640,"width":360}]}}]

(I'm also failing to get audio recording on that camera, but that's another issue)

[hawkeye217]

Glad to hear it's working for most of your cameras.

What's the name of the camera in your config that is still failing?

[makerwolf]

It's a Reolink CX810, Camera1 in the config, rotated by 90 degree in frigate.

[hawkeye217]

If it's rotated, did you try swapping width/height in the detect section?

    detect:
      width: 360
      height: 640