Live Video Editing and Markup

ffmpeg Video Markup Using Scrypted

Build a custom version of ffmpeg:

• To allow compatibility with HomeKit, make sure that this version supports:

  • libfdk-aac
  • libx264
  • libx265

• mkdir ~/Applications/ffmpeg-for-scrypted && cd ~/Applications/ffmpeg-for-scrypted

• sudo apt-get -y install autoconf automake build-essential libass-dev libfreetype6-dev libtheora-dev libtool libvorbis-dev pkg-config texinfo zlib1g-dev

• sudo apt-get install libfdk-aac-dev libmp3lame-dev yasm libx264-dev libx265-dev

• https://ffmpeg.org/releases/ffmpeg-snapshot.tar.bz2

• tar xjvf ffmpeg-snapshot.tar.bz2

• cd ffmpeg

• PATH="$HOME/Applications/ffmpeg-for-scrypted/bin:$PATH" PKG_CONFIG_PATH="$HOME/Applications/ffmpeg-for-scrypted/ffmpeg_build/lib/pkgconfig" ./configure --prefix="$HOME/Applications/ffmpeg-for-scrypted/ffmpeg_build" --pkg-config-flags="--static" --extra-cflags="-I$HOME/Applications/ffmpeg-for-scrypted/ffmpeg_build/include" --extra-ldflags="-L$HOME/Applications/ffmpeg-for-scrypted/ffmpeg_build/lib" --bindir="$HOME/Applications/ffmpeg-for-scrypted/bin" --enable-shared --enable-libx264 --enable-libx265 --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libtheora --enable-libvorbis --enable-libmp3lame --enable-nonfree --enable-gpl

• PATH="$HOME/Applications/ffmpeg-for-scrypted/bin:$PATH" make

• make install

• make distclean

• hash -r

Add the lib directory of this new build to the path:

• sudo nano /etc/ld.so.conf
• Add the following line at the bottom: /home/<username>/Applications/ffmpeg-for-scrypted/ffmpeg_build/lib
• sudo ldconfig

Running Scrypted with this version of ffmpeg...

...in a terminal (for testing):

• First stop the Scrypted service if it's running: sudo systemctl stop scrypted.service
• SCRYPTED_FFMPEG_PATH=/home/<username>/Applications/ffmpeg-for-scrypted/bin/ffmpeg /usr/bin/npx -y scrypted serve

...always (editing the systemd service):

• Edit /etc/systemd/system/scrypted.service and add the "Environment" line so that it looks like the following:

[Unit]
Description=Scrypted service
After=network.target

[Service]
User=<username>
Group=<username>
Type=simple
Environment="SCRYPTED_FFMPEG_PATH=/home/<username>/Applications/ffmpeg-for-scrypted/bin/ffmpeg"
ExecStart=/usr/bin/npx -y scrypted serve
Restart=on-failure
RestartSec=3

[Install]
WantedBy=multi-user.target

• Run sudo systemctl daemon-reload
• Run sudo systemctl start scrypted.service

Setting up Scrypted

• In your camera of choice, ensure that the HomeKit integration is turned on
• In the camera settings, choose the HomeKit tab, and check all the boxes for HomeKit transcoding
• In the "H264 Encoder Arguments" box, enter the following:

-vf drawtext=fontfile=/usr/share/fonts/truetype/freefont/FreeMonoBold.ttf:text='%{localtime}':fontsize=72:[email protected]:x=10:y=10 -vcodec libx264 -preset ultrafast -tune zerolatency -b:v 600k

• The font size ("72") as well as the position on screen ("x=10:y=10") can be editing by changing the command above.
• Reload the HomeKit plugin

Viewing Additional Logs in the Scrypted UI

• In the HomeKit plugin settings, click the REPL button
• Enter localStorage.setItem('SCRYPTED_FFMPEG_NOISY', 'true') to enable verbose ffmpeg output
• Enter localStorage.removeItem('SCRYPTED_FFMPEG_NOISY', 'true') to disable