MMM-RTSPStream - Video Streaming from Live Feeds (Security Cameras)

This is a module for the MagicMirror².

This module will show a live RTSP video stream and/or periodic snapshots on the Magic Mirror from any IP Security Camera which supports the RTSP protocol and/or can serve a snapshot periodically.

Features:

• Supports single or multiple camera streams/snapshots
• For multiple streams: supports rotating through streams in a single window or displaying multiple windows (with customizeable layout)
• Supports fetching snapshots from a file or url when not actively streaming
• Flexible configurations to limit resource use on Raspberry Pi --
  • Stops all streams when module is hidden
  • Option for AutoPlay or manual starting of stream
  • Plays one or all streams (when displaying multiple)
  • Note: 3 simultaneous streams on a RaspberryPi 3 is about the limit for usability.
• Support for MMM-KeyBindings module for Play/Pause Remote Control and navigation of multiple streams
• Hardware-Accelerated Playback on the main screen, with option to use software playback on a remote browser window.
• When using omxplayer or vlc, double-clicking the play button (or longpressing PlayPause key if using MMM-KeyBindings) will play the video fullscreen. Click anywhere once (or Pause with MMM-KeyBindings) to exit.

Dependencies:

• The following packages are required for the module to function fully and the installer will attempt to install them with apt:
  • ffmpeg, omxplayer, vlc, devilspie2, wmctrl
• For hardware-accelerated streaming, vlc or omxplayer is required.
• For manipulating VLC's windows, devilspie2 and wmctrl are used.
• For software-decoded streaming and/or remote browser viewing:
  • Requires jsmpeg for front-end display of stream.
  • Requires node-rtsp-stream-es6 Node.js module and ffmpeg for backend.
  • Video flow using 'ffmpeg': Camera RTSP Stream → ffmpeg pre-processor → MM module's node_helper.js (via node-rtsp-stream-es6) → Web Socket (ws) → MagicMirror² (via jsmpeg)

Screenshot:

Installation:

Quick install

If you followed the default installation instructions for the Magic Mirror² project, you should be able to use the automatic installer. The following command will download the installer and execute it:

bash -c "$(curl -s https://raw.githubusercontent.com/shbatm/MMM-RTSPStream/develop/scripts/installer.sh)"

Updating after a Module Update:

Re-run the installation script above, or do the following:

cd ~/MagicMirror/modules/MMM-RTSPStream
git pull
npm install

Using the module

To use this module, use the configuration builder tool included.

1. Install the module (see above).
2. Add the following to your config:

    {
        module: 'MMM-RTSPStream',
        position: 'middle_center',
        config: {
            initialSetup: true,
        }
    }

2. Open a web-browser and navigate to: http://your-mirror-ip:8080/MMM-RTSPStream/config.html
3. Use the tool to generate your config details.
4. Copy the section you your MagicMirror config.js file.
5. Restart the MagicMirror

Configuration options

It is highly recommended you use the tool included. Several sample configurations are available on this wiki page, detailed options are listed below.

Option	Description
autoStart	Start the stream(s) automatically Default: true
rotateStreams	true: Rotate through all streams in a single window false: Display an individual window for each stream Default: true
rotateStreamTimeout	Time (in sec) to show each stream when rotateStreams is true. Default: 10
localPlayer	Optional: Which player to use for local playback: vlc, ffmpeg or omxplayer. Default: vlc for hardware acceleration.
remotePlayer	Optional: Which player to use for remote browser playback: ffmpeg or none. Default: ffmpeg. Set to none to disable remote playback.
remoteSnaps	Optional: If true, module will continue to show snapshots for any remote browser windows while playing the stream locally. Using false will stop updating snapshots when playing locally. Use this option if you only use the local screen to save resources. Default: true.
showSnapWhenPaused	Whether or not to show snapshots when the stream(s) is paused. Default: true
moduleWidth	Width in px of the module. Note: When rotateStreams is false and multiple streams are used, adjust this value to adjust the number of streams shown side by side. E.G. to show 2 streams side by side, this value should be = 2*(Stream Width + 2*1px (border) + 2*15px (margin)) Default: 354px
moduleHeight	Similar (but less critical) to moduleWidth. Adjust to the number of streams high to ensure other modules clear. Default: 240px
moduleOffset	Only applies when using OMXPlayer. On some displays, the video does not properly line up with the box on the screen because of differences between JavaScript's reporting and the native display. Entering a pixel value will shift the video over by that amount. Default: 0 Values: Any number (no units) by itself will adjust both top/left the same amount, or you can specify left & top adjustments separately (e.g. moduleOffset: { left: 10, top: -10 }
shutdownDelay	The time delay (in sec) between when the last client disconnects and the ffmpeg or vlc stream actually stops. Once created, the websocket continues to run in the background; however, the ffmpeg process will only process the camera's stream while there are active connections on the socket (e.g. someone is watching the video on the frontend). When rotating through multiple streams this prevents closing the connection to a stream only to re-open a few seconds later when it comes back through the loop (which reduces the time delay when restarting a stream). To conserve resources on a slow device, you can set this to 0 Default: 11 (sec)
omxRestart	Automatically restart the OMX Stream every X hours. Default: 24 (hours).
debug	Set to true to show additional logging information.
streamX	The individual stream configuration options. See table below for more details.

Stream Configuration Options

Each stream you would like to show should be added to the the configuration by adding a streamX section, where X is the number of the stream (e.g. stream1, stream2, stream3, etc.)

config: {
    // ... <other config options; see above> ...,
    stream1: {
        name: 'BigBuckBunny Test Stream',
        url: 'rtsp://184.72.239.149/vod/mp4:BigBuckBunny_115k.mov',
        // ... <additional stream options; see below> ...
    },
    stream2: {
        // ...
    },
    // ...
}

Option	Description
name	Required The name of the individual stream. Will be displayed when paused if snapshots are turned off.
url	The url of the RTSP stream. See this list for paths for some common security cameras. Also see below for how to test for a valid url Username and password should be passed in the url if required: rtsp://<username>:<password>@<hostname>:<port>/<path> Default: A test stream at 'rtsp://184.72.239.149/vod/mp4:BigBuckBunny_115k.mov',
hdUrl	Optional: The url for the "High-Def" stream to use when playing a full screen stream with OMXPlayer. If blank, regular url will be used.
protocol	Protocol to use for receiving RTSP stream Default: "tcp", valid options: "tcp" or "udp".
snapshotUrl	A string with the path to the camera snapshot. This can either be a url to camera itself (if supported) or a file path to where the snapshot is stored every X seconds by the camera. Leave blank to show just the stream title when paused. Username and password should be passed in the url if required: http://<username>:<password>@<hostname>:<port>/<path>
snapshotType	The type of snapshot path given Values: url or file Default: url
snapshotRefresh	How often to refresh the snapshot image (in sec). Default: 10 (seconds)
frameRate	Framerate to use for the RTSP stream. Must be a string. Default: "30"
width	The width in px of the stream.
height	The height in px of the stream.
absPosition	Only required for OMXPlayer Provide an absolute potiion to show the stream. This overrides the automatic window and moduleOffset settings. Format: { top: XX, right: XX, bottom: XX, left: XX } where XX is the pixel position on the screen.
ffmpegPort	Only required for ffmpeg Any available port to use for the ffmpeg websocket. Notes: THIS IS NOT THE PORT FOR YOUR CAMERA Camera stream's port must be included in the URL above. This port must be unqiue for each stream added and cannot be used by another service on the server. This is a separate WebSocket from the the Socket.IO connection between the module's script and it's node_helper.js. Default: 9999
hwAccel	Only required for ffmpeg Attempt to use Hardware Accelerated Decoding with ffmpeg. Default: false
muted	Disable sound (OMXPlayer only) Default: false
timeout	Timeout for stalled file/network operations (OMXPlayer only) Default: 10 (seconds)
rotateDegree	Set orientation of video (OMXPlayer only) Available values: 0, 90, 180 or 270 Default: 0

Testing a camera feed

To test to make sure you have a working url for a camera feed: create a text file with the URL as the first and only line in the file. Save the file as <somename>.strm and open the file with a video player like VLC.

Advanced Stream Configurations

This module has been tested exclusively with streams for Hikvision (Swann) cameras. You may find that you need to adjust the ffmpeg settings that are used beyond just frame rate and size. The command line arguements for ffmpeg can be changed by editing Line 14 of the following file after install. The ffmpeg arguement list is passed as an array.

~/MagicMirror/modules/MMM-RTSPStream/node_modules/node-rtsp-stream-es6/src/mpeg1muxer.js

Controlling from other modules

The streams can be controlled on the main screen by sending a module notification. Examples:

this.sendNotification("RTSP-PLAY", "all"); // Play all streams (or current stream if rotating)
this.sendNotification("RTSP-PLAY", "streamX"); // Play a particular stream (when not rotating)
this.sendNotification("RTSP-PLAY-FULLSCREEN", "streamX"); // Play a particular stream fullscreen (when using OMXPLAYER)
this.sendNotification("RTSP-PLAY-WINDOW", { name:"streamX", box: { top: XX, right: XX, bottom: XX, left: XX } }); // Play a particular stream in a custom window (when using OMXPLAYER)
this.sendNotification("RTSP-STOP", "all"); // Stop the streams
this.sendNotification("RTSP-STOP", "streamX"); // Stop a particular stream 

KeyBindings Configuration (Requires MMM-KeyBindings)

To change from the defaults, add changes to the end of the module's configuration section

Option	Description
mode	Default: "DEFAULT" - Will respond to a key press if no other module has the focus. Note: - To enable this module to take focus, change this value and add a Focus key name below.
map	The map between this module's key functions and the Keyboard / MMM-KeyBinding's key name that is sent (i.e. when the "MediaPlayPause" key is pressed, it will send a Play action to this module). Previous/Next actions will cycle through the streams when rotateStreams is enabled, and will change which stream is selected when multiple streams are shown (red border will appear around selected stream).

keyBindings: { 
    enabled: true,
    mode: "DEFAULT",
    map: {
        Play: "MediaPlayPause", 
        Previous: "MediaPreviousTrack", 
        Next: "MediaNextTrack",
    }
}

To-do

• Add better touchscreen support (use an OnTouch method to play/pause instead of OnClick).
• KNOWN ISSUE: snapshots can be stopped by another "instance" of the mirror running in a different window. Expected behavior: should only affect the local window.
• KNOWN ISSUE: omxplayer will only play a certain maximum number of streams at a time. On a RPi3, this appears to be a max of 3. It won't error, it just won't play another stream. To fix: adjust the memory split of the GPU/CPU using the raspi-config command.

Experimentation

This section includes some untested options and configurations that may be useful in the future.

Use ffmpeg to capture snapshots from an RTSP Stream

// Grab a frame every x seconds and save as thumb.png:
ffmpeg -i {RTSP_SOURCE} -f image2 -vf fps=fps=1/{x} -update 1 thumb.png

// Grab the first frame from a stream and save as thumb.jpg
ffmpeg -i {RTSP_SOURCE} -ss 00:00:01.500 -f image2 -vframes 1 thumb.png

(source)