diff --git a/README.md b/README.md index c50329c6..05198058 100644 --- a/README.md +++ b/README.md @@ -1,34 +1,44 @@

- MediaMTX / rtsp-simple-server + MediaMTX / rtsp-simple-server + +
+
+ + [![Test](https://github.com/bluenviron/mediamtx/workflows/test/badge.svg)](https://github.com/bluenviron/mediamtx/actions?query=workflow:test) + [![Lint](https://github.com/bluenviron/mediamtx/workflows/lint/badge.svg)](https://github.com/bluenviron/mediamtx/actions?query=workflow:lint) + [![CodeCov](https://codecov.io/gh/bluenviron/mediamtx/branch/main/graph/badge.svg)](https://app.codecov.io/gh/bluenviron/mediamtx/branch/main) + [![Release](https://img.shields.io/github/v/release/bluenviron/mediamtx)](https://github.com/bluenviron/mediamtx/releases) + [![Docker Hub](https://img.shields.io/badge/docker-bluenviron/mediamtx-blue)](https://hub.docker.com/r/bluenviron/mediamtx) + [![API Documentation](https://img.shields.io/badge/api-documentation-blue)](https://bluenviron.github.io/mediamtx)


-_MediaMTX_ / [_rtsp-simple-server_](#note-about-rtsp-simple-server) is a ready-to-use and zero-dependency server and proxy that allows users to publish, read and proxy live video and audio streams. +_MediaMTX_ (formerly _rtsp-simple-server_) is a ready-to-use and zero-dependency real-time media server and media proxy that allows users to publish, read and proxy live video and audio streams. It has been conceived as a "media broker", a message broker that routes media streams. Live streams can be published to the server with: |protocol|variants|video codecs|audio codecs| |--------|--------|------------|------------| -|WebRTC|Browser-based, WHIP|AV1, VP9, VP8, H264|Opus, G722, G711| -|RTSP clients|UDP, TCP, RTSPS|AV1, VP9, VP8, H265, H264, MPEG-4 Video (H263, Xvid), MPEG-1/2 Video, M-JPEG and any RTP-compatible codec|Opus, MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3), G722, G711, LPCM and any RTP-compatible codec| -|RTSP servers and cameras|UDP, UDP-Multicast, TCP, RTSPS|AV1, VP9, VP8, H265, H264, MPEG-4 Video (H263, Xvid), MPEG-1/2 Video, M-JPEG and any RTP-compatible codec|Opus, MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3), G722, G711, LPCM and any RTP-compatible codec| -|RTMP clients (OBS Studio)|RTMP, RTMPS, Enhanced RTMP|AV1, H265, H264|MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3)| -|RTMP servers and cameras|RTMP, RTMPS, Enhanced RTMP|H264|MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3)| -|HLS servers and cameras|Low-Latency HLS, MP4-based HLS, legacy HLS|H265, H264|Opus, MPEG-4 Audio (AAC)| -|UDP/MPEG-TS streams|Unicast, broadcast, multicast|H265, H264|Opus, MPEG-4 Audio (AAC)| -|Raspberry Pi Cameras||H264|| +|[WebRTC](#webrtc)|Browser-based, WHIP|AV1, VP9, VP8, H264|Opus, G722, G711| +|[RTSP clients](#rtsp-clients)|UDP, TCP, RTSPS|AV1, VP9, VP8, H265, H264, MPEG-4 Video (H263, Xvid), MPEG-1/2 Video, M-JPEG and any RTP-compatible codec|Opus, MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3), G722, G711, LPCM and any RTP-compatible codec| +|[RTSP cameras and servers](#rtsp-cameras-and-servers)|UDP, UDP-Multicast, TCP, RTSPS|AV1, VP9, VP8, H265, H264, MPEG-4 Video (H263, Xvid), MPEG-1/2 Video, M-JPEG and any RTP-compatible codec|Opus, MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3), G722, G711, LPCM and any RTP-compatible codec| +|[RTMP clients](#rtmp-clients)|RTMP, RTMPS, Enhanced RTMP|AV1, H265, H264|MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3)| +|[RTMP cameras and servers](#rtmp-cameras-and-servers)|RTMP, RTMPS, Enhanced RTMP|H264|MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3)| +|[HLS cameras and servers](#hls-cameras-and-servers)|Low-Latency HLS, MP4-based HLS, legacy HLS|H265, H264|Opus, MPEG-4 Audio (AAC)| +|[UDP/MPEG-TS](#udpmpeg-ts)|Unicast, broadcast, multicast|H265, H264|Opus, MPEG-4 Audio (AAC)| +|[Raspberry Pi Cameras](#raspberry-pi-cameras)||H264|| And can be read from the server with: |protocol|variants|video codecs|audio codecs| |--------|--------|------------|------------| -|WebRTC|Browser-based, WHEP|AV1, VP9, VP8, H264|Opus, G722, G711| -|RTSP|UDP, UDP-Multicast, TCP, RTSPS|AV1, VP9, VP8, H265, H264, MPEG-4 Video (H263, Xvid), MPEG-1/2 Video, M-JPEG and any RTP-compatible codec|Opus, MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3), G722, G711, LPCM and any RTP-compatible codec| -|RTMP|RTMP, RTMPS, Enhanced RTMP|H264|MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3)| -|HLS|Low-Latency HLS, MP4-based HLS, legacy HLS|H265, H264|Opus, MPEG-4 Audio (AAC)| +|[WebRTC](#webrtc-1)|Browser-based, WHEP|AV1, VP9, VP8, H264|Opus, G722, G711| +|[RTSP](#rtsp)|UDP, UDP-Multicast, TCP, RTSPS|AV1, VP9, VP8, H265, H264, MPEG-4 Video (H263, Xvid), MPEG-1/2 Video, M-JPEG and any RTP-compatible codec|Opus, MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3), G722, G711, LPCM and any RTP-compatible codec| +|[RTMP](#rtmp)|RTMP, RTMPS, Enhanced RTMP|H264|MPEG-4 Audio (AAC), MPEG-1/2 Audio (MP3)| +|[HLS](#hls)|Low-Latency HLS, MP4-based HLS, legacy HLS|H265, H264|Opus, MPEG-4 Audio (AAC)| -Features: +**Features** * Publish live streams to the server * Read live streams from the server @@ -37,22 +47,15 @@ Features: * Serve multiple streams at once in separate paths * Authenticate users; use internal or external authentication * Redirect readers to other RTSP servers (load balancing) -* Query and control the server through an HTTP API +* Query and control the server through the API * Reload the configuration without disconnecting existing clients (hot reloading) * Read Prometheus-compatible metrics * Run external commands when clients connect, disconnect, read or publish streams * Compatible with Linux, Windows and macOS, does not require any dependency or interpreter, it's a single executable -[![Test](https://github.com/bluenviron/mediamtx/workflows/test/badge.svg)](https://github.com/bluenviron/mediamtx/actions?query=workflow:test) -[![Lint](https://github.com/bluenviron/mediamtx/workflows/lint/badge.svg)](https://github.com/bluenviron/mediamtx/actions?query=workflow:lint) -[![CodeCov](https://codecov.io/gh/bluenviron/mediamtx/branch/main/graph/badge.svg)](https://app.codecov.io/gh/bluenviron/mediamtx/branch/main) -[![Release](https://img.shields.io/github/v/release/bluenviron/mediamtx)](https://github.com/bluenviron/mediamtx/releases) -[![Docker Hub](https://img.shields.io/badge/docker-bluenviron/mediamtx-blue)](https://hub.docker.com/r/bluenviron/mediamtx) -[![API Documentation](https://img.shields.io/badge/api-documentation-blue)](https://bluenviron.github.io/mediamtx) +**Note about rtsp-simple-server** -## Note about rtsp-simple-server - -_rtsp-simple-server_ has been rebranded as _MediaMTX_. The reason is pretty obvious: this project started as a RTSP server but has evolved into a much more versatile media server (i like to call it a "media broker", a message broker for media streams), that is not tied to the RTSP protocol anymore. Nothing will change regarding license, features and backward compatibility. +_rtsp-simple-server_ has been rebranded as _MediaMTX_. The reason is pretty obvious: this project started as a RTSP server but has evolved into a much more versatile product that is not tied to the RTSP protocol anymore. Nothing will change regarding license, features and backward compatibility. ## Table of contents @@ -62,56 +65,52 @@ _rtsp-simple-server_ has been rebranded as _MediaMTX_. The reason is pretty obvi * [Arch Linux package](#arch-linux-package) * [OpenWRT package](#openwrt-package) * [Basic usage](#basic-usage) -* [General](#general) +* [Publish to the server](#publish-to-the-server) + * [By software](#by-software) + * [FFmpeg](#ffmpeg) + * [GStreamer](#gstreamer) + * [OBS Studio](#obs-studio) + * [OpenCV](#opencv) + * [Web browsers](#web-browsers) + * [By device](#by-device) + * [Generic webcam](#generic-webcam) + * [Raspberry Pi Cameras](#raspberry-pi-cameras) + * [By protocol](#by-protocol) + * [WebRTC](#webrtc) + * [RTSP clients](#rtsp-clients) + * [RTSP cameras and servers](#rtsp-cameras-and-servers) + * [RTMP clients](#rtmp-clients) + * [RTMP cameras and servers](#rtmp-cameras-and-servers) + * [HLS cameras and servers](#hls-cameras-and-servers) + * [UDP/MPEG-TS](#udpmpeg-ts) +* [Read from the server](#read-from-the-server) + * [By software](#by-software-1) + * [FFmpeg](#ffmpeg-1) + * [GStreamer](#gstreamer-1) + * [VLC](#vlc) + * [Web browsers](#web-browsers-1) + * [By protocol](#by-protocol-1) + * [WebRTC](#webrtc-1) + * [RTSP](#rtsp) + * [RTMP](#rtmp) + * [HLS](#hls) +* [Features](#features) * [Configuration](#configuration) * [Authentication](#authentication) * [Encrypt the configuration](#encrypt-the-configuration) - * [Proxy mode](#proxy-mode) * [Remuxing, re-encoding, compression](#remuxing-re-encoding-compression) * [Save streams to disk](#save-streams-to-disk) * [On-demand publishing](#on-demand-publishing) * [Start on boot](#start-on-boot) - * [Linux](#linux) - * [Windows](#windows) - * [HTTP API](#http-api) + * [RTSP-specific features](#rtsp-specific-features) + * [RTMP-specific features](#rtmp-specific-features) + * [WebRTC-specific features](#webrtc-specific-features) + * [API](#api) * [Metrics](#metrics) * [pprof](#pprof) - * [Compile from source](#compile-from-source) -* [Publish to the server](#publish-to-the-server) - * [From a webcam](#from-a-webcam) - * [From a Raspberry Pi Camera](#from-a-raspberry-pi-camera) - * [From OBS Studio](#from-obs-studio) - * [From OpenCV](#from-opencv) - * [From a UDP stream](#from-a-udp-stream) - * [From the browser](#from-the-browser) -* [Read from the server](#read-from-the-server) - * [From VLC and Ubuntu](#from-vlc-and-ubuntu) -* [RTSP protocol](#rtsp-protocol) - * [General usage](#general-usage) - * [TCP transport](#tcp-transport) - * [UDP-multicast transport](#udp-multicast-transport) - * [Encryption](#encryption) - * [Redirect to another server](#redirect-to-another-server) - * [Fallback stream](#fallback-stream) - * [Corrupted frames](#corrupted-frames) - * [Decrease latency](#decrease-latency) -* [RTMP protocol](#rtmp-protocol) - * [General usage](#general-usage-1) - * [Encryption](#encryption-1) -* [HLS protocol](#hls-protocol) - * [General usage](#general-usage-2) - * [Browser support](#browser-support) - * [Embedding](#embedding) - * [Low-Latency variant](#low-latency-variant) - * [HLS on Apple devices](#hls-on-apple-devices) - * [Decrease latency](#decrease-latency-1) -* [WebRTC protocol](#webrtc-protocol) - * [General usage](#general-usage-3) - * [WHIP and WHEP](#whip-and-whep) - * [Usage inside a container or behind a NAT](#usage-inside-a-container-or-behind-a-nat) - * [Embedding](#embedding-1) +* [Compile from source](#compile-from-source) * [Standards](#standards) -* [Links](#links) +* [Related projects](#related-projects) ## Installation @@ -123,7 +122,7 @@ There are several installation methods available: standalone binary, Docker imag 2. Start the server: - ``` + ```sh ./mediamtx ``` @@ -142,7 +141,7 @@ Available images: |bluenviron/mediamtx:latest|:x:|:x:| |bluenviron/mediamtx:latest-ffmpeg|:heavy_check_mark:|:x:| |bluenviron/mediamtx:latest-rpi|:x:|:heavy_check_mark:| -|bluenviron/mediamtx:latest-ffmpeg-rpi|:heavy_check_mark:|:heavy_check_mark: +|bluenviron/mediamtx:latest-ffmpeg-rpi|:heavy_check_mark:|:heavy_check_mark:| The `--network=host` flag is mandatory since Docker can change the source port of UDP packets for routing reasons, and this doesn't allow the RTSP server to identify the senders of the packets. This issue can be avoided by disabling the UDP transport protocol: @@ -160,7 +159,7 @@ bluenviron/mediamtx If you are running the Arch Linux distribution, run: -``` +```sh git clone https://aur.archlinux.org/mediamtx.git cd mediamtx makepkg -si @@ -172,7 +171,7 @@ makepkg -si 2. Open a terminal in the SDK folder and setup the SDK: - ``` + ```sh ./scripts/feeds update -a ./scripts/feeds install -a make defconfig @@ -180,7 +179,7 @@ makepkg -si 3. Download the server Makefile and set the server version inside the file: - ``` + ```sh mkdir package/mediamtx wget -O package/mediamtx/Makefile https://raw.githubusercontent.com/bluenviron/mediamtx/main/openwrt.mk sed -i "s/v0.0.0/$(git ls-remote --tags --sort=v:refname https://github.com/bluenviron/mediamtx | tail -n1 | sed 's/.*\///; s/\^{}//')/" package/mediamtx/Makefile @@ -188,7 +187,7 @@ makepkg -si 4. Compile the server: - ``` + ```sh make package/mediamtx/compile -j$(nproc) ``` @@ -196,7 +195,7 @@ makepkg -si 6. Install it with: - ``` + ```sh opkg install [ipk-file-name].ipk ``` @@ -204,37 +203,685 @@ makepkg -si 1. Publish a stream. For instance, you can publish a video/audio file with _FFmpeg_: - ``` + ```sh ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp rtsp://localhost:8554/mystream ``` or _GStreamer_: - ``` + ```sh gst-launch-1.0 rtspclientsink name=s location=rtsp://localhost:8554/mystream filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! queue ! s.sink_0 d.audio_0 ! queue ! s.sink_1 ``` - To publish from other hardware / software, take a look at the [Publish to the server](#publish-to-the-server) section. - 2. Open the stream. For instance, you can open the stream with _VLC_: - ``` + ```sh vlc --network-caching=50 rtsp://localhost:8554/mystream ``` or _GStreamer_: - ``` + ```sh gst-play-1.0 rtsp://localhost:8554/mystream ``` or _FFmpeg_: - ``` + ```sh ffmpeg -i rtsp://localhost:8554/mystream -c copy output.mp4 ``` -## General +## Publish to the server + +### By software + +#### FFmpeg + +FFmpeg can publish a stream to the server in multiple ways (RTSP client, RTMP client, UDP/MPEG-TS, WebRTC with WHIP). The recommended one consists in publishing as a [RTSP client](#rtsp-clients): + +``` +ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp rtsp://localhost:8554/mystream +``` + +The RTSP protocol supports multiple underlying transport protocols, each with its own characteristics (see [RTSP-specific features](#rtsp-specific-features)). You can set the transport protocol by using the `rtsp_transport` flag, for instance, in order to use TCP: + +```sh +ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp -rtsp_transport tcp rtsp://localhost:8554/mystream +``` + +The resulting stream will be available in path `/mystream`. + +#### GStreamer + +GStreamer can publish a stream to the server in multiple ways (RTSP client, RTMP client, UDP/MPEG-TS, WebRTC with WHIP). The recommended one consists in publishing as a [RTSP client](#rtsp-clients): + +```sh +gst-launch-1.0 rtspclientsink name=s location=rtsp://localhost:8554/mystream filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! queue ! s.sink_0 d.audio_0 ! queue ! s.sink_1 +``` + +If the stream is video only: + +```sh +gst-launch-1.0 filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! rtspclientsink name=s location=rtsp://localhost:8554/mystream +``` + +The RTSP protocol supports multiple underlying transport protocols, each with its own characteristics (see [RTSP-specific features](#rtsp-specific-features)). You can set the transport protocol by using the `protocols` flag: + +```sh +gst-launch-1.0 filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! rtspclientsink protocols=tcp name=s location=rtsp://localhost:8554/mystream +``` + +The resulting stream will be available in path `/mystream`. + +#### OBS Studio + +OBS Studio can publish to the server as a [RTMP client](#rtmp-clients). In `Settings -> Stream` (or in the Auto-configuration Wizard), use the following parameters: + +* Service: `Custom...` +* Server: `rtmp://localhost` +* Stream key: `mystream` + +If credentials are in use, use the following parameters: + +* Service: `Custom...` +* Server: `rtmp://localhost` +* Stream key: `mystream?user=myuser&pass=mypass` + +Save the configuration and click `Start streaming`. + +If you want to generate a stream that can be read with WebRTC, open `Settings -> Output -> Recording` and use the following parameters: + +* FFmpeg output type: `Output to URL` +* File path or URL: `rtsp://localhost:8554/mystream` +* Container format: `rtsp` +* Check `show all codecs (even if potentically incompatible` +* Video encoder: `h264_nvenc (libx264)` +* Video encoder settings (if any): `bf=0` +* Audio track: `1` +* Audio encoder: `libopus` + +Then use the button `Start Recording` (instead of `Start Streaming`) to start streaming. + +Latest versions of OBS Studio can publish to the server with the [WebRTC / WHIP protocol](#webrtc). Use the following parameters: + +* Service: `WHIP` +* Server: `http://localhost:8889/mystream/whip` + +Save the configuration and click `Start streaming`. + +The resulting stream will be available in path `/mystream`. + +#### OpenCV + +OpenCV can publish to the server as a [RTSP client](#rtsp-clients). It must be compiled with GStreamer support, by following this procedure: + +```sh +sudo apt install -y libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev gstreamer1.0-plugins-ugly gstreamer1.0-rtsp python3-dev python3-numpy +git clone --depth=1 -b 4.5.4 https://github.com/opencv/opencv +cd opencv +mkdir build && cd build +cmake -D CMAKE_INSTALL_PREFIX=/usr -D WITH_GSTREAMER=ON .. +make -j$(nproc) +sudo make install +``` + +You can check that OpenCV has been installed correctly by running: + +```sh +python3 -c 'import cv2; print(cv2.getBuildInformation())' +``` + +Check that the output contains `GStreamer: YES`. + +Videos can be published with `VideoWriter`: + +```python +import cv2 +import numpy as np +from time import sleep, time + +fps = 15 +width = 800 +height = 600 +colors = [ + (0, 0, 255), + (255, 0, 0), + (0, 255, 0), +] + +out = cv2.VideoWriter('appsrc ! videoconvert' + \ + ' ! x264enc speed-preset=ultrafast bitrate=600 key-int-max=' + str(fps * 2) + \ + ' ! video/x-h264,profile=baseline' + \ + ' ! rtspclientsink location=rtsp://localhost:8554/mystream', + cv2.CAP_GSTREAMER, 0, fps, (width, height), True) +if not out.isOpened(): + raise Exception("can't open video writer") + +curcolor = 0 +start = time() + +while True: + frame = np.zeros((height, width, 3), np.uint8) + + # create a rectangle + color = colors[curcolor] + curcolor += 1 + curcolor %= len(colors) + for y in range(0, int(frame.shape[0] / 2)): + for x in range(0, int(frame.shape[1] / 2)): + frame[y][x] = color + + out.write(frame) + print("frame written to the server") + + now = time() + diff = (1 / fps) - now - start + if diff > 0: + sleep(diff) + start = now +``` + +The resulting stream will be available in path `/mystream`. + +#### Web browsers + +Web browsers can publish a stream to the server by using the [WebRTC protocol](#webrtc). Start the server and open the web page: + +``` +http://localhost:8889/mystream/publish +``` + +The resulting stream will be available in path `/mystream`. + +This web page can be embedded into another web page by using an iframe: + +```html + +``` + +For more advanced setups, you can create and serve a custom web page by starting from the [source code of the publish page](internal/core/webrtc_publish_index.html). + +### By device + +#### Generic webcam + +If the OS is Linux-based, edit `mediamtx.yml` and replace everything inside section `paths` with the following content: + +```yml +paths: + cam: + runOnInit: ffmpeg -f v4l2 -i /dev/video0 -pix_fmt yuv420p -preset ultrafast -b:v 600k -f rtsp rtsp://localhost:$RTSP_PORT/$MTX_PATH + runOnInitRestart: yes +``` + +If the OS is Windows: + +```yml +paths: + cam: + runOnInit: ffmpeg -f dshow -i video="USB2.0 HD UVC WebCam" -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -f rtsp rtsp://localhost:$RTSP_PORT/$MTX_PATH + runOnInitRestart: yes +``` + +Where `USB2.0 HD UVC WebCam` is the name of a webcam, that can be obtained with: + +```sh +ffmpeg -list_devices true -f dshow -i dummy +``` + +The resulting stream will be available in path `/cam`. + +#### Raspberry Pi Cameras + +_MediaMTX_ natively supports the Raspberry Pi Camera, enabling high-quality and low-latency video streaming from the camera to any user, for any purpose. There are a couple of requirements: + +1. The server must run on a Raspberry Pi, with Raspberry Pi OS bullseye or newer as operative system. Both 32 bit and 64 bit operative systems are supported. + +2. Make sure that the legacy camera stack is disabled. Type `sudo raspi-config`, then go to `Interfacing options`, `enable/disable legacy camera support`, choose `no`. Reboot the system. + +If you want to run the standard (non-Docker) version of the server: + +1. Make sure that the following packages are installed: + + * `libcamera0` (at least version 0.0.2) + * `libfreetype6` + +2. download the server executable. If you're using 64-bit version of the operative system, make sure to pick the `arm64` variant. + +3. edit `mediamtx.yml` and replace everything inside section `paths` with the following content: + + ```yml + paths: + cam: + source: rpiCamera + ``` + +The resulting stream will be available in path `/cam`. + +If you want to run the server inside Docker, you need to use the `latest-rpi` image (that already contains libcamera) and launch the container with some additional flags: + +```sh +docker run --rm -it \ +--network=host \ +--privileged \ +--tmpfs /dev/shm:exec \ +-v /run/udev:/run/udev:ro \ +-e MTX_PATHS_CAM_SOURCE=rpiCamera \ +bluenviron/mediamtx:latest-rpi +``` + +Camera settings can be changed by using the `rpiCamera*` parameters: + +```yml +paths: + cam: + source: rpiCamera + rpiCameraWidth: 1920 + rpiCameraHeight: 1080 +``` + +All available parameters are listed in the [sample configuration file](/mediamtx.yml). + +In order to add audio from a USB microfone, install GStreamer and alsa-utils: + +```sh +sudo apt install -y gstreamer1.0-tools gstreamer1.0-rtsp gstreamer1.0-alsa alsa-utils +``` + +list available audio cards with: + +```sh +arecord -L +``` + +Sample output: + +``` +surround51:CARD=ICH5,DEV=0 + Intel ICH5, Intel ICH5 + 5.1 Surround output to Front, Center, Rear and Subwoofer speakers +default:CARD=U0x46d0x809 + USB Device 0x46d:0x809, USB Audio + Default Audio Device +``` + +Find the audio card of the microfone and take note of its name, for instance `default:CARD=U0x46d0x809`. Then use GStreamer inside `runOnReady` to read the video stream, add audio and publish the new stream to another path: + +```yml +paths: + cam: + source: rpiCamera + runOnReady: > + gst-launch-1.0 + rtspclientsink name=s location=rtsp://localhost:$RTSP_PORT/cam_with_audio + rtspsrc location=rtsp://127.0.0.1:$RTSP_PORT/$MTX_PATH latency=0 ! rtph264depay ! s. + alsasrc device=default:CARD=U0x46d0x809 ! opusenc bitrate=16000 ! s. + runOnReadyRestart: yes + cam_with_audio: +``` + +The resulting stream will be available in path `/cam_with_audio`. + +### By protocol + +#### WebRTC + +WebRTC is an API that makes use of a set of protocols and methods to connect two clients together and allow them to exchange real-time media or data streams. You can publish a stream with WebRTC and a web browser by visiting: + +``` +http://localhost:8889/mystream/publish +``` + +The resulting stream will be available in path `/mystream`. + +WHIP is a WebRTC extensions that allows to publish streams by using a URL, without passing through a web page. This allows to use WebRTC as a general purpose streaming protocol. If you are using a software that supports WHIP (for instance, latest versions of OBS Studio), you can publish a stream to the server by using this URL: + +``` +http://localhost:8889/mystream/whip +``` + +Depending on the network it may be difficult to establish a connection between server and clients, see [WebRTC-specific features](#webrtc-specific-features) for remediations. + +#### RTSP clients + +RTSP is a protocol that allows to publish and read streams. It supports different underlying transport protocols and allows to encrypt streams in transit (see [RTSP-specific features](#rtsp-specific-features)). In order to publish a stream with the RTSP protocol, you can use this URL: + +``` +rtsp://localhost:8554/mystream +``` + +The resulting stream will be available in path `/mystream`. + +#### RTSP cameras and servers + +Most IP cameras expose their video stream by using a RTSP server that is embedded into the camera itself. You can use _MediaMTX_ to connect to one or multiple existing RTSP servers and read their video streams: + +```yml +paths: + proxied: + # url of the source stream, in the format rtsp://user:pass@host:port/path + source: rtsp://original-url +``` + +The resulting stream will be available in path `/proxied`. + +The server supports any number of source streams (count is just limited by hardware capability) it's enough to add additional entries to the paths section: + +```yml +paths: + proxied1: + source: rtsp://url1 + + proxied2: + source: rtsp://url1 +``` + +#### RTMP clients + +RTMP is a protocol that allows to read and publish streams, but is less versatile and less efficient than RTSP and WebRTC (doesn't support UDP, doesn't support most RTSP codecs, doesn't support feedback mechanism). Streams can be published to the server by using the URL: + +``` +rtmp://localhost/mystream +``` + +The resulting stream will be available in path `/mystream`. + +#### RTMP cameras and servers + +You can use _MediaMTX_ to connect to one or multiple existing RTMP servers and read their video streams: + +```yml +paths: + proxied: + # url of the source stream, in the format rtmp://user:pass@host:port/path + source: rtmp://original-url +``` + +The resulting stream will be available in path `/proxied`. + +#### HLS cameras and servers + +HLS is a streaming protocol that works by splitting streams into segments, and by serving these segments and a playlist with the HTTP protocol. You can use _MediaMTX_ to connect to one or multiple existing HLS servers and read their video streams: + +```yml +paths: + proxied: + # url of the playlist of the stream, in the format http://user:pass@host:port/path + source: http://original-url/stream/index.m3u8 +``` + +The resulting stream will be available in path `/proxied`. + +#### UDP/MPEG-TS + +The server supports ingesting UDP/MPEG-TS packets (i.e. MPEG-TS packets sent with UDP). Packets can be unicast, broadcast or multicast. For instance, you can generate a multicast UDP/MPEG-TS stream with GStreamer: + +``` +gst-launch-1.0 -v mpegtsmux name=mux alignment=1 ! udpsink host=238.0.0.1 port=1234 \ +videotestsrc ! video/x-raw,width=1280,height=720 ! x264enc speed-preset=ultrafast bitrate=3000 key-int-max=60 ! video/x-h264,profile=high ! mux. \ +audiotestsrc ! audioconvert ! avenc_aac ! mux. +``` + +Edit `mediamtx.yml` and replace everything inside section `paths` with the following content: + +```yml +paths: + udp: + source: udp://238.0.0.1:1234 +``` + +The resulting stream will be available in path `/udp`. + +## Read from the server + +### By software + +#### FFmpeg + +FFmpeg can read a stream from the server in multiple ways (RTSP, RTMP, HLS, WebRTC with WHEP). The recommended one consists in reading with [RTSP](#rtsp): + +```sh +ffmpeg -i rtsp://localhost:8554/mystream -c copy output.mp4 +``` + +The RTSP protocol supports multiple underlying transport protocols, each with its own characteristics (see [RTSP-specific features](#rtsp-specific-features)). You can set the transport protocol by using the `rtsp_transport` flag: + +```sh +ffmpeg -rtsp_transport tcp -i rtsp://localhost:8554/mystream -c copy output.mp4 +``` + +#### GStreamer + +GStreamer can read a stream from the server in multiple ways (RTSP, RTMP, HLS, WebRTC with WHEP). The recommended one consists in reading with [RTSP](#rtsp): + +```sh +gst-launch-1.0 rtspsrc location=rtsp://127.0.0.1:8554/mystream latency=0 ! decodebin ! autovideosink +``` + +The RTSP protocol supports multiple underlying transport protocols, each with its own characteristics (see [RTSP-specific features](#rtsp-specific-features)). You can change the transport protocol by using the `protocols` flag: + +```sh +gst-launch-1.0 rtspsrc protocols=tcp location=rtsp://127.0.0.1:8554/mystream latency=0 ! decodebin ! autovideosink +``` + +If encryption is enabled, set `tls-validation-flags` to `0`: + +```sh +gst-launch-1.0 rtspsrc tls-validation-flags=0 location=rtsps://ip:8322/... +``` + +#### VLC + +VLC can read a stream from the server in multiple ways (RTSP, RTMP, HLS). The recommended one consists in reading with [RTSP](#rtsp): + +```sh +vlc --network-caching=50 rtsp://localhost:8554/mystream +``` + +The RTSP protocol supports multiple underlying transport protocols, each with its own characteristics (see [RTSP-specific features](#rtsp-specific-features)). + +In order to use the TCP transport protocol, use the `--rtsp_tcp` flag: + +```sh +vlc --network-caching=50 --rtsp-tcp rtsp://localhost:8554/mystream +``` + +In order to use the UDP-multicast transport protocol, append `?vlcmulticast` to the URL: + +```sh +vlc --network-caching=50 rtsp://localhost:8554/mystream?vlcmulticast +``` + +You can change the transport protocol by using the `--rtsp_` flag: + +##### Ubuntu bug + +The VLC shipped with Ubuntu 21.10 doesn't support playing RTSP due to a license issue (see [here](https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=982299) and [here](https://stackoverflow.com/questions/69766748/cvlc-cannot-play-rtsp-omxplayer-instead-can)). To fix the issue, remove the default VLC instance and install the snap version: + +``` +sudo apt purge -y vlc +snap install vlc +``` + +##### Encrypted streams + +At the moment VLC doesn't support reading encrypted RTSP streams. However, you can use a proxy like [stunnel](https://www.stunnel.org) or [nginx](https://nginx.org/) to decrypt streams before reading them. + +#### Web browsers + +Web browsers can read a stream from the server in multiple ways (WebRTC or HLS). + +You can read a stream by using the [WebRTC protocol](#webrtc-1) by visiting the web page: + +``` +http://localhost:8889/mystream +``` + +This web page can be embedded into another web page by using an iframe: + +```html + +``` + +For more advanced setups, you can create and serve a custom web page by starting from the [source code of the read page](internal/core/webrtc_read_index.html). + +Web browsers can also read a stream with the [HLS protocol](#hls). Latency is higher but there are less problems related to connectivity between server and clients, furthermore the server load can be balanced by using a common HTTP CDN (like CloudFront or Cloudflare), and this allows to handle readers in the order of millions. Visit the web page: + +``` +http://localhost:8888/mystream +``` + +This web page can be embedded into another web page by using an iframe: + +```html + +``` + +### By protocol + +#### WebRTC + +WebRTC is an API that makes use of a set of protocols and methods to connect two clients together and allow them to exchange real-time media or data streams. You can read a stream with WebRTC and a web browser by visiting: + +``` +http://localhost:8889/mystream +``` + +WHEP is a WebRTC extensions that allows to read streams by using a URL, without passing through a web page. This allows to use WebRTC as a general purpose streaming protocol. If you are using a software that supports WHEP, you can read a stream from the server by using this URL: + +``` +http://localhost:8889/mystream/whep +``` + +Depending on the network it may be difficult to establish a connection between server and clients, see [WebRTC-specific features](#webrtc-specific-features) for remediations. + +#### RTSP + +RTSP is a protocol that allows to publish and read streams. It supports different underlying transport protocols and allows to encrypt streams in transit (see [RTSP-specific features](#rtsp-specific-features)). In order to read a stream with the RTSP protocol, you can use this URL: + +``` +rtsp://localhost:8554/mystream +``` + +##### Latency + +The RTSP protocol doesn't introduce any latency by itself. Latency is usually introduced by clients, that put frames in a buffer to compensate network fluctuations. In order to decrease latency, the best way consists in tuning the client. For instance, latency can be decreased with VLC by decreasing the Network caching parameter, that is available in the Open network stream dialog or alternatively ca be set with the command line: + +``` +vlc --network-caching=50 rtsp://... +``` + +##### Corrupted frames + +In some scenarios, when reading from the server with RTSP, decoded frames can be corrupted or incomplete. This can be caused by multiple reasons: + +* the packet buffer of the server is too small and can't keep up with the stream throughput. A solution consists in increasing its size: + + ```yml + readBufferCount: 1024 + ``` + +* The stream throughput is too big and the stream can't be sent correctly with the UDP transport. UDP is more performant, faster and more efficient than TCP, but doesn't have a retransmission mechanism, that is needed in case of streams that need a large bandwidth. A solution consists in switching to TCP: + + ```yml + protocols: [tcp] + ``` + + In case the source is a camera: + + ```yml + paths: + test: + source: rtsp://.. + sourceProtocol: tcp + ``` + +* The stream throughput is too big to be handled by the network between server and readers. Upgrade the network or decrease the stream bitrate by re-encoding it. + +#### RTMP + +RTMP is a protocol that allows to read and publish streams, but is less versatile and less efficient than RTSP and WebRTC ((doesn't support UDP, doesn't support most RTSP codecs, doesn't support feedback mechanism)). Streams can be read from the server by using the URL: + +``` +rtmp://localhost/mystream +``` + +#### HLS + +HLS is a protocol that works by splitting streams into segments, and by serving these segments and a playlist with the HTTP protocol. You can use _MediaMTX_ to generate a HLS stream, that is accessible through a web page: + +``` +http://localhost:8888/mystream +``` + +and can also be accessed without using the browsers, by software that supports the HLS protocol (for instance VLC or _MediaMTX_ itself) by using this URL: + +``` +http://localhost:8888/mystream/index.m3u8 +``` + +Although the server can produce HLS with a variety of video and audio codecs (that are listed at the beginning of the README), not all browsers can read all codecs. You can check what codecs your browser can read by visiting this page: + + + +If you want to support most browsers, you can to re-encode the stream by using the H264 and AAC codecs, for instance by using FFmpeg: + +```sh +ffmpeg -i rtsp://original-source -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -c:a aac -b:a 160k -f rtsp rtsp://localhost:8554/mystream +``` + +##### LL-HLS + +Low-Latency HLS is a recently standardized variant of the protocol that allows to greatly reduce playback latency. It works by splitting segments into parts, that are served before the segment is complete. LL-HLS is enabled by default. If the stream is not shown correctly, try tuning the hlsPartDuration parameter, for instance: + +```yml +hlsPartDuration: 500ms +``` + +##### Compatibility with Apple devices + +In order to correctly display Low-Latency HLS streams in Safari running on Apple devices (iOS or macOS), a TLS certificate is needed and can be generated with OpenSSL: + +```sh +openssl genrsa -out server.key 2048 +openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650 +``` + +Set the `hlsEncryption`, `hlsServerKey` and `hlsServerCert` parameters in the configuration file: + +```yml +hlsEncryption: yes +hlsServerKey: server.key +hlsServerCert: server.crt +``` + +Keep also in mind that not all H264 video streams can be played on Apple Devices due to some intrinsic properties (distance between I-Frames, profile). If the video can't be played correctly, you can either: + +* re-encode it by following instructions in this README +* disable the Low-latency variant of HLS and go back to the legacy variant: + + ```yml + hlsVariant: mpegts + ``` + +##### Latency + +in HLS, latency is introduced since a client must wait for the server to generate segments before downloading them. This latency amounts to 500ms-3s when the low-latency HLS variant is enabled (and it is by default), otherwise amounts to 1-15secs. + +To decrease the latency, you can: + +* try decreasing the hlsPartDuration parameter +* try decreasing the hlsSegmentDuration parameter +* The segment duration is influenced by the interval between the IDR frames of the video track. An IDR frame is a frame that can be decoded independently from the others. The server changes the segment duration in order to include at least one IDR frame into each segment. Therefore, you need to decrease the interval between the IDR frames. This can be done in two ways: + + * if the stream is being hardware-generated (i.e. by a camera), there's usually a setting called Key-Frame Interval in the camera configuration page + * otherwise, the stream must be re-encoded. It's possible to tune the IDR frame interval by using ffmpeg's -g option: + + ```sh + ffmpeg -i rtsp://original-stream -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -max_muxing_queue_size 1024 -g 30 -f rtsp rtsp://localhost:$RTSP_PORT/compressed + ``` + +## Features ### Configuration @@ -260,6 +907,7 @@ There are 3 ways to change the configuration: ``` Parameters that have array as value can be overriden by setting a comma-separated list. For example: + ``` MTX_PROTOCOLS="tcp,udp" ``` @@ -276,7 +924,7 @@ There are 3 ways to change the configuration: docker run --rm -it --network=host -e MTX_PATHS_TEST_SOURCE=rtsp://myurl bluenviron/mediamtx ``` -3. By using the [HTTP API](#http-api). +3. By using the [API](#api). ### Authentication @@ -322,7 +970,7 @@ paths: readPass: sha256:BdSWkrdV+ZxFBLUQQY7+7uv9RmiSVA8nrPmjGjJtZQQ= ``` -**WARNING**: enable encryption or use a VPN to ensure that no one is intercepting the credentials. +**WARNING**: enable encryption or use a VPN to ensure that no one is intercepting the credentials in transit. Authentication can be delegated to an external HTTP server: @@ -378,42 +1026,6 @@ After performing the encryption, put the base64-encoded result into the configur MTX_CONFKEY=mykey ./mediamtx ``` -### Proxy mode - -_MediaMTX_ is also a proxy, that is usually deployed in one of these scenarios: - -* when there are multiple users that are reading a stream and the bandwidth is limited; the proxy is used to receive the stream once. Users can then connect to the proxy instead of the original source. -* when there's a NAT / firewall between a stream and the users; the proxy is installed on the NAT and makes the stream available to the outside world. - -Edit `mediamtx.yml` and replace everything inside section `paths` with the following content: - -```yml -paths: - proxied: - # url of the source stream, in the format rtsp://user:pass@host:port/path - source: rtsp://original-url -``` - -After starting the server, users can connect to `rtsp://localhost:8554/proxied`, instead of connecting to the original url. The server supports any number of source streams, it's enough to add additional entries to the `paths` section: - -```yml -paths: - proxied1: - source: rtsp://url1 - - proxied2: - source: rtsp://url1 -``` - -It's possible to save bandwidth by enabling the on-demand mode: the stream will be pulled only when at least a client is connected: - -```yml -paths: - proxied: - source: rtsp://original-url - sourceOnDemand: yes -``` - ### Remuxing, re-encoding, compression To change the format, codec or compression of a stream, use _FFmpeg_ or _GStreamer_ together with _MediaMTX_. For instance, to re-encode an existing stream, that is available in the `/original` path, and publish the resulting stream in the `/compressed` path, edit `mediamtx.yml` and replace everything inside section `paths` with the following content: @@ -454,20 +1066,20 @@ The command inserted into `runOnDemand` will start only when a client requests t ### Start on boot -#### Linux +#### Linux* Systemd is the service manager used by Ubuntu, Debian and many other Linux distributions, and allows to launch _MediaMTX_ on boot. Download a release bundle from the [release page](https://github.com/bluenviron/mediamtx/releases), unzip it, and move the executable and configuration in the system: -``` +```sh sudo mv mediamtx /usr/local/bin/ sudo mv mediamtx.yml /usr/local/etc/ ``` Create the service: -``` +```sh sudo tee /etc/systemd/system/mediamtx.service >/dev/null << EOF [Unit] Wants=network.target @@ -480,13 +1092,13 @@ EOF Enable and start the service: -``` +```sh sudo systemctl daemon-reload sudo systemctl enable mediamtx sudo systemctl start mediamtx ``` -#### Windows +#### Windows* Download the [WinSW v2 executable](https://github.com/winsw/winsw/releases/download/v2.11.0/WinSW-x64.exe) and place it into the same folder of `mediamtx.exe`. @@ -509,9 +1121,136 @@ WinSW-x64 install The server is now installed as a system service and will start at boot time. -### HTTP API +### RTSP-specific features -The server can be queried and controlled with an HTTP API, that must be enabled by setting the `api` parameter in the configuration: +#### Transport protocols + +The RTSP protocol supports different underlying transport protocols, that are chosen by clients during the handshake with the server: + +* UDP: the most performant, but doesn't work when there's a NAT/firewall between server and clients. It doesn't support encryption. +* UDP-multicast: allows to save bandwidth when clients are all in the same LAN, by sending packets once to a fixed multicast IP. It doesn't support encryption. +* TCP: the most versatile, does support encryption. + +The default transport protocol is UDP. To change the transport protocol, you have to tune the configuration of your client of choice. + +#### Encryption + +Incoming and outgoing RTSP streams can be encrypted with TLS (obtaining the RTSPS protocol). A TLS certificate is needed and can be generated with OpenSSL: + +```sh +openssl genrsa -out server.key 2048 +openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650 +``` + +Edit `mediamtx.yml`, and set the `protocols`, `encryption`, `serverKey` and serverCert parameters: + +```yml +protocols: [tcp] +encryption: optional +serverKey: server.key +serverCert: server.crt +``` + +Streams can be published and read with the `rtsps` scheme and the `8322` port: + +``` +rtsps://localhost:8322/mystream +``` + +### RTMP-specific features + +#### Encryption + +RTMP connections can be encrypted with TLS, obtaining the RTMPS protocol. A TLS certificate is needed and can be generated with OpenSSL: + +```yml +openssl genrsa -out server.key 2048 +openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650 +``` + +Edit mediamtx.yml, and set the `rtmpEncryption`, `rtmpServerKey` and `rtmpServerCert` parameters: + +```yml +rtmpEncryption: optional +rtmpServerKey: server.key +rtmpServerCert: server.crt +``` + +Streams can be published and read with the rtmps scheme and the 1937 port: + +``` +rtmps://localhost:1937/... +``` + +Be aware that RTMPS is currently unsupported by all major players. However, you can use a proxy like [stunnel](https://www.stunnel.org) or [nginx](https://nginx.org/) to decrypt streams before reading them. + +### WebRTC-specific features + +#### Connectivity issues + +If the server is hosted inside a container or is behind a NAT, additional configuration is required in order to allow the two WebRTC parts (the browser and the server) to establish a connection (WebRTC/ICE connection). + +A first method consists into forcing all WebRTC/ICE connections to pass through a single UDP server port, by using the parameters: + +```yml +# public IP of the server +webrtcICEHostNAT1To1IPs: [192.168.x.x] +# any port of choice +webrtcICEUDPMuxAddress: :8189 +``` + +The NAT / container must then be configured in order to route all incoming UDP packets on port 8189 to the server. If you're using Docker, this can be achieved with the flag: + +```sh +docker run --rm -it \ +-p 8189:8189/udp +.... +bluenviron/mediamtx +``` + +If the UDP protocol is blocked by a firewall, all WebRTC/ICE connections can be forced to pass through a single TCP server port: + +```yml +# public IP of the server +webrtcICEHostNAT1To1IPs: [192.168.x.x] +# any port of choice +webrtcICETCPPMuxAddress: :8189 +``` + +The NAT / container must then be configured in order to redirect all incoming TCP packets on port 8189 to the server. If you're using Docker, this can be achieved with the flag: + +```sh +docker run --rm -it \ +-p 8189:8189 +.... +bluenviron/mediamtx +``` + +Finally, if none of these methods work, you can force all WebRTC/ICE connections to pass through a TURN server, like coturn, that must be configured externally. The server address and credentials must be set in the configuration file: + +```yml +webrtcICEServers2: +- url: turn:host:port + username: user + password: password +``` + +Where user and pass are the username and password of the server. Note that port is not optional. + +If the server uses a secret-based authentication (for instance, coturn with the use-auth-secret option), it must be configured by using AUTH_SECRET as username, and the secret as password: + +```yml +webrtcICEServers2: +- url: turn:host:port + username: AUTH_SECRET + password: secret +``` + +where secret is the secret of the TURN server. MediaMTX will generate a set of credentials by using the secret, and credentials will be sent to clients before the WebRTC/ICE connection is established. + +### API + +The server can be queried and controlled with its API, that must be enabled by setting the `api` parameter in the configuration: ```yml api: yes @@ -530,7 +1269,7 @@ Full documentation of the API is available on the [dedicated site](https://bluen A metrics exporter, compatible with [Prometheus](https://prometheus.io/), can be enabled with the parameter `metrics: yes`; then the server can be queried for metrics with Prometheus or with a simple HTTP request: ``` -wget -qO- localhost:9998/metrics +curl localhost:9998/metrics ``` Obtaining: @@ -585,9 +1324,9 @@ go tool pprof -text http://localhost:9999/debug/pprof/heap go tool pprof -text http://localhost:9999/debug/pprof/profile?seconds=30 ``` -### Compile from source +## Compile from source -#### Standard +### Standard Install Go ≥ 1.20, download the repository, open a terminal in it and run: @@ -597,9 +1336,9 @@ go build . The command will produce the `mediamtx` binary. -#### Raspberry Pi +### Raspberry Pi -The server can be compiled with native support for the Raspberry Pi Camera. Compilation must happen on a Raspberry Pi Device, with the following dependencies: +The server can be compiled with native support for the Raspberry Pi Camera. Compilation must be performed on a Raspberry Pi, with the following dependencies: * Go ≥ 1.20 * `libcamera-dev` @@ -618,9 +1357,9 @@ go build -tags rpicamera . The command will produce the `mediamtx` binary. -#### Compile for all supported platforms +### Compile for all supported platforms -Compilation for all supported platform can be launched by using: +Install Docker and launch: ```sh make binaries @@ -628,679 +1367,10 @@ make binaries The command will produce tarballs in folder `binaries/`. -## Publish to the server - -### From a webcam - -To publish the video stream of a generic webcam to the server, edit `mediamtx.yml` and replace everything inside section `paths` with the following content: - -```yml -paths: - cam: - runOnInit: ffmpeg -f v4l2 -i /dev/video0 -pix_fmt yuv420p -preset ultrafast -b:v 600k -f rtsp rtsp://localhost:$RTSP_PORT/$MTX_PATH - runOnInitRestart: yes -``` - -If the platform is Windows: - -```yml -paths: - cam: - runOnInit: ffmpeg -f dshow -i video="USB2.0 HD UVC WebCam" -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -f rtsp rtsp://localhost:$RTSP_PORT/$MTX_PATH - runOnInitRestart: yes -``` - -Where `USB2.0 HD UVC WebCam` is the name of your webcam, that can be obtained with: - -``` -ffmpeg -list_devices true -f dshow -i dummy -``` - -After starting the server, the webcam can be reached on `rtsp://localhost:8554/cam`. - -### From a Raspberry Pi Camera - -_MediaMTX_ natively support the Raspberry Pi Camera, enabling high-quality and low-latency video streaming from the camera to any user. There are a couple of requirements: - -1. The server must run on a Raspberry Pi, with Raspberry Pi OS bullseye or newer as operative system. Both 32 bit and 64 bit operative systems are supported. - -2. Make sure that the legacy camera stack is disabled. Type `sudo raspi-config`, then go to `Interfacing options`, `enable/disable legacy camera support`, choose `no`. Reboot the system. - -If you want to run the standard (non-containerized) version of the server: - -1. Make sure that the following packages are installed: - - * `libcamera0` (at least version 0.0.2) - * `libfreetype6` - -2. download the server executable. If you're using 64-bit version of the operative system, make sure to pick the `arm64` variant. - -3. edit `mediamtx.yml` and replace everything inside section `paths` with the following content: - - ```yml - paths: - cam: - source: rpiCamera - ``` - -If you want to run the server with Docker, you need to use the `latest-rpi` image (that already contains libcamera) and set some additional flags: - -``` -docker run --rm -it \ ---network=host \ ---privileged \ ---tmpfs /dev/shm:exec \ --v /run/udev:/run/udev:ro \ --e MTX_PATHS_CAM_SOURCE=rpiCamera \ -bluenviron/mediamtx:latest-rpi -``` - -After starting the server, the camera can be reached on path `/cam` (`http://raspberry-pi:8889/cam`, `http://raspberry-pi:8888/cam`, `rtsp://raspberry-pi:8554/cam` or `rtmp://raspberry-pi:1935/cam`). - -Camera settings can be changed by using the `rpiCamera*` parameters: - -```yml -paths: - cam: - source: rpiCamera - rpiCameraWidth: 1920 - rpiCameraHeight: 1080 -``` - -All available parameters are listed in the [sample configuration file](/mediamtx.yml). - -In order to add audio from a USB microfone, install GStreamer and alsa-utils: - -```sh -sudo apt install -y gstreamer1.0-tools gstreamer1.0-rtsp gstreamer1.0-alsa alsa-utils -``` - -list available audio cards with: - -```sh -arecord -L -``` - -Sample output: - -``` -surround51:CARD=ICH5,DEV=0 - Intel ICH5, Intel ICH5 - 5.1 Surround output to Front, Center, Rear and Subwoofer speakers -default:CARD=U0x46d0x809 - USB Device 0x46d:0x809, USB Audio - Default Audio Device -``` - -Find the audio card of the microfone and take note of its name, for instance `default:CARD=U0x46d0x809`. Then use GStreamer inside `runOnReady` to read the video stream, add audio and publish the new stream to another path: - -```yml -paths: - cam: - source: rpiCamera - runOnReady: > - gst-launch-1.0 - rtspclientsink name=s location=rtsp://localhost:$RTSP_PORT/cam_with_audio - rtspsrc location=rtsp://127.0.0.1:$RTSP_PORT/$MTX_PATH latency=0 ! rtph264depay ! s. - alsasrc device=default:CARD=U0x46d0x809 ! opusenc bitrate=16000 ! s. - runOnReadyRestart: yes - cam_with_audio: -``` - -Stream with video and audio will be available in path `/cam_with_audio`. - -### From OBS Studio - -OBS Studio can publish to the server by using the RTMP protocol. In `Settings -> Stream` (or in the Auto-configuration Wizard), use the following parameters: - -* Service: `Custom...` -* Server: `rtmp://localhost` -* Stream key: `mystream` - -If credentials are in use, use the following parameters: - -* Service: `Custom...` -* Server: `rtmp://localhost` -* Stream key: `mystream?user=myuser&pass=mypass` - -If you want to generate a stream that can be read with WebRTC, open `Settings -> Output -> Recording` and use the following parameters: - -* FFmpeg output type: `Output to URL` -* File path or URL: `rtsp://localhost:8554/mystream` -* Container format: `rtsp` -* Check `show all codecs (even if potentically incompatible` -* Video encoder: `h264_nvenc (libx264)` -* Video encoder settings (if any): `bf=0` -* Audio track: `1` -* Audio encoder: `libopus` - -The use the button `Start Recording` (instead of `Start Streaming`) to start streaming. - -### From OpenCV - -To publish a video stream from OpenCV to the server, OpenCV must be compiled with GStreamer support, by following this procedure: - -``` -sudo apt install -y libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev gstreamer1.0-plugins-ugly gstreamer1.0-rtsp python3-dev python3-numpy -git clone --depth=1 -b 4.5.4 https://github.com/opencv/opencv -cd opencv -mkdir build && cd build -cmake -D CMAKE_INSTALL_PREFIX=/usr -D WITH_GSTREAMER=ON .. -make -j$(nproc) -sudo make install -``` - -You can check that OpenCV has been installed correctly by running: - -``` -python3 -c 'import cv2; print(cv2.getBuildInformation())' -``` - -And verifying that the output contains `GStreamer: YES`. - -Videos can be published with `VideoWriter`: - -```python -import cv2 -import numpy as np -from time import sleep, time - -fps = 15 -width = 800 -height = 600 -colors = [ - (0, 0, 255), - (255, 0, 0), - (0, 255, 0), -] - -out = cv2.VideoWriter('appsrc ! videoconvert' + \ - ' ! x264enc speed-preset=ultrafast bitrate=600 key-int-max=' + str(fps * 2) + \ - ' ! video/x-h264,profile=baseline' + \ - ' ! rtspclientsink location=rtsp://localhost:8554/mystream', - cv2.CAP_GSTREAMER, 0, fps, (width, height), True) -if not out.isOpened(): - raise Exception("can't open video writer") - -curcolor = 0 -start = time() - -while True: - frame = np.zeros((height, width, 3), np.uint8) - - # create a rectangle - color = colors[curcolor] - curcolor += 1 - curcolor %= len(colors) - for y in range(0, int(frame.shape[0] / 2)): - for x in range(0, int(frame.shape[1] / 2)): - frame[y][x] = color - - out.write(frame) - print("frame written to the server") - - now = time() - diff = (1 / fps) - now - start - if diff > 0: - sleep(diff) - start = now -``` - -### From a UDP stream - -The server supports ingesting UDP/MPEG-TS packets (i.e. MPEG-TS packets sent with UDP). Packets can be unicast, broadcast or multicast. For instance, you can generate a multicast UDP/MPEG-TS stream with: - -``` -gst-launch-1.0 -v mpegtsmux name=mux alignment=1 ! udpsink host=238.0.0.1 port=1234 \ -videotestsrc ! video/x-raw,width=1280,height=720 ! x264enc speed-preset=ultrafast bitrate=3000 key-int-max=60 ! video/x-h264,profile=high ! mux. \ -audiotestsrc ! audioconvert ! avenc_aac ! mux. -``` - -Edit `mediamtx.yml` and replace everything inside section `paths` with the following content: - -```yml -paths: - udp: - source: udp://238.0.0.1:1234 -``` - -After starting the server, the stream can be reached on `rtsp://localhost:8554/udp`. - -### From the browser - -Open the page into the browser: - -``` -http://localhost:8889/mystream/publish -``` - -## Read from the server - -### From VLC and Ubuntu - -The VLC shipped with Ubuntu 21.10 doesn't support playing RTSP due to a license issue (see [here](https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=982299) and [here](https://stackoverflow.com/questions/69766748/cvlc-cannot-play-rtsp-omxplayer-instead-can)). - -To overcome the issue, remove the default VLC instance and install the snap version: - -``` -sudo apt purge -y vlc -snap install vlc -``` - -Then use it to read the stream: - -``` -vlc rtsp://localhost:8554/mystream -``` - -## RTSP protocol - -### General usage - -RTSP is a standardized protocol that allows to publish and read streams; in particular, it supports different underlying transport protocols, that are chosen by clients during the handshake with the server: - -* UDP: the most performant, but doesn't work when there's a NAT/firewall between server and clients. It doesn't support encryption. -* UDP-multicast: allows to save bandwidth when clients are all in the same LAN, by sending packets once to a fixed multicast IP. It doesn't support encryption. -* TCP: the most versatile, does support encryption. - -The default transport protocol is UDP. To change the transport protocol, you have to tune the configuration of your client of choice. - -### TCP transport - -The RTSP protocol supports the TCP transport protocol, that allows to receive packets even when there's a NAT/firewall between server and clients, and supports encryption (see [Encryption](#encryption)). - -You can use _FFmpeg_ to publish a stream with the TCP transport protocol: - -``` -ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp -rtsp_transport tcp rtsp://localhost:8554/mystream -``` - -You can use _FFmpeg_ to read that stream with the TCP transport protocol: - -``` -ffmpeg -rtsp_transport tcp -i rtsp://localhost:8554/mystream -c copy output.mp4 -``` - -You can use _GStreamer_ to read that stream with the TCP transport protocol: - -``` -gst-launch-1.0 rtspsrc protocols=tcp location=rtsp://localhost:8554/mystream ! fakesink -``` - -You can use _VLC_ to read that stream with the TCP transport protocol: - -``` -vlc --rtsp-tcp rtsp://localhost:8554/mystream -``` - -### UDP-multicast transport - -The RTSP protocol supports the UDP-multicast transport protocol, that allows a server to send packets once, regardless of the number of connected readers, saving bandwidth. - -This mode must be requested by readers when handshaking with the server; once a reader has completed a handshake, the server will start sending multicast packets. Other readers will be instructed to read existing multicast packets. When all multicast readers have disconnected from the server, the latter will stop sending multicast packets. - -If you want to use the UDP-multicast protocol in a Wireless LAN, please be aware that the maximum bitrate supported by multicast is the one that corresponds to the lowest enabled WiFi data rate. For instance, if the 1 Mbps data rate is enabled on your router (and it is on most routers), the maximum bitrate will be 1 Mbps. To increase the maximum bitrate, use a cabled LAN or change your router settings. - -To request and read a stream with UDP-multicast, you can use _FFmpeg_: - -``` -ffmpeg -rtsp_transport udp_multicast -i rtsp://localhost:8554/mystream -c copy output.mp4 -``` - -or _GStreamer_: - -``` -gst-launch-1.0 rtspsrc protocols=udp-mcast location=rtsps://ip:8554/... -``` - -or _VLC_ (append `?vlcmulticast` to the URL): - -``` -vlc rtsp://localhost:8554/mystream?vlcmulticast -``` - -### Encryption - -Incoming and outgoing RTSP streams can be encrypted with TLS (obtaining the RTSPS protocol). A TLS certificate is needed and can be generated with OpenSSL: - -``` -openssl genrsa -out server.key 2048 -openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650 -``` - -Edit `mediamtx.yml`, and set the `protocols`, `encryption`, `serverKey` and `serverCert` parameters: - -```yml -protocols: [tcp] -encryption: optional -serverKey: server.key -serverCert: server.crt -``` - -Streams can be published and read with the `rtsps` scheme and the `8322` port: - -``` -ffmpeg -i rtsps://ip:8322/... -``` - -If the client is _GStreamer_, disable the certificate validation: - -``` -gst-launch-1.0 rtspsrc tls-validation-flags=0 location=rtsps://ip:8322/... -``` - -At the moment _VLC_ doesn't support reading encrypted RTSP streams. A workaround consists in launching an instance of _MediaMTX_ on the same machine in which _VLC_ is running, using it for reading the encrypted stream with the proxy mode, and reading the proxied stream with _VLC_. - -### Redirect to another server - -To redirect to another server, use the `redirect` source: - -```yml -paths: - redirected: - source: redirect - sourceRedirect: rtsp://otherurl/otherpath -``` - -### Fallback stream - -If no one is publishing to the server, readers can be redirected to a fallback path or URL that is serving a fallback stream: - -```yml -paths: - withfallback: - fallback: /otherpath -``` - -### Corrupted frames - -In some scenarios, when reading RTSP from the server, decoded frames can be corrupted or incomplete. This can be caused by multiple reasons: - -* the packet buffer of the server is too small and can't keep up with the stream throughput. A solution consists in increasing its size: - - ```yml - readBufferCount: 1024 - ``` - -* The stream throughput is too big and the stream can't be sent correctly with the UDP transport. UDP is more performant, faster and more efficient than TCP, but doesn't have a retransmission mechanism, that is needed in case of streams that need a large bandwidth. A solution consists in switching to TCP: - - ```yml - protocols: [tcp] - ``` - - In case the source is a camera: - - ```yml - paths: - test: - source: rtsp://.. - sourceProtocol: tcp - ``` - -* The stream throughput is too big to be handled by the network between server and readers. Upgrade the network or decrease the stream bitrate by re-encoding it. - -### Decrease latency - -The RTSP protocol doesn't introduce any latency by itself. Latency is usually introduced by clients, that put frames in a buffer to compensate network fluctuations. In order to decrease latency, the best way consists in tuning the client. For instance, latency can be decreased with VLC by decreasing the `Network caching` parameter, that is available in the `Open network stream` dialog or alternatively ca be set with the command line: - -``` -vlc --network-caching=50 rtsp://... -``` - -## RTMP protocol - -### General usage - -RTMP is a protocol that allows to read and publish streams, but is less versatile and less efficient than RTSP (doesn't support UDP, encryption, doesn't support most RTSP codecs, doesn't support feedback mechanism). It is used when there's need of publishing or reading streams from a software that supports RTMP only (for instance, OBS Studio and DJI drones). - -Streams can be published or read with the RTMP protocol, for instance with _FFmpeg_: - -``` -ffmpeg -re -stream_loop -1 -i file.ts -c copy -f flv rtmp://localhost/mystream -``` - -or _GStreamer_: - -``` -gst-launch-1.0 -v flvmux name=s ! rtmpsink location=rtmp://localhost/mystream filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! queue ! s.video d.audio_0 ! queue ! s.audio -``` - -Credentials can be provided by appending to the URL the `user` and `pass` parameters: - -``` -ffmpeg -re -stream_loop -1 -i file.ts -c copy -f flv rtmp://localhost:8554/mystream?user=myuser&pass=mypass -``` - -### Encryption - -RTMP connections can be encrypted with TLS, obtaining the RTMPS protocol. A TLS certificate is needed and can be generated with OpenSSL: - -``` -openssl genrsa -out server.key 2048 -openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650 -``` - -Edit `mediamtx.yml`, and set the `rtmpEncryption`, `rtmpServerKey` and `rtmpServerCert` parameters: - -```yml -rtmpEncryption: optional -rtmpServerKey: server.key -rtmpServerCert: server.crt -``` - -Streams can be published and read with the `rtmps` scheme and the `1937` port: - -``` -rtmps://localhost:1937/... -``` - -Please be aware that RTMPS is currently unsupported by _VLC_, _FFmpeg_ and _GStreamer_. However, you can use a proxy like [stunnel](https://www.stunnel.org/) or [nginx](https://nginx.org/) to allow RTMP clients to access RTMPS resources. - -## HLS protocol - -### General usage - -HLS is a protocol that allows to embed live streams into web pages. It works by splitting streams into segments, and by serving these segments with the HTTP protocol. Every stream published to the server can be accessed by visiting: - -``` -http://localhost:8888/mystream -``` - -where `mystream` is the name of a stream that is being published. - -### Browser support - -Although the server can produce HLS with a variety of video and audio codecs (that are listed at the beginning of the README), not all browsers can read all codecs. You can check what codecs your browser can read by visiting this page: - -https://jsfiddle.net/4msrhudv - -If you want to increase the compatibility of the stream in order to support most browsers, you have to re-encode it by using the H264 and AAC codecs, for instance by using _FFmpeg_: - -``` -ffmpeg -i rtsp://original-source -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -c:a aac -b:a 160k -f rtsp rtsp://localhost:8554/mystream -``` - -### Embedding - -The simples way to embed a HLS stream into a web page consists in using an iframe tag: - -```html - -``` - -For more advanced options, you can create and serve a custom web page by starting from the [source code of the default page](internal/core/hls_index.html). - -### Low-Latency variant - -Low-Latency HLS is a [recently standardized](https://datatracker.ietf.org/doc/html/draft-pantos-hls-rfc8216bis) variant of the protocol that allows to greatly reduce playback latency. It works by splitting segments into parts, that are served before the segment is complete. - -LL-HLS is enabled by default. Every stream published to the server can be read with LL-HLS by visiting: - -``` -https://localhost:8888/mystream -``` - -If the stream is not shown correctly, try tuning the `hlsPartDuration` parameter, for instance: - -```yml -hlsPartDuration: 500ms -``` - -### HLS on Apple devices - -In order to correctly display Low-Latency HLS streams in Safari running on Apple devices (iOS or macOS), a TLS certificate is needed and can be generated with OpenSSL: - -``` -openssl genrsa -out server.key 2048 -openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650 -``` - -Set the `hlsEncryption`, `hlsServerKey` and `hlsServerCert` parameters in the configuration file: - -```yml -hlsEncryption: yes -hlsServerKey: server.key -hlsServerCert: server.crt -``` - -Keep also in mind that not all H264 video streams can be played on Apple Devices due to some intrinsic properties (distance between I-Frames, profile). If the video can't be played correctly, you can either: - -* re-encode it by following the [guide](#remuxing-re-encoding-compression) - -* disable the Low-latency variant of HLS and go back to the legacy variant: - - ```yml - hlsVariant: mpegts - ``` - -### Decrease latency - -in HLS, latency is introduced since a client must wait for the server to generate segments before downloading them. This latency amounts to 500ms-3s when the low-latency HLS variant is enabled (and it is by default), otherwise amounts to 1-15secs. - -To decrease the latency, you can: - -* try decreasing the `hlsPartDuration` parameter; - -* try decreasing the `hlsSegmentDuration` parameter; - -* The segment duration is influenced by the interval between the IDR frames of the video track. An IDR frame is a frame that can be decoded independently from the others. The server changes the segment duration in order to include at least one IDR frame into each segment. Therefore, you need to decrease the interval between the IDR frames. This can be done in two ways: - - * if the stream is being hardware-generated (i.e. by a camera), there's usually a setting called _Key-Frame Interval_ in the camera configuration page - - * otherwise, the stream must be re-encoded. It's possible to tune the IDR frame interval by using ffmpeg's `-g` option: - - ``` - ffmpeg -i rtsp://original-stream -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -max_muxing_queue_size 1024 -g 30 -f rtsp rtsp://localhost:$RTSP_PORT/compressed - ``` - -## WebRTC protocol - -### General usage - -You can publish a stream from the browser to the server with WebRTC by visiting: - -``` -http://localhost:8889/mystream/publish -``` - -You can read a stream from the browser with WebRTC by visiting: - -``` -http://localhost:8889/mystream -``` - -### WHIP and WHEP - -WHIP and WHEP are two WebRTC extensions that allow to publish and read streams with WebRTC without passing through a web page. This allows to use WebRTC as a general purpose streaming protocol. - -If you are using a software that supports WHIP, you can publish a stream to the server by using this WHIP URL: - -``` -http://localhost:8889/mystream/whip -``` - -If you are using a software that supports WHEP, you can read a stream from the server by using this WHEP URL: - -``` -http://localhost:8889/mystream/whep -``` - -### Usage inside a container or behind a NAT - -If the server is hosted inside a container or is behind a NAT, additional configuration is required in order to allow the two WebRTC parts (the browser and the server) to establish a connection (WebRTC/ICE connection). - -A first method consists into forcing all WebRTC/ICE connections to pass through a single UDP server port, by using the parameters: - -```yml -# public IP of the server -webrtcICEHostNAT1To1IPs: [192.168.x.x] -# any port of choice -webrtcICEUDPMuxAddress: :8189 -``` - -The NAT / container must then be configured in order to route all incoming UDP packets on port 8189 to the server. If you're using Docker, this can be achieved with the flag: - -``` -docker run --rm -it \ --p 8189:8189/udp -.... -bluenviron/mediamtx -``` - -If the UDP protocol is blocked by a firewall, all WebRTC/ICE connections can be forced to pass through a single TCP server port: - -```yml -# public IP of the server -webrtcICEHostNAT1To1IPs: [192.168.x.x] -# any port of choice -webrtcICETCPPMuxAddress: :8189 -``` - -The NAT / container must then be configured in order to redirect all incoming TCP packets on port 8189 to the server. If you're using Docker, this can be achieved with the flag: - -``` -docker run --rm -it \ --p 8189:8189 -.... -bluenviron/mediamtx -``` - -Finally, if none of these methods work, you can force all WebRTC/ICE connections to pass through a TURN server, like [coturn](https://github.com/coturn/coturn), that must be configured externally. The server address and credentials must be set in the configuration file: - -```yml -webrtcICEServers2: -- url: turn:host:port - username: user - password: password -``` - -Where `user` and `pass` are the username and password of the server. Note that `port` is not optional. - -If the server uses a secret-based authentication (for instance, coturn with the `use-auth-secret` option), it must be configured by using `AUTH_SECRET` as username, and the secret as password: - -```yml -webrtcICEServers2: -- url: turn:host:port - username: AUTH_SECRET - password: secret -``` - -where `secret` is the secret of the TURN server. _MediaMTX_ will generate a set of credentials by using the secret, and credentials will be sent to clients before the WebRTC/ICE connection is established. - -### Embedding - -The simples way to embed a WebRTC stream into a web page consists in using an iframe tag: - -```html - -``` - -For more advanced options, you can create and serve a custom web page by starting from the [source code of the default read page](internal/core/webrtc_read_index.html) and [source code of the publish page](internal/core/webrtc_publish_index.html). - ## Standards * RTSP - * [RTSP/RTP/RTCP standards](https://github.com/bluenviron/gortsplib#standards) + * [RTSP / RTP / RTCP standards](https://github.com/bluenviron/gortsplib#standards) * HLS * [HLS standards](https://github.com/bluenviron/gohlslib#standards) @@ -1320,12 +1390,11 @@ For more advanced options, you can create and serve a custom web page by startin * Other * [Golang project layout](https://github.com/golang-standards/project-layout) -## Links - -Related projects +## Related projects * [gortsplib (RTSP library used internally)](https://github.com/bluenviron/gortsplib) * [gohlslib (HLS library used internally)](https://github.com/bluenviron/gohlslib) +* [mediacommon (codecs and formats library used internally)](https://github.com/bluenviron/mediacommon) * [pion/webrtc (WebRTC library used internally)](https://github.com/pion/webrtc) * [pion/sdp (SDP library used internally)](https://github.com/pion/sdp) * [pion/rtp (RTP library used internally)](https://github.com/pion/rtp) diff --git a/logo.png b/logo.png index 5effe08b..56390831 100644 Binary files a/logo.png and b/logo.png differ