Improve logging.
[toast/stream2beamer.git] / stream2beamer.md
1 # Stream Desktop/Video/Webcam to Kodi/Beamer/other PCs
2 Gregor and I had a closer look at the following projects:
3
4 # Laplace
5 Simple WebRTC implementation in GO: https://github.com/adamyordan/laplace.git
6 Simple to compile and just works.
7 WebRTC actually uses SRTP (Secure Real-time Transport Protocol). 
8
9 IPv6+IPv4, and no TLS:
10
11     ./laplace -addr "[::]:8080" -tls=false
12
13 ## WebRTC signaling
14
15 * https://developer.mozilla.org/en-US/docs/Web/API/WebRTC_API/Signaling_and_video_calling
16 * https://www.tutorialspoint.com/webrtc/webrtc_signaling.htm
17 * https://www.html5rocks.com/en/tutorials/webrtc/infrastructure/
18 * https://github.com/topics/webrtc-signaling
19
20 # gstreamer
21 * Supports RTP
22 * Supports webcam capture via v4l (video for linux)
23 * Supports screen capture via xmanager/ximagesrc
24 * Interesting URLs:
25   * WebRTC in one direction only: https://stackoverflow.com/questions/57430215/how-to-use-webrtcbin-create-offer-only-receive-video
26   * gstreamer to VLC via RTP: https://stackoverflow.com/questions/13154983/gstreamer-rtp-stream-to-vlc
27   * https://github.com/intel/gstreamer-media-SDK/issues/138
28   * https://developer.ridgerun.com/wiki/index.php?title=GstWebRTC_Pipelines
29   * https://developer.ridgerun.com/wiki/index.php?title=GstWebRTC_-_H264-Opus_Examples#Receive_Pipeline
30
31 ## WebRTC
32 gstreamer has a WebRTC implementation.
33 The examples at https://github.com/centricular/gstwebrtc-demos.git work once
34
35     export OPENSSL_CONF=''
36
37 has been set (see https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/811)
38
39 There's a new recvonly example:
40
41 * https://github.com/centricular/gstwebrtc-demos/commit/000cfb6cd817ca0f07d761795b352a8b8b9074f8
42 * `sendonly/webrtc-recvonly-h264.c`
43
44 ## gstreamer examples
45     gst-launch-1.0 -v playbin uri=file:///home/philipp/tmp/GerisGame.mp4
46     
47     # send
48     gst-launch-1.0 ximagesrc ! videoconvert ! videoscale ! video/x-raw,width=800,height=600 ! vp8enc ! rtpvp8pay ! udpsink host=239.255.12.42 port=5004
49     # receive
50     gst-launch-1.0 udpsrc address=239.255.12.42 port=5004 caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)VP8-DRAFT-IETF-01, payload=(int)96, ssrc=(uint)2990747501, clock-base=(uint)275641083, seqnum-base=(uint)34810" ! rtpvp8depay ! vp8dec ! autovideosink
51     
52     # send
53     gst-launch-1.0 -v ximagesrc ! videoconvert ! videoscale ! video/x-raw,format=I420,width=800,height=600,framerate=25/1 ! jpegenc ! rtpjpegpay ! udpsink host=239.255.12.42 port=5004
54     # receive
55     gst-launch-1.0 udpsrc address=239.255.12.42 port=5004 ! application/x-rtp,encoding-name=JPEG,payload=26 ! rtpjpegdepay ! jpegdec ! autovideosink
56
57
58 * https://stackoverflow.com/questions/33747500/using-gstreamer-to-capture-screen-and-show-it-in-a-window/33822024#33822024
59 * http://www.einarsundgren.se/gstreamer-basic-real-time-streaming-tutorial/
60 * https://gist.github.com/tetkuz/0c038321d05586841897
61 * https://gist.github.com/esrever10/7d39fe2d4163c5b2d7006495c3c911bb
62 * https://gist.github.com/nebgnahz/26a60cd28f671a8b7f522e80e75a9aa5
63 * https://salsa.debian.org/debconf-video-team/ansible/-/blob/master/roles/voctomix/templates/videoteam-stream.j2
64 * https://github.com/xfxf/video-scripts/blob/master/michael/youtube-live.sh
65   (and others in the same repo)
66
67 ## gstreamer webrtc, another example
68
69 * blog post: https://aweirdimagination.net/2020/07/05/gstreamer-webrtc/
70 * code: https://git.aweirdimagination.net/perelman/minimal-webrtc-gstreamer
71     
72 ## websockets
73
74 connecting to websockets (plus gstreamer and v4l2sink)
75
76 https://michael.stapelberg.ch/posts/2020-06-06-iphone-camera-linux-v4l2loopback/
77
78         # send
79         laplace / chromium
80
81         # receive
82         websocat --insecure "wss://localhost:8080/ws_connect?id=cranky_kind_chipmunk"
83
84 ## more v4l2loopback/v4l2sink
85
86         # send
87         gst-launch-1.0 videotestsrc ! v4l2sink device=/dev/video42
88
89         # receive
90         cvlc v4l2:///dev/video42
91
92 ## SRT and gstreamer
93
94 * https://github.com/Haivision/srt/blob/master/docs/gstreamer.md
95 * https://srtlab.github.io/srt-cookbook/
96
97 ## gstreamer and rtsp
98
99 working minimal example: https://github.com/Enne2/PyGObject-GstRtspServer/blob/master/rtsp-server.py
100
101 other maybe helpful links (for getting an existing pipeline streamed):
102
103 * https://stackoverflow.com/questions/52562499/is-it-possible-to-stream-an-existing-gstreamer-pipeline-through-gstrtspserver
104 * http://gstreamer-devel.966125.n4.nabble.com/Continuously-streaming-a-video-file-code-review-td4671364.html
105 * https://stackoverflow.com/questions/59858898/how-to-convert-a-video-on-disk-to-a-rtsp-stream
106 * http://gstreamer-devel.966125.n4.nabble.com/RTSP-Server-from-a-manually-created-and-linked-pipeline-td4680305.html
107 * http://gstreamer-devel.966125.n4.nabble.com/Using-C-API-based-pipelines-in-RTSP-server-without-quot-launch-quot-arg-td4680144.html
108 * RTSP on_media_configure and appsrc: https://github.com/GStreamer/gst-rtsp-server/blob/master/examples/test-appsrc.c
109 * Link two pipelines: http://gstreamer-devel.966125.n4.nabble.com/Two-pipelines-link-them-merge-them-easy-handling-td4686753.html
110
111 a "relay" between cameras and rtsp, in rust:
112
113 * https://github.com/thirtythreeforty/neolink
114
115 ## gstreamer: from udp to rtsp
116
117 * http://trac.gateworks.com/wiki/Yocto/gstreamer/streaming
118
119 ## HLS
120
121 or gstreamer's `hlssink(2)`, if we want to serve files via HTTP and kodi can
122 read/play .m3u8 playlist
123
124 # VLC
125 Note that you have to close VLC and open it again for new streaming as VLC leaves the connections
126 open (I spent hours figuring out why http based streaming doesn't work - `netstat -4 --ip` is nice
127 for debugging in that respect).
128
129 ## RTP
130 ### Source
131 The address has to be the address where the video should be streamed **to**. In the following
132 examples, a multicast address is used. It is either the IP address of the device receiving the video (unicast address) or a multicast address 
133 like 239.255.12.42 (multicast addresses are between 224.0.0.0 and 239.255.255.255, some of
134 them being reserved, 239.0.0.0 to 239.255.255.255 are Organization-Local Scope so they are
135 good candidates, see
136 https://www.iana.org/assignments/multicast-addresses/multicast-addresses.xhtml).
137
138     cvlc -vv --sout '#transcode{vcodec=h264,acodec=mpga,channels=2,vb=800,ab=128}:rtp{mux=ts,dst=239.255.12.42,sdp=sap,name="Geris Game"}' GerisGame.mp4
139     cvlc -vv --sout '#transcode{vcodec=h264,acodec=mpga,ab=128,channels=2,samplerate=44100,scodec=none}:rtp{dst=239.255.12.42,port=5004,mux=ts,sap,name=Geris Game}' :no-sout-all :sout-keep GerisGame.mp4
140     cvlc -vv --sout '#transcode{vcodec=h264,acodec=mpga,channels=2}:rtp{mux=ts,dst=239.255.12.42,sdp=sap,name="Videokamera"}' v4l2:///dev/video0 # long latency
141     cvlc -vv --sout '#transcode{vcodec=h264,acodec=mpga,channels=2}:rtp{mux=ts,dst=239.255.12.42,sdp=sap,name="Desktop"}' screen:// # not convincing
142
143 ### Player
144     cvlc rtp://239.255.12.42
145
146
147 ## RTSP
148 For VLC, RTSP means RTSP combined with RTP.
149
150 ### Source
151 We assume that the video source computer has the external IP 192.168.1.54.
152 Instead of rtsp://192.168.1.54:8554/ we could also use rtsp://192.168.1.54:8554/mystream.sdp
153
154     cvlc -vv --sout '#transcode{vcodec=h264,acodec=mpga,ab=128,channels=2,samplerate=44100,scodec=none}:rtp{sdp=rtsp://:8554/}' :no-sout-all :sout-keep GerisGame.mp4
155     cvlc -vv --sout '#rtp{dst=239.255.12.42,port=1234,sdp=rtsp://192.168.1.54:8554/}' :no-sout-all :sout-keep GerisGame.mp4
156
157
158 ### Player
159 The address needs to be the address of the source. Note the backslash at the end.
160
161     vlc rtsp://192.168.1.54:8554/
162
163
164 ## VLC Remarks
165 * Latency: The following options are said to reduce latency:
166
167       --network-caching=150 --clock-jitter=0 --clock-synchro=0
168
169 * Duplicating a stream is nice for debugging:
170
171       cvlc -vv --sout '#duplicate{dst=display,dst="transcode{vcodec=h264,acodec=mpga,channels=2,vb=800,ab=128}:rtp{mux=ts,dst=239.255.12.42,sdp=sap,name=Geris Game}"}' GerisGame.mp4
172       cvlc rtp://239.255.12.42
173
174
175 ## HTTP
176 The address at the source side has to be the external one of the local computer.
177
178 ### Source (server)
179     cvlc -vv --sout '#transcode{vcodec=mp4v,acodec=mpga,vb=800,ab=128}:standard{access=http,mux=ogg,dst=0.0.0.0:8080}' GerisGame.mp4
180
181 ### Player (client)
182
183     vlc http://192.168.1.54:8080
184
185
186 # Kodi
187 The player built into code knows at least the following streaming protocols: http, rtsp.
188
189 https://kodi.wiki/index.php?title=Internet_video_and_audio_streams