Live Video Player
The RUSEON Core Web UI provides dual streaming modes with real-time AI metadata visualization.
Streaming Protocols
1. WebRTC (WHEP) — Default Mode
- Provides sub-50ms latency for live operator control and PTZ monitoring.
- Uses WHEP HTTP POST signaling to negotiate ICE/SDP.
- Receives AI bounding boxes via the dedicated
"metadata"SCTP DataChannel.
2. HLS Mode — Fallback
- Uses
hls.jswith 2-second target segments for reliable playback across constrained networks. - Receives AI bounding boxes synchronized via the WebVTT subtitle track (
subs.m3u8).
AI Canvas Metadata Overlay
The MetadataOverlay component utilizes HTML5 Canvas and requestAnimationFrame for hardware-accelerated 60 FPS bounding box rendering:
- Normalizes camera pixel coordinates to match dynamic video viewport scaling.
- Renders object bounding boxes, confidence percentages, and class labels (e.g.
person 96%,car 88%). - Clears expired bounding boxes automatically when new telemetry arrives.