slococo-uni
/
webviewstream
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
109 Commits 1 Branch 0 Tags 3.3 MiB
yaml 94.3%
ShaderLab 2.7%
GLSL 1.5%
C# 1.1%
HLSL 0.4%
Go to file
Santiago Lo Coco a57cb87be5 Update service and dialog distance 2024-11-19 01:39:20 +01:00
Assets Update service and dialog distance 2024-11-19 01:39:20 +01:00
Packages Fix more bugs 2024-11-05 00:47:53 +01:00
ProjectSettings Save recording to the Videos folder 2024-11-19 00:27:37 +01:00
.csharpierrc Reformat files 2024-11-05 23:36:17 +01:00
.gitattributes Add .gitattributes 2024-10-13 19:07:50 +02:00
.gitignore Update .gitignore 2024-11-11 22:19:01 +01:00
README.md Update project name 2024-11-11 23:21:07 +01:00

README.md

WebViewStream

WebViewStream is a Unity-based HoloLens 2 application for high-quality, low-latency WebRTC streaming from multiple endpoints, optimized with Microsoft's Mixed Reality Toolkit (MRTK) and WebView package. It offers an extensible, high-performance streaming setup that can scale to multiple streams, limited only by the HoloLens 2 hardware.

Features

  • MRTK-Native: Built on MRTK for optimized HoloLens 2 functionality.
  • Optimized performance: Configured and fine-tuned for smooth, low-latency streaming on the HoloLens 2.
  • WebRTC-based streaming: Uses WebRTC for low-latency, high-quality streaming.
  • Dynamic endpoint management: Reads streaming endpoints from a REST API GetEndpoints, simplifying endpoint updates without typing long URLs directly on the HoloLens.
  • Extendable streaming capacity: Supports two streams by default and can scale up, limited only by HoloLens 2's hardware.
  • Hand menu and speech commands: Offers an intuitive HandMenu and voice control for hands-free operation.

Installation

  1. Clone the repository.
  2. Configure the API host for GetEndpoints to dynamically retrieve streaming endpoints.
  3. Build and sideload the application to the HoloLens 2.

Technical details

  • Platform: HoloLens 2 (UWP)
  • Language: C# (Unity)
  • Required packages:
    • com.microsoft.mixedreality.openxr
    • com.microsoft.mixedreality.toolkit.foundation
    • com.microsoft.mixedreality.toolkit.standardassets
    • com.microsoft.mixedreality.webview.unity

Note: Install dependencies from my MixedReality repository. Only use the specific libraries and versions hosted there, as they have been patched for this project's requirements. Using different versions may lead to errors and compatibility issues.

API requirements

The app requires an external API for endpoint retrieval (GetEndpoints), expected to be accessible within the HoloLens 2's network environment.

The application supports local service discovery using UDP broadcasting. This is particularly useful in scenarios where DNS is down or when setting up a DNS record is not feasible.