I’ve been trying to get the example hand tracking scenes to run with holographic remoting with MRTK 2.5.1, Unity 2019.4.13f, XR SDK, a USB connection and the Hololens 2 but haven’t been completely successful. Does anybody have a minimal project setup where the example handtracking scenes run in holographic remoting without crashing?
If HoloLens 2 hand joints or eye-tracking isn’t working over remoting, there are a few common points of potential issues. It is recommended you go through the set-up steps to enable additional HL2 features over remoting. Please take a look at our guide and see if your setup matches those steps:Debugging HoloLens 2 remoting via Unity package import
In case anyone else has issues following the instructions on https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/Tools/HolographicRemoting.html#xr-sdk-setup-instructions here is a
Minimal Project with Holographic Remoting and XR SDK
The sample scene runs with holographic remoting but not the Example Hand Tracking Scenes from MRTK.
Related
I've been developing a Hololens 2 app in Unity 2019.4 using built-in XR/Windows Mixed Reality and remoting was working fine, hand tracking was perfect. Recently migrated to Unity 2020.3 LTS using OpenXR. Everything is working fine in the editor/player and I'm able to connect to my HL2 for remoting (following the instructions here) but then things get weird:
When I play remotely, the scene origin doesn't line up how it used to - often the scene loads behind and/or below me. During normal non-remoting play, the origin is exactly where I'd expect it. And I'm unable to get any kind of hand tracking in the headset.
I've tried importing DotNetWinRT and other troubleshooting steps but nothing works.
My Unity 2019 packages:
My Unity 2020 packages:
Unity 2020 OpenXR Project Settings:
I needed to manually update the Input Data Providers in the MixedRealityToolkit. If I'd created this scene from scratch, I imagine these data providers would have been properly configured by Unity, but because I was migrating the scene from a previous Unity/Mixed Reality version, they never got updated.
MRTK Input settings
I want to use Holographic Remoting to stream holographic content to HoloLens 2 in real time. I follow this tutorial to preview my work with Holographic Remoting. But when I click the 'play' button in unity, I get this error in unity
Failed to enable remoting runtime.
UnityEngine.Debug:LogError (object)
Microsoft.MixedReality.OpenXR.Remoting.PlayModeRemotingPlugin:HookGetInstanceProcAddr (intptr) (at Library/PackageCache/com.microsoft.mixedreality.openxr#a4cc3ecd3f67/Runtime/FeaturePlugins/PlayModeRemotingPlugin.cs:77)
UnityEngine.XR.Management.XRGeneralSettings:AttemptInitializeXRSDKOnLoad () (at Library/PackageCache/com.unity.xr.management#4.2.0/Runtime/XRGeneralSettings.cs:148)
The Holographic Remoting App in Hololens2 had no response.
This figure shows my setting and versions of unity, openXR plugin, Mixed Reality OpenXR Plugin. How can I solve it? Thanks!
The figure about "XR Plug-in Management" and "OpenXR"
I'm working on an application, and unfortunately all I have to use to test it is a Hololens 1. Is there any way to achieve holographic remoting in Unity, or am I limited to building and deploying each and every time?
For HoloLens, we can use the legacy WSA Holographic Emulation to achieve holographic remoting. Please note, the legacy WSA Holographic Emulation is only supported in Unity 2019 LTS, and Unity 2020 does not support it. For how to use it, please refer to this doc: Preview and debug your app using Holographic Remoting and Play mode
I'm new in hololens 2 developing and trying to use Holographic Remoting.
Unity 2019 LTS
MRTK 2.5.3
Unreal 4.26
Hololens 2
Win 10
VS 2019
In Unity : I follow a popular tutorial,
On HoloLens, go to the Microsoft Store and install the Holographic Remoting Player application.
On HoloLens, start the Holographic Remoting Player application.
In Unity, click the "Windows" menu and select "XR->Holographic Emulation".
Set the simulation mode to the remote device.
For remote computers, please enter the IP address of HOLOLENS.
Click "Connect". You should see the connection status change to "Connected", and you should see the screen appear blank in HoloLens.
Click the "Play" button to start the play mode and experience the application on HoloLens.
What I met:
Setting in Unity
Setting in Unity
When I start to "Connect", Error there:
Disconnected with error TransportConnectionFailed
UnityEditor.EditorApplication:Internal_CallUpdateFunctions()
In Unreal I follow: https://docs.unrealengine.com/zh-CN/SharingAndReleasing/XRDevelopment/AR/HoloLens/QuickStartStreaming/index.html
https://learn.microsoft.com/zh-cn/windows/mixed-reality/develop/unreal/tutorials/unreal-uxt-ch6
Setting in Unreal
Setting in Unreal
Similiar error:
LogTemp: Editor connecting to remote HoloLens2: 192.168.19.57
LogWmrHmd: WMRInterop: ConnectToRemoteHoloLens trying to connect to HoloLens2 192.168.19.57
LogWmrHmd: WMRInterop: RemotingDisconnectedEvent: Reason: 12 TransportConnectionFailed
LogHoloLensAR: Warning: HoloLens AR session disconnected from peer
I can connect the device in device portal, and in the Unreal device manager I can also connect my hololens.
device portal
Unreal device manager
Anyone meet this problem?
Could you check that is there any network management software (such as anti-virus software, Firewall, VPN, etc.) is running on your PC? Because we have solved same problems of another customer, and the reason is that he installed VPN software on the PC, which caused UDP port to be blocked. If you still see the same behavior after shutting down the network management software, please open a support ticket through this link: http://aka.ms/hololenssupport
I still didn't find a solution with this configuration (thank you Hernando, but it's not a VPN problem).
However, after I used :
unity2019LTS-XRSDK-MRTK2.4.0-DefaultXRSDKConfigurationProfile
All the things work well (whether VPN is on or not).
Is there any way to direct install from unity to hololens emulator ?
I want to hit unity play button and hololens app get install and run on emulator.
Its very hard to for each test build unity project and then run built visual studio project on emulator.
I also used Mixed Reality Portal but it doesn't show real scales, scales are very smaller than hololens device.
You can try the Holographic Emulation feature provided by unity(https://docs.unity3d.com/560/Documentation/Manual/windowsholographic-emulation.html), and download the Holographic Remoting Player from the store in the simulator.
After successfully connecting to your simulator, you can run the Microsoft HoloLens project directly in the Unity editor rather than building and running the game each time you want to see the effects of the changes.