I am doing some research and I cannot find any examples where Unity integrates speech recognition as input layer.
Do anyone knows an example of it?
If you have some many use this from asset store. If you want to dig more deeper then there is several different ways for several different platrform. Probably this will help you.
Actually in Windows System from 8.1 to 10 exists a Lybrary to do the work for you.
PhraseRecognitionSystem
class in UnityEngine.Windows.Speech
You have the official Unity Documentation here:
Unity Documentation PhraseRecognitionSystem
for me.. I use. Net 3.0 speech recognition to make it happen..i use visual studio c# to make the speech recognition system and then i integrate it with unity at runtime..u need a code in unity to invoke the speech recognition exe and the code need to be able to fetch data from the exe (.readline)..u need to use system.threading here in order to avoid unity to halt when speech recognition exe is invoke..
Hope this help..
Related
I'd like the Hololens to take in through the camera and project an image over tracked images and I can't seem to find a concrete way as to how online. I'd like to avoid using Vuforia etc for this.
I'm currently using AR Foundation Tracked Image manager (https://docs.unity3d.com/Packages/com.unity.xr.arfoundation#2.1/manual/tracked-image-manager.html) in order to achieve the same functionality on mobile, however it doesn't seem to work very well on hololens.
Any help would be very appreciated, thanks!
AR Foundation is a Unity tool and 2D Image tracking feature of AR Foundation is not supported on HoloLens platforms for now, you can refer to this link to learn more about feature support per platform:Platform Support
Currently, Microsoft does not provide an official library to support image tracking for Hololens. But that sort of thing is possible with OpenCV, you can implement it yourself, or refer to some third-party libraries.
Besides, if you are using HoloLens2 and making the QR code as a tracking image is an acceptable option in your project, recommand using Microsoft.MixedReality.QR to detect an QR code in the environment and get the coordinate system for the QR code, more information please see: QR code tracking
I'm am working on a Unity app that needs custom voice recognition. By custom I mean I cant have them be English or any known language. I want to teach the engine basically new words like gibberish words I made up and I need the voice recognition to recognize them, any ideas? Also I need it to work on both iOS/Android.
Thank you in advance.
Check
https://github.com/cmusphinx/pocketsphinx-unity-demo
also the main cmusphinx website
http://cmusphinx.github.io
I have checked many posts about text recognition with Unity. But every post is suggesting Vuforia.
Also, Vuforia text recognition is deprecated.
According to Vuforia it only detects serif and sans-serif fonts.
I want my application to detect even handwritten text up to some extent.
So my question is 'is there any SDK or anything else which will help to detect handwritten text too?'.
Thanks in advance.
If you're allowed to use network in your Unity application, you can integrate Google Cloud Vision which will do it all for you.
There's a project on GitHub called UnityCloudVision which should do the dirty work for you.
https://github.com/comoc/UnityCloudVision
i have to build an app like this:
https://www.youtube.com/watch?v=vetDCkbQGM4
It should simply detect the cockpit of a car and should show informations. For example "this is air conditioning", "this is switch button for the radio". The targets will be pre defined. Basically the app should detect everything and should show information.
Can I realize this with Vuforia? Which framework is suitable for this task?
I hope you guys can help me.
Cheers!
Since your targets are pre-defined, the simplest solution would be to use aruco markers to get 3D world positions/rotations through your user's camera feed.
See the AR Marker Detector in the Unity Asset Store for an example. Vuforia uses 'VuMarks' that are more intricate versions of this.
If you can't add computer-readable labels to the real world for your project, then you are talking about real-time object recognition. That is a much harder problem and not yet easily solvable in Unity as far as I know. It would require something like Google's Cloud Vision API. There is a Unity Cloud Vision project on GitHub, but I have no idea how well it works or what it's capabilities are.
Yes it is possible, you were first require to google. There are different SDK/Framework and Unity Asset store packages available.
You can use Free Vuforia AR Starter Kit from asset store to up and run your logic. Or You can also use Free AR Toolkit. There are different kind of tut available which can show you how to implement these pacakges.
I am developing an application with Image and Voice recognition.
Do you have any source or idea how to do this?
Thanks,
ZaldzBugz
For speech recognition use pocketsphinx. Static libs were created for it at
http://github.com/KingOfBrian/VocalKit
to work on the iphone.
XCode comes with examples for speech recognition (in /Developer/Examples/Speech/Recognition), and the class you'd use is NSSpeechRecognizer.
I can suggest you using OpenCV, well written in C/C++, can be used in IPhone for computer vision and image processing.