I am creating multiplayer game using photon. The game also supports photon voice.
I do want to support some bot mechanism where user can ask some questions to bot. With predefined command to bot (hey dummybot), it can understand the question and convert it to text.
I am using below plugins
Photon voice
https://assetstore.unity.com/packages/tools/audio/photon-voice-45848
Speech to text
https://assetstore.unity.com/packages/add-ons/machinelearning/google-cloud-speech-recognition-vr-ar-desktop-desktop-72625
Both these plugins need access to microphone.
The problem I am facing is, If I am connected to photon voice (which understand the speech and transmit it to other network players) and same time trying to convert the same speech to text using speech to text plugin, it's not allowing me to do so. Speech to text failed to connect to microphone as photon voice is already using it
Is it possible to get microphone access to both plugins? How can I achieve that?
So to someone who's interested to know, I found one workaround to this.
Create audio clip using microphone data
Save audio clip
Pass audioclip time photon voice for network transmission
Using Google cloud speech to text api, convert audioclip to text
Related
I would like to use chrome speech recognition WebKitSpeechRecognition() with the input of an audio file for testing purposes. I could use a virtual microphone but this is really hacky and hard to implement with automation, but when I tested it everything worked fine and the speechrecognition converted my audio file to text. now I wanted to use the following chrome arguments:
--use-file-for-fake-audio-capture="C:/url/to/audio.wav"
--use-fake-device-for-media-stream
--use-fake-ui-for-media-stream
This worked fine on voice recorder sites for example and I could hear the audio file play when I replayed the recording. But for some reason when I try to use this on WebKitSpeechRecognition of chrome then it doesn't use the fake audio device but instead my actual microphone. Is there any way I can fix this or test my audio files on the website? I am using C# and I couldn't really find any useful info on automatically adding, managing and configuring virtual audio devices. What approaches could I take?
Thanks in advance.
Well it turns out this is not possible because chrome and google check if you are using a fake mic ect, they do this specifically to prevent this kind of behavior so people cannot get free speech to text. There is a paid api available from google (first 60 minutes per month are free)
I am trying to create a AR app which recognizes numbers.I was able to do the text recognition using vuforia but numbers I didn't find any such SDK.I am also ready to write the code using c# but I am not sure where to start.
I want to integrate voice detection in my iPhone app. The iPhone app allow the user to search the word by using their voice. But, i don't know a single info about Voice Recognition in iPhone. Can you please suggest me any ideas,tutorials or sample code for this?
You can also use Google Chrome API to integrate voice recognition on your application, but there is a big problem : the API works only with FLAC encoded files, but this encoding isn't supported natively on iOS... :/
You can see those 2 links for more information :
http://www.albertopasca.it/whiletrue/2011/09/objective-c-use-google-speech-iphone/
http://8byte8.com/blog/2012/07/voice-recognition-ios/
EDIT :
I realized an application including voice recognition using Nuance SDK, but it's not free to use. You can register for free and get a developer key that allows you to test your application for 90-days. An application example is included, you can see the code, it's very easy to implement.
Good luck :)
The best approach will probably be to:
Record the voice on the phone
Send the recording to a server that runs the speech recognition software
Then return something to the phone to indicate what it should do
This approach is favorable as there are a number of open source voice to text softwares out there & you are not limited by computing power in the backend.
Having said that, iOS has OpenEars which is based on Pocket Sphinx. It looks promising...
Well voice recognition is not correlated with iphone. All you can do is record the voice in iphone. Once done, you can either code your one voice recognition module, or find a third party API and reuse it.
You can do google search on that.
I am working on a project where I have to record a voice covert into text then match the pattern and according to the user command perform action.
I am able to to record voice of the user through AVAudioRecorder and perform action. But the actions are perform on anything what user says. I want to perform on user's particular word like if he say play then playing should start.
Help me by any tutorial or any sample code.
Thanks in Advance
Most apps (including Siri) send the sound file to a remote data center via to do the speech recognition, which involves some fairly heavy duty processing. Nuance may have an commercial API.
Another option might be to try using the CMU OpenEars or PocketSphinx speech library, which has been ported to the iPhone. Also look at VocalKit and this article on running PocketSphinx on the iPhone.
I want to ask a question about the iPhone application. Does Apple provide any API to the developers to record the phone call and convert it to text message? Thank you.
In short, there are no APIs for recording phone calls or converting text to speech. You will need to create a speech recognition engine. I suspect the iPhone hardware will not be powerful enough to handle that type of processing though.
FYI...
APIs for converting Voice/Audio data in to text
API for Voice recognition in among group
iPhone speech recognition API?