I've build an agent that uses dialogflow and fulfillment with the actions-on-google library. In a certain intent, the fulfillment sends back a SimpleResponse, a MediaResponse and some Suggestions.
It works fine in the simulator, the audio file in the MediaResponse plays as expected.
When testing the agent in the Google Assistant app on my iPhone however, the audio file isn't playing. There isn't a play/pause button but shows a loading/buffering gif instead. When I click on the loading gif the audio file starts playing and the start/pause button appears.
I don't think this is expected behaviour, is this a bug on Google's end or am I missing something here? Is there even a way to default autoplay the audiofile without the user having to push the icon?
As it turns out, this is a bug in Actions on Google and they are working on it.
Media responses are supported out of the box only on Android and Google home devices. You must check for the surface capabilities before trying to play the audio. You can check https://developers.google.com/actions/assistant/responses#media_responses for more options and suggestions.
What I would suggest is if you are playing small audio clips in between text/speech data, then use SSML. Check audio tag in the link https://developers.google.com/actions/reference/ssml
Related
Trying the SDK from the smart tv alliance, I worry about it not playing videos in the vbox.
The menu and browser works well, but e.g. when trying the video sample project within SDK, it does not play videos there. => screen remains black in the content area...
It's a smart tv virtualization, so I hope it supports video playback and is not a missing feature (as in some android simulators).
It's exactly like a normal site or HTML document...
Add your video like you would do normally.
The SDK emulator does not supprot much formats to be played except of the mp4 progressive download. What exactly are you trying to stream?
STeN
I have used Local Notification in my app an successfully generated an alert at correct time..
But when i tried following code for playing sound it does not play....
localNot.soundName =#"Ghulam Ali-Chamkte Chaad Ko.mp3";
Can anyone tell me the reason....Does the playing length of sound file affects
According to the Apple Developer Documentation, you need to use "aiff", "caf" or "wav" files.
The link provided shows some ways of converting audio to these formats on your mac.
Why is it that if I pick a video from the library in my application I'm given this horribly pixelated/compressed video but if I take the video with the camera in my application I'm given a nice video file, this is on the iphone 4.
Sample of video taken w/in the app:
http://photos.smugmug.com/photos/912709066_Kcc8p-1280.mp4
Sample of video picked from the library:
http://photos.smugmug.com/photos/912709325_hw7Bv-1280.mp4
Both are 720p. Setting videoQuality to 'UIImagePickerControllerQualityTypeHigh' doesn't help, which makes sense really since that appears to be just for setting the recording resolution when using the camera.
Sam
i had the same assumption as Shizam till i saw an FTP app upload a video just fine on an iPhone 4. its not the quality of the imported video thats the problem. if you download the app's sandbox and look at the imported video you will see its fine.
go to Window/Organizer and select your device. there will be a list of Applications in the bottom right. select the app in question and click the expansion triangle. you will see "Application Data" click on the little black downward arrow and tell it when to save the data. then go look at the video in the tmp folder. you will see its fine.
the problem comes when you try to send it out via HTTP. for what ever reason Apple decided to add an extra crappy video compression to videos sent over HTTP. if you FTP the file to the server the video quality is actually very good similar to what you get when you email the video to yourself. Apple gives you a working example of how to FTP to and from a server.
See my post here. You can improve the quality by changing some settings.
Avoid Video Compression when Selecting Movie with UIImagePickerController?
I have just created and iPhone web app, which has some x264 (mp4) video files on it. When I link directly to the file on the iPhone and the user taps the link, the video player is loaded and the video starts playing.
Using the app on an Android phone causes the browser to download the video instead of just playing it. Is there a way to force a video player to just boot up and play the video not download it?
Thanks in advance.
You should know that Android is quite strict regarding the video streams that you can stream. To be able to watch a stream a video (progressively watch and download) the video container must be correctly formatted.
There are many ways to create a container suitable for progressive streaming. You can look it up here: http://groups.google.com/group/android-beginners/browse_thread/thread/2a801ce5f71b5aaf?pli=1
I have successfully created a streamable video. Try to open it from your browser: http://students.mimuw.edu.pl/~nh209484/Video000.3gp
I'm a newbie to cocoa programing on iPhone.
My client has a website that plays YouTube videos. Once a video is finished playing, it will automatically play the next one. This is done by using the YouTube API and swfobject.
After some research, I was told that Safari on iPhone does not support flash. This make the current swfobject code not working on the iPhone browser.
As workaround, when the user clicked on an embedded player, iPhone will launch the YouTube app.
Is to possible to determine when the YouTube app has finished playing and has returned control back to browser?
You can use UIWebView to play videos from YouTube. You'll have to control those from your application though (start, stop, play next, etc).
Also In iOS you can register custom URI schemes and then redirect the browser (or UIWebView) back to your application. This is how many application do 3-legged OAuth for example (which requires a browser interaction). Which might require having a control over the server.
No, it is not possible to jump out of your App and then come back to it again. Once you leave your App, you are finished.
You'll need to stay in a UIWebView, or come up with another method of playing the YouTube videos from within your App.
-t