From my understanding, the Youtube technical requirement for 2017 and 2018 requires support of W3C Web Audio API.
Cobalt is currently not able to run the qual-e web audio web page: http://qual-e.appspot.com/webaudio.html. The video player is not rendered. Also clicking the navigation buttons does not result in sound played and with the following message on the console.
[0917/153645:ERROR:console.cc(62)] [console.error()] Error in loading sound:
Does cobalt currently support Web Audio API?
Does cobalt currently support rendering the webpage http://qual-e.appspot.com/webaudio.html?
Will such a support rely on the starboard audio_sink api or some other api?
Cobalt supports WebAudio API. This works well with linux-x64x11 reference implementation while navigating the YouTube app(https://youtube.com/tv).
The reason why WebAudio TC does not work is due to the lack of support which is not YouTube's requirement. We will rewrite the test case once we modify ShakaPlayer to work on Cobalt.
Related
I am looking for some ready-to-go APIs provided by platforms to deal with video chatting etc. There are some examples like Twilio or OpenTok but you have to create the server side by yourself.
Are there any other examples where I don't have to deal with the server?
I recommend to try ConnectyCube, they have a Swift code sample for video calling
You do not need to bother with any server-side stuff, can concentrate only on client-side app development
Code samples https://developers.connectycube.com/ios/code-samples
Video Chat swift code sample https://github.com/ConnectyCube/connectycube-ios-samples/tree/master/sample-videochat-swift
Getting Started guide https://developers.connectycube.com/ios/
Video Chat API documentation https://developers.connectycube.com/ios/videocalling
The following features are supported:
1-1 video chat
Group video chat
Cross-platform
Screen sharing
WebRTC based
End-to-end Encryption by default
VP8/H264 video codecs supported
Mute/Unmute audio/video stream
Switch video input devices (cameras)
Video recording
Vidyo.io
You can use this its free for 2000 minutes but it will work without a server,
https://vidyo.io/platform/mobile/
Does Google speech API v2 support audio streaming via web sockets?
I found a way to send POST request with audio. However, it would be great if I can write audio and send it via socket in real time.
Note: I use Firefox browser. I know that Google Chrome supports voice recognition from the box, however I'm interested in Firefox and other browsers.
V2 of the API currently does not support web sockets. The streaming API uses gRPC which would need a translation layer to work with websockets.
https://cloud.google.com/speech/reference/rpc/google.cloud.speech.v1beta1#google.cloud.speech.v1beta1.Speech.StreamingRecognize
IBM Bluemix does support websockets, check out this sample project to see it in use: https://github.com/triceam/IBMWatson-QA-Speech/blob/master/config/socket.js
I am working on a website that works across all mobile browsers specifically Android, iOS and BB. I have used the experimental jQuery mobile for the consistent look and feel. One of the pages require audio to be recorded and played back for this I did some research and found that HTML5 has support for this but still part of the spec so it may not available on these browsers yet, so I was wondering if there is any workaround for this. I atleast know of one such application that captures audio and its Google Voice for iPhone and I read somewhere that they use HTML5 so does that mean safari has support for HTML5 audio capture? Please suggest.
For audio playback, you can use this test page on all of your supported platforms and browsers. It should confirm which HTML5 audio playback constructs will work:
http://www.jplayer.org/HTML5.Audio.Support/
It sounds like there are issues with even getting playback to work on Android, see here for info:
http://textopiablog.wordpress.com/2010/06/25/browser-support-for-html5-audio/
I haven't seen anything about current browser support for audio recording through HTML5. You could try Java or Flash, but Java requires the user to have it installed (and accept suitable permissions), and Flash requires you to set up a server for the data to be sent to (e.g. Red5)...and remember that Flash does not work on iOS.
I'm trying to build a web application for iPhone and Android that deals with audio input.
Is this possible?
Apparently ... yes, or it should be able to when it's finished at least. It will supposedly become possible using the device API which is due to be part of HTML5 when it's finished and released (HTML5 isn't finalised yet however, and information is subject to potential for change).
W3C Device API Requirements (camera section)
Sony Erricson community blog posting, with examples (pre-final API)
While it isn't explicitly mentioned in the W3C spec, audio recording as part of (web)camera interactions is, so it's definitely hopeful. There seems to be a shortage of good information at this stage though. I'd expect to see more as HTML5 comes closer to being finalised.
As of now, HTML5 Can't record Audio. but in future, it will be able to, by using the Device's native features.
HTML 5 can not record audio (at least currently). HTML basically is a markup language and therefore only declares how a browser should display certain content. Although HTML 5 introduces new features that make some interaction possible, you can't record audio straight into.. HTML (even saying that sounds wrong). When the HTML5 spec is finished, it might become reality, until then, no way.
Web applications that record audio normally require a plugin like Flash or Silverlight, because those can access system resources like audio hardware. Both are a no-go on iOS, although Flash is theoretically possible on Android, I don't know if it supports audio input.
I would suggest you write a native app (for iOS and Android) that can access the audio hardware and connects to your web application in the background, so that the recording takes place natively and the recorded audio will be transmitted to your servers (think of Shazam, for example).
Here are the basic developer guides on recording audio in:
Android
OS X, iOS
A new MediaStream Recording API is being worked on. It is currently availble only in the Firefox Nightly build for demo purposes
Here's the draft with the latest updates directly form W3C site:
https://dvcs.w3.org/hg/dap/raw-file/default/media-stream-capture/MediaRecorder.html
Also the following article covers up other attempts on recording audio and video directly in the browser:
http://hdfvr.com/html5-video-recording
we have to develop a commercial video streaming application for iPhone & within that app we are planning to integrate additional searching functionality for Google Video & You Tube. I want to know following points,
Where can i find the Google video API & You Tube API ?
Will there be any legal issue on Google Video & You Tube video integration on commercial products, Form whom we have to the approval? Is there any standard procedure on this
You are allowed to do this but there are some restrictions
Take a look at the Terms of Service Point 1.2 Commercial Usage and Using the YouTube APIs to Build Monetizable Applications (too much to include in this answer)
Objective-C APIs for Google services are at http://code.google.com/p/gdata-objectivec-client/
YouTube provides an API, including video searches; Google Video does not.
Google APIs are intended for use in commercial applications, but carefully read the YouTube FAQ and the associated terms of services documents.