I really interested to develop and app with AR (Augmented Reality) using Vuforia and Unity plugin because I just want to develop once for Android and iOS, but I really want to take advantage using fast CV, which allow facial recognition for Vuforia, but I'm not very sure if it's possible to integrate, what about this recipe?:
For just one develop for iOS and Adnroid, use:
- Vuforia + fast CV + unity plugin
Has anyone tried it before? would be it possible?
Thank you
Facial recognition is (already) available through a number of other SDKs. Particularly, many have been able to integrate with Unity already. Just do a simple search, you'd find:
Magnus' tech demo http://www.youtube.com/watch?v=9Yb_kte6e5w
FaceTracker Plugin http://www.youtube.com/watch?v=xEleWOfRzSE
etc
--
Edit: also iOS natively provides facial recog and tracking that you can plugin to use with Unity
Not sure if it would help if this is time sensitive but metaio's sdk (also usable with unity) will be including facial recognition next year.
http://www.metaio.com/products/sdk/
Related
I wanna build measurement app for Android and iOS using Unity. Can some one guide me through as it is my final year project and I am confused what to use that will work on both Android and iOS for all devices.
I am confused what to use that will work on both android and ios for all devices.
This is not a very reasonable thing to ask. You can deploy your applications to iOS and Android with both ARCore and Vuforia. However, not every device can run ARCore or Vuforia. There is a list of supported devices for both of them.
For the task you want to implement you need to use Vuforia Fusion. Here is the list of devices that support Vuforia Fusion. On top of that these devices should fulfill certain requirements such as having minimum iOS 9+.
For ARCore the list is like this and ARCore also has requirements specific to devices. However, it is easy to say Vuforia supports more devices than ARCore. Therefore, Vuforia is used more in such applications recently but this might change in the future. I prefer ARCore over Vuforia because of the flexibility it provides to developers.
Since this is your final year project i would recommend doing a thorough AR SDK research first and then decide with which one to start. There might be other SDKs which might be better for the task in hand. Good luck!
I have to make an app that uses virtual reality, so should I drop the idea of using Flutter?
yes as much as I have seen flutter does support AR,I have been following a flutter developer on twitter he posts some cool AR stuff built with flutter here's a plugin ARCore he has built for flutter.
here are some of sample AR videos from the developer himself
https://twitter.com/i/status/1123893412279791616
https://twitter.com/i/status/1129117305303175168
Can I build 3D (OpenGL) apps with Flutter?
Today we don’t support for 3D via OpenGL ES or similar.We have long-term plans to expose an optimized 3D API, but right now we’re focused on 2D.
https://flutter.dev/docs/resources/faq#can-i-build-3d-opengl-apps-with-flutter
there aren't any OpenGL bindings supported by flutter. Flutter is only a 2d only application.
https://flutter.io/faq/#can-i-build-3d-opengl-apps-with-flutter
https://github.com/flutter/flutter/issues/14591
https://github.com/flutter/flutter/issues/7053
https://github.com/flutter/flutter/issues/179
I am not sure how VR would work at all on flutter.
You can use google's ar core with flutter. Check out the arcore_flutter_plugin to work with ar in a flutter.
As of now, there aren't any packages that specifically target VR. But you can use ARKIT arkit_flutter_plugin.
NOTE: ARCORE only works with android. And ARKIT only works with iOS.
I recently created a Flutter plugin for AR that supports both Android and iOS by wrapping around ARCore and ARKit: https://pub.dev/packages/ar_flutter_plugin
The plugin is a work in progress, but it already supports collaborative AR and sharing content through Google's Cloud Anchor Service and a lot of other useful features
I have background in android and have developed few apps of my own. Now I want to explore VR app development for android. Going through forums etc., first thing I understand is that I need to have basic infrastructure like unity 3d sdk, cardboard sdk, cardboard device etc. I am not able to understand roles these individual components play in overall bigger picture.
Like, why do I need unity 3d sdk if I have android sdk and cardboard sdk, and android studio as dev environment?
Then, if I plan to develop for something like Oculus then what all sdks and devices are needed, and which programming language I can work with?
Your options depend on which device you'll target:
Game engines like Unity: You need Unity and some plug ins and of course the device you will target too:
Google Cardboard / Daydream
Samsung Gear VR
From scratch application: Your language is java and you need to download the sdk for your target device:
Google Cardboard / Daydream SDK
Samsung Gear VR, Oculus Mobile SDK
Regards
I think there is a lot of promise in web-based VR. Of course, the app will not be as high fidelity as a native application built in Unity or Java but you get the benefit of being able to target many platforms out of the box. ReactVR is a cool project coming out of facebook that is making it easier and more performant to build VR apps with web technologies.
Here is a cool starter-kit that can help you get started if you are interested: https://github.com/scaphold-io/react-vr-graphql
P.S. GraphQL is a great tool for enriching your VR apps with data no matter if you're building it with React, Unity, or Java.
You can check out A-Frame (https://aframe.io), a web framework for building VR experiences. It's been out over a year and has a strong community and ecosystem. With web-based VR, you get cross-platform support across Rift, Vive, Cardboard, Daydream, GearVR out of the box. With A-Frame, you get all of the boilerplate with a single line of HTML. You just have to grab a VR-enabled browser.
A-Frame's architecture is similar to Unity's, entity-component, but A-Frame makes it declarative and similar to web development. With effort, the fidelity can rival native (https://blog.mozvr.com/a-painter/).
I have a license Unity 3.x. Now we need to create a simple 2D mobile application. Is compatible Unity 3.x SDK with current mobile API platform (Android, IOS) ?
I would say it's not really an issue of if you need to but should you.
And you absolutely should. Unity has released numerous improvements and native support for 2D applications that didn't exist or at least were very rough around the edges prior to 4. I can't think of any reason why I'd want to stay stuck with Unity 3.x when Unity 5 is readily available.
I want to develop a game using Unity + Kinect, as I understand Unity does not support the official Kinect SDK so I have to find another way. I saw that some guys use ZigFu which seems to not have a good Documentation and has a $200 licence. Is there any other easy way to make things work between Kinect and Unity? If I choose to not use Unity, what other tools exist that support the official C# Kinect SDK to develop a game?
The Official Microsoft Kinect SDK should be easy to plug into the XNA Game Studio.
There should articles on the web and samples shipping with the SDK.
Unfortunately I haven't used the MS Kinect SDK since version 1.5. I'm hoping there are updated guides/tutorials available for the latest SDK.
UPDATE
One workaround would using multiple applications talking to each via a TCP/UDP socket (OSC is pretty easy to use for example). The idea is you use what you prefer for the kinect tracking, but send a list of coordinates for the joint's positions and orientations to unity.
You should see this unity thread. It states that you cannot use the Kinect SDK with Unity, as the frameworks are not correct. However that was a different version.
Actually, it says you can use it as this sample shows.
Note that there are many errors people seem to be having with it. I don't know how much of that is people having poor code and how much is with the SDK.