I am new to flutter, It is a great way to build apps for all platform, But is there a way to use google ML KIT for flutter? I want to use Selfie Segmentation.
Yes, there's a way to use Google ML KIT for flutter. Try google_ml_kit.
Related
I am working on an application where main screen has a live camera opened automatically.
Here I need faces to be detected.
Am getting confused about how to integrate ML kit.
Do I have to signup with firebase????
I tried working with google ml kit but got too many errors.
There are two separate ML libraries now - Firebase ML and ML Kit. Firebase ML runs on the cloud, and you need to use Firebase for it. You can find the documentation here.
ML Kit, however, runs entirely on the user's device, and it does not require you to use Firebase, unless you want to use custom models.
The easiest way to integrate it into your flutter app would be to use the google_ml_kit library, which provides modules for different purposes. For face recognition, you can use google_mlkit_face_detection.
I have an idea for a desktop app that needs to detect whether a user has his/her eyes closed and track the orientation of the user's head in real time.
Google ML Kit offers these two features right out of the box and with the google_ml_kit Flutter package it's as easy as pie to get it up and running in an Android or iOS app.
But sadly the Google ML KIT doesn't support MacOS or Windows.
Is there an alternative package for desktop that doesn't require me to train the models myself and would be easy to integrate into a Flutter app?
I am trying to have a games section on the app that I am making for kids. Is there a way that I can use a 3rd party game maker (preferably online) and integrate it to my flutter app ? I don't want to use flutter's flame engine.
You can try Unity package for flutter if not flame.
As per the title, I want to implement a Video chat app in a flutter project and use AR filters during video chat. I'm looking for an implementation that can be done easily so I've checked out Agora and Twilio flutter SDK's for Video chat but they haven't provided any ways to add AR Filters yet. Does anyone know how this can be done?
Is there a way to implement a separate AR filter SDK to the existing Agora or Twilio video chat Flutter SDK?
Twilio developer evangelist here.
I don't have any concrete answers for you here, but some ideas that might help. As a disclaimer, I am not a Flutter developer and the Twilio Video Flutter SDK is built by the community and not supported by Twilio, so your mileage may vary.
As far as I know, you can implement your own camera source (iOS) or camera capturer (Android) object that you can pass to the native Twilio Video SDKs. The camera capturer outputs frames that the SDK uses to send to the video room. If you can implement your own, then you can build whatever effects or filters on the frames before passing them onto the SDK.
Sorry this is a very vague answer, I hope you can apply this to the Flutter SDK and achieve your goals.
Integrating AR filters using the Agora Flutter SDK needs to be done via the native layer of your Flutter application. Agora has various guides and blogs on how to add AR to your video calling application. You can refer to this Android blog that shows how to add face filters that might help you in your development journey: https://www.agora.io/en/blog/build-a-live-streaming-application-with-face-filters-on-android/
I have to make an app that uses virtual reality, so should I drop the idea of using Flutter?
yes as much as I have seen flutter does support AR,I have been following a flutter developer on twitter he posts some cool AR stuff built with flutter here's a plugin ARCore he has built for flutter.
here are some of sample AR videos from the developer himself
https://twitter.com/i/status/1123893412279791616
https://twitter.com/i/status/1129117305303175168
Can I build 3D (OpenGL) apps with Flutter?
Today we don’t support for 3D via OpenGL ES or similar.We have long-term plans to expose an optimized 3D API, but right now we’re focused on 2D.
https://flutter.dev/docs/resources/faq#can-i-build-3d-opengl-apps-with-flutter
there aren't any OpenGL bindings supported by flutter. Flutter is only a 2d only application.
https://flutter.io/faq/#can-i-build-3d-opengl-apps-with-flutter
https://github.com/flutter/flutter/issues/14591
https://github.com/flutter/flutter/issues/7053
https://github.com/flutter/flutter/issues/179
I am not sure how VR would work at all on flutter.
You can use google's ar core with flutter. Check out the arcore_flutter_plugin to work with ar in a flutter.
As of now, there aren't any packages that specifically target VR. But you can use ARKIT arkit_flutter_plugin.
NOTE: ARCORE only works with android. And ARKIT only works with iOS.
I recently created a Flutter plugin for AR that supports both Android and iOS by wrapping around ARCore and ARKit: https://pub.dev/packages/ar_flutter_plugin
The plugin is a work in progress, but it already supports collaborative AR and sharing content through Google's Cloud Anchor Service and a lot of other useful features