I am using camera plugin https://pub.dev/packages/camera I want to take image stream from it and use it to identify the barcode using Firebase ml kit. Can I do that? I can't figure out how to take image stream from camera plugin and how to use this stream with ml kit. Can anybody help me? I am creating a live reader, I don't want to take picture using the camera plugin.
There are some already built packages that you can use and enhance based on your use case like barcode_scan.
However, I would encourage you to try a few things first and then turn to the community for help with the code that you have tried but didn't work.
Related
I am implementing a music app in a flutter. In the app, I want to implement a music equalizer first, and together with this want to implement a visualizer.
like this : Qualizer and Visualizer
I have used this package Qualizer but it doesn't provide sound null safety. so I need an alternative to this.
I've been trying to do the same thing and I was able to implement an equalizer using this package just_audio but the only problem is that it only worked on Android and I couldn't make it work on IOS, I found an issue on GitHub discussing this matter but it was kinda confusing I'm trying to make it work still GitHub link
I am trying to create a video streaming app in Flutter, using Mux. I also want to track user data to help recommend more specific videos per user. However, I do not know how exactly to integrate mux/data with the video_player plugin in flutter. Have I misunderstood how exactly these plugins/services work? I am using flutter for my frontend and python for the backend.
Links:
video_player: https://pub.dev/packages/video_player
mux/data: https://docs.mux.com/guides/data/track-your-video-performance
You could use this player instead which is functional: https://pub.dev/packages/mux_player
However, I'm struggling to make it autoplay and not go fullscreen when you play it as it feels kind of weird. It does track all data as you would expect.
How does one go about creating a Face Swap mechanism in Flutter?
Can anyone point me in the right direction?
Thank you
You’ll probably need a good plugin to do all the hard work for you. I recommend Google’s ML Kit on Flutter, as it is the most popular way to run on-device ML with Flutter.
The face detection plugin is what you want. You would basically get the face oval shape with face contour detection and swap those shapes. And this can be done real-time with a given video input.
But you should keep in mind that the plugin is on v0.0.1. If you’re aiming for production, you’d better do that with Swift or Kotlin.
There are multiple ways to archive this thing in Flutter. It might be in real-time or with some delay of seconds.
You can use one of these packages.
Open CV
TensorFlow
Google's ML Kit
It might be possible you will not get good support from openCV and TensorFlow in a flutter. But you can integrate the OpenCV/TensorFlow native libs or SDK for both Android and IOS and invoke them through platform channels
There is also one more possible solution but it will definitely have a delay. For this kind of ML project python have great support of library and projects.
You can set up a python project which is responsible for face swapping it takes input from the flutter app (using rest API or socket) and return the output image after face-swapping.
Some great face swap projects are available on GitHub you can look into it.
I'd like the Hololens to take in through the camera and project an image over tracked images and I can't seem to find a concrete way as to how online. I'd like to avoid using Vuforia etc for this.
I'm currently using AR Foundation Tracked Image manager (https://docs.unity3d.com/Packages/com.unity.xr.arfoundation#2.1/manual/tracked-image-manager.html) in order to achieve the same functionality on mobile, however it doesn't seem to work very well on hololens.
Any help would be very appreciated, thanks!
AR Foundation is a Unity tool and 2D Image tracking feature of AR Foundation is not supported on HoloLens platforms for now, you can refer to this link to learn more about feature support per platform:Platform Support
Currently, Microsoft does not provide an official library to support image tracking for Hololens. But that sort of thing is possible with OpenCV, you can implement it yourself, or refer to some third-party libraries.
Besides, if you are using HoloLens2 and making the QR code as a tracking image is an acceptable option in your project, recommand using Microsoft.MixedReality.QR to detect an QR code in the environment and get the coordinate system for the QR code, more information please see: QR code tracking
I know that i have to use gstreamer for creating an application to capture photo and videos
from web cam. But, i could not find any documentation describing vividly the steps for creating the
same. It will be very pleased,if any one could helped me in this.
Regards,
iSight
There is a GNOME/vala tutorial in the work that shows you how to make a Gtk application to grab pictures:
https://developer.gnome.org/gnome-devel-demos/3.10/magic-mirror.vala.html.en
Saving a video is left for you to do, you'll have to use a tee to have both live preview and recording simultaneously.
Also, there is a high-level object, camerabin, for your case, but I never used it myself.
Camerabin is being used by libcheese, that is even higher level and depends on Clutter (but not Gtk), and allows you to plug effects with cheese_camera_set_effect().
Pick what you need!