I am working on developing an iOS video app that needs to do stuff like apply filters, adjust brightness/contrast/saturation add overlays etc. As I am new to image processing I am not able to judge which resources (i.e. APIs, open source libraries) I can use. So any guidance from those who have experience in this field will be of great help.
Here is a great tutorial about GPU-accelerated video processing on Mac and iOS:
http://www.sunsetlakesoftware.com/2010/10/22/gpu-accelerated-video-processing-mac-and-ios
Use OpenCV.
1. Get OpenCV
Check out OpenCV homepage to download OpenCV source.
2. Check out this SOF for more details on OpenCV on iOS
iPhone and OpenCV
3. Get and read some good books on OpenCV
The best book on OpenCV is "Learning OpenCV" written by Gary Bradsky, main founder of OpenCV.
Second one is "OpenCV cookbook".
These books contains lots of examples on OpenCV along with description
4. Check out OpenCV documentation.
OpenCV documentation contains details of complete functions. It also includes a lot of tutorials, which are really good for all.
5. Also try running OpenCV samples. It contains a lot of good programs
All the best.
Related
I am searching for a way, to achieve real time image recognition in dynamically, I have to scan object (it can be a product) and show details about that object.
Is it possible by using native frameworks like ARKit? Or I have to go with third party libraries by using recent methodology?
Example: https://www.youtube.com/watch?v=GbplSdh0lGU
Can someone suggest a way?
Thanks.
Yes, it's possible by using Apple's native CoreML and Vision frameworks.
But you need to know about all the products in your library in advance.
You can read about it in this Medium post: CoreML Machine Learning on iOS.
Also, watch this WWDC 2017 video about Vision/CoreML frameworks.
I'am new to Iphone, to Xcode and to openGL ES.
I looking for an example of a source code witch demonstrates how to create 3d object, rotate it with gestures and zoom in, zoom out ...
Thanks,
Alex
Here is the simple example how to display and rotate 3d models created with Blender: http://iphonedevelopment.blogspot.com/2009/06/using-3d-models-from-blender-in-opengl.html
The complete source can be found here: http://innerloop.biz/code/ExportTest.zip
I can recommend the OpenGL SuperBible 5th Ed. It starts out with the very foundations with lots of example code (I believe the specific scenario you describe is chapter 5), and moves on to topics like platform specific development, OpenGL ES for the iPhone... - and it's a decent read, a rare quality among textbooks, in my opinion. All examples and code in the book should compile in Xcode, and they show various exceptions for individual platforms as necessary.
I am currently looking at this challenge as well.
I will put up my findings so far, and whack a bounty on this question to try and get some focus for it.
http://nineveh.gl/ promises to do the job, but it is in beta and even the most basic examples don't run out-of-the-box (they give compiler errors). so I couldn't recommend it.
It is possible to integrate Unity with native iOS code, eg
http://clevermartian.com/blog/?p=59
http://technology.blurst.com/a-cocoa-based-frontend-for-unity-iphone-applications/
but that stuff looks scary
http://www.sunsetlakesoftware.com/molecules is open source; it may be possible to lift something from there.
I see you had answered this but a good tutorial are the Lamarche Tutorials, there is also OpenGLES 2.0 tutorials:
http://iphonedevelopment.blogspot.co.uk/2009/05/opengl-es-from-ground-up-table-of.html
Also for loading up models look up setting up the POWER VR SDK as there is all the things you need to loading up a 3d model with bone animation , textures lighting e.t.c.
i am not sure if this is what you have searched and looking for but you can take a look at : http://nehe.gamedev.net/tutorial/texture_filters,lighting&_keyboard_control/15002/
in the lower portion of the page, you can see that there is the example code for macos/cocoa ..
i'm still not sure but hope this helps..
I had a play around with OpenGL ES a year or so ago, and I found this on-line O'Reilly book very helpful: http://ofps.oreilly.com/titles/9780596804824/
The chapters are typical of most books on this subject; math primer to 'Advanced' (typically your usual scene using shaders that implement cube-maps, bump-maps etc)
You are also able to download the source code for the examples.
Edit: I also own this book http://www.amazon.co.uk/OpenGL-ES-2-0-Programming-Guide/dp/0321502795/ref=sr_1_1?ie=UTF8&qid=1336064164&sr=8-1
Which I found was a good read with respect to OpenGL ES as-well as 3D graphics in general.
I have used the library for reading barcode from image. But can't find any source or help for reading numbers from image.
I just need to take photo with camera and then process image whether any numbers exist and read out the numbers.
Is there any way to get the number written on image?
that's OCR type of problem. you might want to take a look at: Is there any good OCR API for iPhone and/or Android phones? or iPhone: Regarding OCR technology?
The Google Docs API has some OCR support. You may want to take a look at this and see if you can implement it: http://googlesystem.blogspot.com/2009/09/google-docs-ocr.html I don't remember if Apple will allow you to use any external libraries though.
Is there any library alternative to OpenCV which detects smile.
I dont want to use OpenCV as it sometimes fails to detect faces due to background.
Any one knw other library ? other than OpenCV ?
I would recommend having a look at The Machine Perception Toolbox (MPT Library).
I had a chance to play with it a bit at an Openframeworks OpenCV workshop at Goldsmiths and there is a c++ smile detection sample available.
I imagine you can try the MPT Library for iPhone with openframeworks or simply link to the library from an iphone project.
sometimes fails to detect faces due to
background.
An ideal lighting setup will guarantee better results, but given that you want to use this on a mobile device, you must inform your users that smile detection might fail under extreme conditions (bad lighting)
HTH
How are you doing smile detection? I can't see a smile-specific Haar dataset in the default OpenCV face detection cascades. I suspect your problem is training data rather than OpenCV itself.
Egawer is a good starting point if you need a working app to begin with.
https://github.com/Atrac613/egawer-iOS
I checked the training images of smileD_haarcascade_v0.05, an found that they include the full face. So, it seems to be a "smiling face" detector rather than a smile detector alone. While this seems easier, it can also be less accurate.
The best is to create your own Haar Cascade XML file, but admittedly most of us developers don't have time for that. You can improve the results considerably by equalizing the brightness of the image.
iOS 7 now has native support of simile detection in CoreImage. Here is the API diff:
For iOS 7, Yes, now you can do it with CoreImage.
Here is the API diff in iOS 7 Beta 2:
CoreImage
CIDetector.h
Added CIDetectorEyeBlink
Added CIDetectorSmile
I've started looking on the subject of Acoustic Fingerprint (http://en.wikipedia.org/wiki/Acoustic_fingerprint) for a pet project of mine for the iOS and I was wondering if there are:
Any opensource libraries or source code for the iOS that handle this?
Assuming I'm a veteran jack of all trades coder, is it very problematic to implement this myself if there is no open-source versions?
Will the Accelerate DSP library in iOS able to handle such a task?
Thanks
you may want to check out the EchoPrint CodeGen library by The Echo Nest. They even have a fully functional iOS code example.
You can find some additional links to open source audio fingerprinting related software in this MusicBrainz article, but AFAIK the EchoPrint library is the only one that has a license that is compatible with iOS apps.
Good Luck!
Not of my knowledge
No problem for a veteran, that won't be easy, but achievable.
Never looked into.
Even in java, this might be an interesting reading.
Before doing anything, especially if you intend to sell on AppStore, take care that these techniques/algorithms are patented. Read what happened to the above blog post writer.
Will the Accelerate DSP library in iOS able to handle such a task?
NO
I also notice that you put the tag "voice recognition". Just to make sure voice recognition as nothing to do with audio identification/acoustic fingerprinting !!