I will try to explain the context of the project on which I'm working and the problem which I currently try to overcome. I would like to collect mobile data for analytics purpose, e.g. using Firebase from Google. After collecting thoses data, I'd like to store them in a local database, such as PostgreSQL or MongoDB. But the thing is mobile data collecting platform such as Firebase mostly doesn't support connecting to a local database. I've found out that there is a possibility to export raw data from Firebase to import into a local database, but I have no detail information about this. I've searched through many documentations and I couldn't find anything.Has everyone ever had this kind of problem and can give a clear guidance about exporting data from Firebase and import into a local database? Thanks in advance.
Google Analytics for Firebase collects enormous amount of data and send it to the servers in form of batches or bundles. Three things here with your design:
SDK collects that data and does not expose it for you to parse in the app and store it in local DB.
Storing this much data locally, you are going to re-invent the wheel. In addition, this could cause performance issues.
If you need all the data collected by Firebase in raw form, just link Firebase to Big Query and all data would be available to you.
Related
I have data getting stored in Google firebase (i.e. output of google vision API). I need the same data to get stored in MongoDB which is running on AWS. Is there a connectivity possible between Google cloud and AWS for data migration?
There is no out of the box solution for what you're trying to accomplish. Currently Firestore supports exporting it's data as documented here though the format of the export is probably not something MongoDB could import right away. Even if the format was compatible you would need some kind of data processing pipeline to handle the flow from side to side.
Depending on how you're handling the ingestion of Vision API results you might be able to include code to also send that data to MongoDB. If that's not the case you might need to design a custom solution for this particular use case.
Can't find any option to import my SQL Database into Firestore database.
Realtime Database has this function, for example.
Is it suggested to be available in Firestore after the Beta ?
I don't think there is a direct import right now.
You have a few options though:
Use the Firebase libraries to export data from your SQL application into Firestore manually (alternatively write a cloud function and get the data via an API). This can also be a good option, if you need to keep both DBs in sync for some transition time.
If you need to get your user accounts over to Firebase Auth, read this article
If you already have your data in a Firestore, gcloud now has an import in beta (https://firebase.google.com/docs/firestore/manage-data/export-import)
From your description I fear that the first option is the way to go for you. Unfortunately Firestore is still in beta and we have to create a lot of functionality ourselves (like SQL imports, data migrations, test mocks, …).
I have a firebase database where I am storing records. Is there anything already existing features in firebase by which I can use/compose a form to make entries to the database?
The Firebase console has a panel where you can see and manipulate the data in your Firebase Database. But beyond that, there is no functionality in the SDKs to help you build edit forms.
I am developing a hybrid Cordova app (but only for Android platform) using Meteor.
App should have offline support, in a way that a user can add objects that are stored offline, in a SQLite database, and after the user connects to Internet, sync the data with server (Mongo database).
Problem is a can't find any solution for synchronisation.
I have looked at GroundDB that provided the mechanism for synchronization I need, but stored data in localStorage which doesn't provide enough storage. In newer versions it doesn't provide sync mechanism, only cashing.
Do you have any suggestions or experience with this type of problem? Any help would be much appreciated.
You could look at LokiJS, which is in a high performance JS database, with features to sync to Mongo.
I haven't used it myself, but from looking at the site, it may do what you need. http://lokijs.org/#/
You can also check out MongOGX which is a Javascript "clone" of mongo for the front end
My app will consume a xml web service that will pull info, images and documents from the server and store it offline (docs and images are stored on a path, not in the database). I need to perform some simple queries on the offline data for viewing and browsing the offline data.
There will be no updates made on the client, the data is readonly, no need to push updates back to the server.
Should I use Core Data? Or plain XML?
What is the best solution for storing this data?
Thanks.
CoreData, its reliable and will give you the query abilities you want. You could use sqllite too but CoreData will probably be simpler, especially if your data structure is not changing alot.