I'm searching a way to retrieve data (csv format) from something which is not a file, let me explain.
In the company i'm in actually they quit Fileserver to Google Drive - So i'm actually trying to read information from a google spreadsheet but it didn't work nicely so far.
Any idea how to do this ? Any other idea on a way to centralise datas (CSV format) which is neither fileserver or using GDrive ?
The data source should be easily modified (no database..)
Thanks.
Related
For a project I'm working on I have a CSV reader to read user input. But that's quite an annoying UX, cause the user has the data in a google sheet/ execl (xlsx) format or numbers format. So if the user did not convert the file to CSV before uploading, they need to navigate to the Numbers app and export the file to file to CSV there.
So I was thinking how can I make this better, first thought, yeah just read the xlsx or numbers file ..... One day googling and trying some stuff, I still didn't find a good approach.
I would love to hear your input, I'm sure somebody out there has experience with this.
I'm thinking about creating an API for it. But I prefer to handle it natively in swift.
Thanks!
Could someone please guide me on how to extract a .docx file and load it onto a database using an ETL(Extract-Transform-Load) or ELT(Extract-Load-Transform) tool?
Assuming that the .docx file contains mostly unstructured data, isn't it an ELT tool I should go for instead of ETL?
The ETL and ELT tools I found this far didn't support the MS Word component. What other way is there to extract and store the content in a .docx file onto a database?
My requirement is to:
Extract the data inside the .docx file,
Convert them into meaningful data, and
Store them onto a data lake so I can perform data analysis, and take productive decisions based on those results.
It's just like how e-commerce companies convert customer reviews into meaningful data so they can take decisions to boost their sales. In my case, it's Word files I need to analyze.
I'm asking this because I've searched for so many ETL and ELT tools but couldn't find anything that supported Word files. Maybe it's because I haven't been searching for the right tool or the right way to do it?
If somebody knows a way, please guide me through the process. What should I start looking for? A tool, or a way to code the entire thing?
I've been looking for an answer for weeks now but didn't find a helpful answer. And it's starting to get really frustrating to see all the tools supporting every other component like social media, MongoDB, or whatever EXCEPT Word files.
You have to do this in 2 steps:
Extract the data from the .docx file to txt or xml
Now use SSIS to import. (Azure Data Factory if you are in the cloud)
Following these instructions for exporting firestore to google cloud storage I was able to produce an export folder in GCS.
After looking at the data it's kinda familiar I recognize parts of it. It's filled with stuff like this zamount �* !ÆG·zT8#z I recognize the word amount from one of my fields.
I don't understand how this export data is helpful or meaningful. If I needed to reconstitute my database from these file, how would I even start?
Clearly I'm missing something because this is borderline gibberish.
The format of a Firestore is undocumented. It's a binary representation of the document data. The only supported ways to import the data from that export is using the instructions in the related documentation using gcloud firestore import or the GCP console.
If you want an export whose format you can parse and work with programmatically, you should find a different mechanism. I'm sure there are other libraries out there that can do what you want.
Is it possible to get Google Drive to automatically convert uploaded documents to the native format?
I know it works with manual upload (i.e. Google Drive can auto-convert files you upload via the website), but I want to avoid having to upload every file by hand.
I'd prefer to use the API, or better yet, dump the files in my ~/Google Drive folder.
Using the API, you can pass the convert=true parameter to files.insert. The uploaded file will attempt to be converted to a native Google Docs format.
Sure, see this answer. Note you can upload a text file or a csv file and set its content type to google doc or google sheets respectively, and google will attempt to convert it. I have tested this for text -> doc and it works. You will need to set the const contentType at the start of the code to one of the supported google mimetypes.
I want to store textfield values in pdf file i.e I need to export form values to pdf file just for back up purpose as I cant completely rely on app database so how can I achieve this. Can somebody help me pls. Or can we export data in excel file.
I cant completely rely on app database
Millions of apps rely on Databases! what about XML storage?
XML will be easy to store, easy to retrieve values.
I believe you're looking for xlslib
Good Luck.