I am using CloverETL Designer for ETL operations and I want to load some csv files from GCS to my Clover graph. I used FlatFileReader and tried to get file using remote File URL but it is not working. Can someone please detail the entire process here??
The path for file in GCS is
https://storage.cloud.google.com/PATH/Write_to_a_file.csv
And I need to get this csv file into the FlatFileReader in CloverETL Designer
You should use the Google Cloud Storage API to GET the file; Clover's HTTPConnector component will allow you to pass in the appropriate parameters to make a GET request (you will presumably have to do an OAuth2 authentication first to get a token), and send the output to a local destination specified in "Output File URL." Then you can use a FlatFileReader to read from that local file.
GCS has several different ways to download files from your buckets. You can use the console and the Cloud Storage browser. Steps: open the storage browser, navigate to the object you want to download, right click, and save to your chosen local folder. If you use Chrome the save appears as “Save Link As…”.
To use the GS Utility, use this command:
`gsutil cp gs://[BucketName]/[ObjectName] [ObjectDestination]`.
Or you can use client libraries or the REST APIs to download files. With these last options you could work with a number of files or create a job to download them. Once they are in a location known to Clover ETL the process is straightforward.
Within Clover designer, under the navigation pane you can right click a folder and choose import. Pick the one in which you placed your GCS file. Once the file is imported then you can use data from it like any other datafile in Clover. Since this is a .csv file, remember to edit your metadata (right click the component, choose extract metadata then edit inside the Metadata Editor -- for data types, labels and such.) Assign metadata to the edges of your components so they know what is coming in/going out of that step. Depending on your file, this process may be repeated many times.
Even with an ETL tool, getting the data and data types correct can be tricky. If you have questions about how to configure data types or your edges in an ETL project, a wiki may help. The web has additional resources may help you get the end analysis you’re looking for.
I am trying to get a twbx file from twb file from commandline(tabcmd).
I have tried http://community.tableau.com/thread/135045.
The problem with the above mentioned site is that it requires data extract(.tde) file to be uploaded and this .tde file cannot be generated by using tabcmd.
How can i complete the above mentioned task using tabcmd.
OR is there any better way to transform twb -> twbx file.
It's not clear from your description, so I'll have to cover both scenarios:
If your workbook was published with an extracted data source (an "embedded" data source), then it is possible to download a packaged workbook using tabcmd.
If your workbook is using a published extract data source, then downloading the workbook with tabcmd (or any other means) will not automatically download the published extract. Even if you were to download the data source XML file, you still wouldn't have the extract - getting the extract itself would require opening the data source in Tableau Desktop, logging on to Tableau Server and then creating a local copy
Since it's likely that you're dealing with scenario 2, then I would suggest that you contact Tableau Support as they can file a feature/enhancement request for you
Hi I am using extract to view a workbook in tableau server.
I deleted the local extract as well as the extract in the server.
I am still able to see that data is being pointed.
Struggled a lot to understand this.Does tableau create temp folder to store?
FYI It is not in live mode(since the data is not being changed until I refresh).
How do I point to server extract?(is it automatic)?
If a workbook on Server is pointing to a server hosted data source and that data source is delete, then it would not render. If you're still able to view the data, then it sounds like the workbook was uploaded with the extract. Check the file size, if it's large, that's probably what happened.
friends,
I have a Macro enabled excel file. How and where I can upload my Xlsm file and do the updation. I mean, I want my HR people to do the updation on regular basis on this XlSM file from the branch office and myself want to see the updated XLSM file at my Head office. Is there any way for that? I think Google docs cannot be possible.
thanks in adavance.
you may use database as a place that will store data. Your remote HR fill in excel tables then upload it to database (Access or MySQL or whatever) then you can download it wherever you are - this method requires writing macro that use ADO component - there is planty of tutorials about it.
regards
m
I am new to using tableau server. I wanted to know if it was possible to download a tableau workbook (which is linked to a live SQL DB) with the data from the tableau server? Basically I would want to have a downloaded packaged tableau file which I can pass around for demos, without having to connect to the database every time.
You can do this programmatically in python simply.
TSC(Tableau Server Client) is the python library for tableau server.
You can publish, update, delete and download workbooks freely using TSC
Please visit https://github.com/tableau/server-client-python/blob/master/docs/docs/api-ref.md
On this page, just search by "workbooks.download", then you will get the instructions how to download a workbook with data extraction.
In essence, no. Since the workbook is using a live connection, the data is still on the SQL database and not on Tableau Server.
If you want to be able to create a packaged workbook for demo use, then you'll have to create an extract of the data that can be saved with the workbook.
There is another approach to this problem. Now that the viz is using the tableau online extract.
1.Download the workbook from the server.
2.Once done, open the dashboard in tableau desktop. You will see a data extract with a check mark on it.
3.Right click on the data extract and click on create a local copy.
4.This will extract all the data so far and stores it locally.
5.Next step is to replace the datasource from the Online extract to the local copy you have created. 6.Save the workbook as .twbx.
You are done. Hope this will work for you..
I believe what you are trying to do can be accomplished using a tableau extract. This will create a package of the sql db you want on the tableau server. the user could then make a packaged workbook or make a local copy of the extract.
http://kb.tableau.com/articles/knowledgebase/working-with-tableau-data-extracts
Yes, you can from the top tight hand corner of the view depending on your user permission levels.
When you connect tableau server data source click on extract then publish your workbook to server. when any one click on download the extracted data will also download along with worksheet
you must have the permission to download.at least Interactor
click "download", then save the workbook as "twbx" file to include data in the package file.
if your permission is "viewer", you cannot download tableau reports.
one more thing you could do is.
open workbook on server>>>>click download>>>>>select data>>>>go to full data>>> select show all column>>> download all row as text file
now download the workbook create a new data source with a text file you just downloaded. select create an extract
after completion, select replace data source
and it's done.
Unfortunately you cannot unless you have the credentials for the live db connection, if you do you can download the workbook and create a local copy of the data source by entering the credentials and then extract the data which will store the data locally. This will improve the performance as well as then you will be using Tableau extract which is optimized for reporting
With a live connection you will not be able to download the data with a Tableau workbook.
For this you can follow this pocedure :
Create an extract connection in your workbook and publish it in the server with an refresh schedule to it (As per you Data updates).
Now whenever you download the workbook it will come with the last refreshed data with it.
Hope it helps :)
make the data connection as extract, then it will copy with data copy in dashboard.
Download your workbook.
Edit your data Sources
Right-click Data Source and select "Create Local Copy"
Select the original data source .. right click it and replace it with the local copy
Lastly, right-click the original data source and close it.
There you have your workbook with a local extract(tde)
You can refresh this local extract anytime you want by refreshing the data source.
You can do so by using tableau extract file(.twbx)
But if the workbook has large data and can't create extract locally, then we can use something called empty extract.
Here's how
https://www.tableau.com/about/blog/2013/9/easy-empty-local-extracts-25152
Make an empty extract using above method and load it on server.
Let server build the full extract and then download it.
You are good to go with that workbook.
Since the workbook is using a live connection, the data is still on the SQL database and not on Tableau Server.
If you want to be able to create a packaged workbook for demo use, then you'll have to create an extract of the data that can be saved with the workbook.
Create an extract connection in your workbook and publish it in the server with an refresh schedule to it (As per you Data updates). Now whenever you download the workbook it will come with the last refreshed data with it.
You can save it as a .twbx or download from the published version