How to combine multiple excel data into one excel with all sheets? - talend

Actually I have a list of customers from all the countries in one sheet name "ALL".
Problem: I have to crate separate sheets for group of countries like for USA sheet name will be USA and for Australia,Germany and Switzerland sheet name will be Central_Region output will be like below image.
What I have tried till now :- I used tFilterRow component and I have got all the separate excel files group by countries . now trying to combine in one file.
For Example : I have 5 excel workbook files each has one sheet like excel1.xls has sheet "USA" other excel2.xls has sheet "Canada" and same other 3 are in same way.
Now I want to generate a single excel workbook which will have all the sheets like "USA", "Canada" and all other sheets from other excels.
I tried using iUnite but it did not help it just append all the sheets data into one sheet.Like below image

Download this add-ins
Open one your excel file and then open this add-ins file (also you can install that)
when you open this file, select Enable Macro.
Go to DATA tab on excel file and select RDB Merge add-in.
set properties and push Merge Button.
With this, your excel fills will merge in one sheet.

If you can't know in which order row will appear, you could store your data in csv files for each country.
Then you can add each csv file into a separate sheet on the Excel file using Write after.
If rows are coming in the rigth order, like all USA then Canada etc . . . you can directly use Write after in your ExcelOutput behind your tFilter but i highly suppose this is not the case.

If you have same structure excel file with different in sheet name then you have to make job like this.
tFileList---tFileInputExcel-----tMap---tFileOuputExcel
Set source directory where you get all the files to the tFileList component.
Use global varibale which hold "file with path" information and assign to the file name text box of tFileInputExcel component.
In select Sheet box assign index instead sheet name.
check Append property of tFileOuputExcel component you can merge all files in single one.
Note: in tMap you can add transformation or make changes in column sequence of output.

Related

How to check if the file contains certain values before reading in Talend Studio

Hello beginner in Talend Studio here and first time poster. I am using Talend 8.0 and have a text file to ingest into a database that has the following:
H2||ID||portfolio||manager||name
D||5||8001-1101||48||John Doe
D||6||8001-1102||50||John Doe
D||7||8002-1101||20||Jane Doe
F3||||||||
where the delimiter is a double pipe (||)
ID, portfolio, manager and name and its associated records are the data I'd like to ingest. The first column with "H2", "D" and "F3" are the header, detail and footer indicators respectively. These indicators are not supposed to be ingested but will need to be checked for their presence when the file is read into talend studio.
I need to check if these three indicators are available in the file. If either of these indicators are not in the file, it should not ingest the file and output a message. If the indicators do exist, the data is ingested but only the data for the columns "ID","portfolio","manager" and "name"
I tried using the following components:
Which will read the table in its entirety including the H2 column. I then use t-map with a filter
row1.Header.contains("D")
which keeps rows that has "D" indicator. Appreciate if there is a better way to do this
Use row1.Header.contains("D")&&row1.Header.contains("H2")&&row1.Header.contains("F3") to filter header in ("D","H2","F3")
If you want the reject check the option in an other output and check output reject to true

tableau, excel workbook, three worksheets, want data sources column in union

I have a question on Tableau Desktop. I have an excel file with three tabs: Applications, Shared Drives, Sharepoint_Libraries. I would like to union all of these tables. I would like a column called Data Source with the below values. So from Applications excel file, I would like a Data Source column in the Union which says Applications. So from Shared Drives excel file, I would like a Data Source column in the Union which says Shared Drives. Lastly, from Sharepoint_Libraries excel file, I would like a Data Source column in the Union which says Sharepoint_Libraries. How can I do this in Tableau? Do I need to edit the source excel files and add the Data Source column in each file? Or, can I create a calculated field called Data Source and use a formula to populate this information?
Data Source
Applications
Shared Drives
Sharepoint_Libraries
Tableau has a "merged mismatched fields" option for this situation.
So..
open Desktop
connect to the Excel file
drag over the Applications sheet
drag over the Shared Drives sheet and position it just below Applications until you see the "union" box appear then release your mouse button
repeat for Sharepoint Libraries
in the preview window (below) you will see the three different fields.
highlight the three fields that you want to merge
right-click and choose Merge Mismatched Fields.
Then you can rename the field accordingly :)

Upload multiple files to pentaho

In pentaho data integration, how do I import a list of xlsx files that are in the same folder?
note: the number of columns are always the same
If your excel column name and sheet name are always same then you can use THIS solution. Here I have take all xlsx file from source folder and convert one-by-one file as csv.
But if your excel columnname and sheet name are dynamic or you need some dynamic solution. Then you can use my another stackoverflow solution from Here

Qlik excel data import for columns with same name

I have 4 different excel sheets and I have been loading them in QlikSense. The common column names get suffix EXPORT WORKSHEET1 . Although I change the name of the sheet after importing, the alias remains the same. How can I change that? Thanks.
I needed to change the name of the sheet within the excel sheet before importing it into QlikSense. Thanks.

How to Load multiple excel sheets data to the same table in SSIS?

I am bit confused on my business scenario and need your's valuable suggestion to go ahead .
I got one excel work book template from the client and it is having 8 sheets and 250 columns and each sheet having different columns and there is no relationship from one sheet to other sheet in terms of column names (one sheet has 60 columns with 5000 rows and other sheet has 10 columns with 200 rows ) as well as data also .
I Need to load this data into single table using SSIS ?
Our client confirmed there will not be change in their inputs ?
Here are steps for ur scenario
1- create a table which has all the columns in excel sheets. If column names are repeating on multiple sheets. You will have one time in your table.
1- bring data flow task. Bring excel source. Make connection to ur excel. Choose sheet1 and then bring oledb destination and map input columns to table. If the column names in table will b same in ur sheet. They will map automatically.
2- bring second data flow. Bring excel souce. Use existing excel source n choose sheet2. Get oledb dest n map to ur destination table.
Get third data flow n load third sheet. Repeat for ur all sheets.