how to insert data into MySql using Azure data factory - azure-data-factory

In Azure Data Factory, the Copy activity doesn't support MySQL table in Sink setting (link). I need to copy some data from another database's table into a relevant MySQL table. Do we have any other Activity that can do the MySQL's insertion? Thanks.

Here's a guide to using an ODBC sink/source
https://learn.microsoft.com/en-us/azure/data-factory/connector-odbc?tabs=data-factory
Install a self hosted runtime on a server
Connect the self hosted runtime to the ADF instance
Install the MySQL ODBC driver on the server, set up a DSN and test it
Test it in the self hosted runtime console
Set up an ODBC linked service in ADF. Test it

Related

Load data from Azure PostgreSQL to Azure Analysis Services (AAS)

I have a Azure database for PostgreSQL and want to set up my Azure Analysis Service with this Postgres on Azure as datasource.
I'm not sure whether PostgreSQL on Azure is supported by AAS? I am getting the below error when trying to connect:
Error
I tried with the below extension, but installing it did not resolve the issue:
Npgsql installed
My assumption is that I need to install the on-premise gateway to be able to connect this Azure PostgreSQL db - can anybody confirm this is the right direction and will resolve the connection issue?
I'm not sure whether PostgreSQL on Azure is supported by AAS? I need to install the on-premise gateway to be able to connect this Azure PostgreSQL db - can anybody confirm this is the right direction and will resolve the connection issue?
According to KranthiPakala:
Azure Database for PostgreSQL is not a supported data source of AAS.
You can connect to on-prem PostgreSQL as a data source for import or in-memory tabular models. In order to do this, select the ODBC data source option(start a new import connection , choose ODBC option, then pick the ODBC source name) and AAS will treat it like SQL Server.
References: Data sources supported in Azure Analysis Services and Specify provider data sources in tabular 1400 and higher model projects

Connect AWS Athena to Postgres SQL

I need to connect AWS Athena (which is binded to AWS s3 bucket) to a Postgres SQL database.
I have tried to connect with Tableau and PowerBI successfully (following the instructions in documentation) and the result was successful.
I think that I need to use the JDBC connector already installed on my machine and try to create a server in Postgres, but I cannot see any option in pgadmin in order to connect AWS athena to the server.
Any ideas?
Thank you in advance!

How do I connect from Azure Data Factory to an AWS-hosted Postgres database?

I have a Postgres database created on Heroku but looks like it's spun up on AWS based on the server name. Unfortunately, I can't tell if it's an Aurora or RDS instance.
I'm trying to create some data pipelines on Azure Data Factory to do some ETL work moving Blob files onto the Postgres Database but am having a tough time setting it up. The default Postgres option isn't working - looks like DataFactory tries to make a JDBC connection.
I'm stuck and am clueless as to how I should set up the connection.

Connecting to PostgreSQL Data Source in SQL Server Import Export Tool

I'm trying to setup an easily-replicable (or even manual and I do it once a month or so) process for moving data from a large Azure PostgreSQL database to a more manageable Azure SQL database for end users that are most familiar with SQL Server. I've successfully connected to the PostgreSQL database via PGAdmin, so I know all my connection string info.
I started by installing the latest ODBC driver from here.
I then used a connection string which was given to me from the Azure portal, filled in the proper database name and password, and attempted to use the following drivers:
PostgreSQL ODBC Driver(UNICODE)
PostgreSQL ODBC Driver(ANSI)
I am getting the following error with either of them:
ERROR [IM002] [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified
What step am I missing in this process? Or how best can I troubleshoot this?
After more research, I attempted to add the ODBC driver here:
And got the following error (I'm not sure why Tableau is relevant to this?):
Thank you.

I am in need of connecting to DB2 AS/400 database from Oracle Apex.

Is there any feasibility from Oracle to have a connection established to DB2 database so that I can query on DB2 database and generate reports from Oracle Apex?
OR
Is it possible to create a View in Oracle from a remote DB2 database?
OR
What options do i have in order to develop reports in Oracle Apex from the data i have in DB2 database?
(I know, this is an old question and you've already found a workaround. Anyway,) the keyword you might be interested in is gateway. This is Oracle 10g Database Gateway for DB2/400 Installation and User's Guide. I don't know which database you use, but - if 10g is not the one, I hope you'll manage to find the right documentation.
Shortly: after installing the gateway between Oracle and DB2, you'd create a database link. Then, in your Oracle schema, create a view that selects data over that database link from DB2 database. Finally, fetch data in Apex from the view.
As i didn't find a way to directly connect to DB2 from Oracle PL/SQL, i used a work-around. As this is a reporting tool, we are ok to have this tool running with the data which is 1 day off, we did the following:
1) Extract the data required from DB2 database to CSV files. We used a DB2 command which can be run at command line to extract the data into a CSV
2) Then we imported the data into Oracle tables using sqlldr