Kafka JDBC Sink Connector compatibly works with PostgreSQL 12? - postgresql

I'm looking for the documentation mentioned the compatible databases that Kafka JDBC Sink Connector (developed by Confluent) is working well with. However, I cannot see any documentations mention that one.
I'm seeing the insertion performance issue after upgrading our database to Postgres 12 from Postgres 9.5. Wondering if that's caused by the current JDBC Connector version we're using or any other things.
Please give me your advice.

You should be able to infer what databases are supported from the source code that specifies what driver versions are used
https://github.com/confluentinc/kafka-connect-jdbc/blob/master/pom.xml#L59
You can also look at the dialects available
https://github.com/confluentinc/kafka-connect-jdbc/tree/master/src/main/java/io/confluent/connect/jdbc/dialect

Related

Azure Postgres Single server version upgrade

Azure Postgres Single server version is 11. Is it possible to upgrade it to 13+ version using dump and restore as mentioned here:
https://learn.microsoft.com/en-us/azure/postgresql/how-to-upgrade-using-dump-and-restore
It should still remain Single Server.
Yes, you can.
The document you shared is Microsoft's official and therefore there is no doubt that you can upgrade it to any higher version using dump and restore.
Just take care of the below mentioned points:
You can upgrade your PostgreSQL server deployed in Azure Database for PostgreSQL by migrating your databases to a higher major version server using following methods.
Offline method using PostgreSQL pg_dump and pg_restore which incurs downtime for migrating the data.
Online method using Database Migration Service (DMS). This method provides a reduced downtime migration and keeps the target database in-sync with the source and you can choose when to cut-over. However, there are few prerequisites and restrictions to be addressed for using DMS.
The following table provides some recommendations based on database sizes and scenarios.
Choose the right approach based on your database configuration and it should be done without any issue.
To upgrade using pg_dump and pg_restore, you can refer Migrate your PostgreSQL database by using dump and restore.
It is not possible.
In the document, prerequisites states:
A source PostgreSQL database server running a lower version of the
engine that you want to upgrade. A target PostgreSQL database server
with the desired major version Azure Database for PostgreSQL server -
Single Server or Azure Database for PostgreSQL - Flexible Server.
The question asks about upgrading target.

Issues with SQL Developer and PostgreSQL JDBC driver

I'm trying to assist user who suddenly no longer is able to connect to database using PostgreSQL JDBC driver. PostgreSQL connection tab is not clickable. All of her colleagues do not have such issues. I have re-installed SQL developer several times, backed up and deleted SQL config folders from C:\users\username\appdata\roaming, re-added driver, nothing seems to change. I have limited knowledge about SQL as I don't use it and neither is there much information about this as it doesn't seem like a common issue. User uses following software:
JDK 8 -172 64 bit,
SQL Developer 17.2.0,
PostgreSQL JDBC driver 42.2.18. Added screenshot just in case. Any help would be appreciated.

Postgres version compatibility

I was using PostgresSQL version 9.6 with JDBC driver 9.4-1206-jdbc42 to connect to Java. I was using the SimpleJDBCCall of Springs to connect to the database.
However, after the upgrade of PostgreSQL to 10.5, we are unable to use the SimpleJDBCCall API. Any light on this issue will be of great help.
You should never use a version of the JDBC driver that is older than the PostgreSQL server release.
The recommendation is to always use the latest driver version. A new driver will know how to talk to an old server, while an old driver might not know how to talk to a new server.

Use Postgresql as a datasource for Microsoft Analysis Services

Has anyone managed to use Postgresql as a datasource for SSAS? The Postgresql .NET connector seems promising, but the SSAS view wizard does not seem to be able to see the tables in the database.
Try using the ODBC connector. I've had success getting other tools to connect to PG using it. The EnterpriseDB installers not only include a well packaged, working version of PG for windows, they include working, correctly installed drivers.
http://www.enterprisedb.com/products-services-training/pgdownload
try pg_bulkload for load from via c# & from mssql to pgsql
copy & bcp (ssis) for second direction (pgsql->ssas)
242
It is actually possible to hack the Postgresql .NET connector and implement a "MSSQL compatibility mode", where the [ and ] around tables and schema names are removed. Using this, the list of tables does not appear in MS SSAS, but it is possible to replace them by views.

Flyway: Support for older DB's

I'm currently trying to set up some simple migration scripts for our databases. I was checking flyway, which seems to be simple enough for what I need. My problem is that, for Postgres, only version 9 is supported (we're using 8.4). Is it possible to work around/fix this limitation somehow, or should I start looking for other options?
Edit: I forgot to mention that when I run something like mvn flyway:status, I get the error message:
Flyway Error: java.lang.IllegalArgumentException: Unsupported Database: PostgreSQL
I can connect to the DB via psql, and I'm using the correct jdbc driver, so when I saw the requirements page in the documentation, I assumed that the version was explicitly checked by flyway.
What limitations do you encounter? Flyway is only tested on PostgreSQL version 9.0, that's it. It's not said that older PostgreSQL versions don't work. Just give it a try.
You could also setup a PostgreSQL 9.0 installation on your testbox to see if there is any difference.