Can we use Confluent Kafka JDBC connect in Apache Kafka Cluster ?
I am trying to use Confluent JDBC connect to install and configure it on apache kafka cluster for source properties connecting to mssql database.
Yes.
Kafka Connect is part of Apache Kafka. The JDBC source and sink connector from Confluent is just a plugin for the Kafka Connect framework.
You can find out more here:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector
http://rmoff.dev/ksldn19-kafka-connect
Related
I am using Kafka MSK in AWS. So we don't have native kafka connect with all required connectors like on confluent.
Actually I work with kakfa mongo connector and I want to find a way to push the kafka mongo connector jar to an on an instance of kafka MSK cluster.
The path to which the jar will be pushed is the plugins.path as defined in the properties of the used connector.
ANy way to make it please ?
MSK doesn't give you a hosted Kafka Connect worker. You'd need to provision and run this yourself, e.g. on EC2. This work would then connect to your Kafka cluster (MSK in this case)
To be clear: MSK is only the hosted Kafka brokers (and Zookeeper). It does not include Kafka Connect, which is what you need in order to run connectors.
I want to connect mongodb to kafka using Kafka connect.
but I am using kafka MSK , no kafka confluent connectors can be used. Do you have any idea how to do it please ?
Thanks.
You would need to run the Kafka Connect worker yourself, and install the appropriate MongoDB connector in the worker. You can find a list of connectors at https://hub.confluent.io.
Is there any support for arangodb kafka connect source connector ?
I can only find a sink connector.
I'm using the Azure HDInsight's managed Apache Kafka solution since unfortunately there's no managed Confluent Kafka solution on Azure. Is it possible to run the Confluent Schema Registry and connect it to the HDInsight Apache Kafka cluster's brokers?
I'm hoping to install just the Schema Registry on a single VM, then using this line in the schema-registry.properties file, point it to the HDInsight cluster's list of brokers:
kafkastore.bootstrap.servers=PLAINTEXT://localhost:9092
Will this work? Or do the brokers need to be Confluent installations and not Apache?
The Apache Kafka brokers in Confluent Platform are Apache Kafka. So yes you can self-host Schema Registry and connect it to Apache Kafka from another distribution.
I am trying to to use Kafka Connect to HBase and there are no Confluent supported connectors available for HBase, though there are some community connectors available. We are not really ready to take risk in production with out support to the connectors: Is there any other work around for HBase connectivity from Kafka Connect? Can we use Kafka JDBC connector for Kafka Connect?