Getting below when trying to connect to zookeeper url using java
.Any pointers will be helpful
INFO 2017-04-11 21:07:34,482 [main] kafka.utils.VerifiableProperties - Verifying properties
INFO 2017-04-11 21:07:34,697 [main] kafka.utils.VerifiableProperties - Property auto.offset.reset is overridden to smallest
INFO 2017-04-11 21:07:34,698 [main] kafka.utils.VerifiableProperties - Property auto.commit.interval.ms is overridden to 1000
INFO 2017-04-11 21:07:34,698 [main] kafka.utils.VerifiableProperties - Property group.id is overridden to n_secondary
INFO 2017-04-11 21:07:34,698 [main] kafka.utils.VerifiableProperties - Property zookeeper.connect is overridden to xxx-xxx-0001.xxxx.xxxx.net:6667,xxx-xxx-0002.xxxx.xxxx.net:6667,xxx-xxx-0003.xxxx.xxxx.net:6667
INFO 2017-04-11 21:07:34,698 [main] kafka.utils.VerifiableProperties - Property zookeeper.session.timeout.ms is overridden to 6400
INFO 2017-04-11 21:07:34,698 [main] kafka.utils.VerifiableProperties - Property consumer.timeout.ms is overridden to 30
INFO 2017-04-11 21:07:34,699 [main] kafka.utils.VerifiableProperties - Property zookeeper.sync.time.ms is overridden to 2000
INFO 2017-04-11 21:07:34,728 [main] kafka.consumer.ZookeeperConsumerConnector - [n__secondary_xxx-xxx--0001.xxxx.wxxxx.net-1491944854725-7865dd0f], Connecting to zookeeper instance at xxx-xxx-0001.xxxx.xxxx.net:6667,xxx-xxx-0002.xxxx.xxxx.net:6667,xxx-xxx-0003.xxxx.xxxx.net:6667
INFO 2017-04-11 21:07:34,910 [ZkClient-EventThread-19-xxx-xxx-0001.xxxx.xxxx.net:6667,xxx-xxx-0002.xxxx.xxxx.net:6667,xxx-xxx-0003.xxxx.xxxx.net:6667] org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread.
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.8--1, built on 02/06/2016 03:18 GMT
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=ncl-sna-0001.corp.wayport.net
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_121
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.121-0.b13.el6_8.x86_64/jre
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/opt//Scripts/consumer/ConsumerKafka.jar
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/opt//////linux2x86/lib64:/opt/////linux2x86/lib64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=2.6.32-642.15.1.el6.x86_64
INFO 2017-04-11 21:07:34,923 [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=n_
INFO 2017-04-11 21:07:34,924 [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/var/home/n_
INFO 2017-04-11 21:07:34,924 [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/opt////
INFO 2017-04-11 21:07:34,927 [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=xxx-xxx-0001.xxxx.xxxx.net:6667,xxx-xxx-0002.xxxx.xxxx.net:6667,xxx-xxx-0003.xxxx.xxxx.net:6667 sessionTimeout=6400 watcher=org.I0Itec.zkclient.ZkClient#7e0b85f9
INFO 2017-04-11 21:07:34,964 [main] org.I0Itec.zkclient.ZkClient - Waiting for keeper state SyncConnected
INFO 2017-04-11 21:07:34,969 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server xxx-xxx-0003.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667. Will not attempt to authenticate using SASL (unknown error)
INFO 2017-04-11 21:07:35,072 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Socket connection established to xxx-xxx-0003.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667, initiating session
WARN 2017-04-11 21:07:36,401 [main-SendThread(hxxx-xxx-0001.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2137ms for sessionid 0x0
INFO 2017-04-11 21:07:36,401 [main-SendThread(hxxx-xxx-0001.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2137ms for sessionid 0x0, closing socket connection and attempting reconnect
INFO 2017-04-11 21:07:36,707 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Opening socket connection to xxx-xxx-0003.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667. Will not attempt to authenticate using SASL (unknown error)
INFO 2017-04-11 21:07:36,717 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Socket connection established to xxx-xxx-0003.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667, initiating session
WARN 2017-04-11 21:07:37,208 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2136ms for sessionid 0x0
INFO 2017-04-11 21:07:37,209 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2136ms for sessionid 0x0, closing socket connection and attempting reconnect
INFO 2017-04-11 21:07:38,227 [main-SendThread(hxxx-xxx-0001.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Opening socket connection to serverxxx-xxx-0001.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667. Will not attempt to authenticate using SASL (unknown error)
INFO 2017-04-11 21:07:38,238 [main-SendThread(hxxx-xxx-0001.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Socket connection established to xxx-xxx-0001.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667, initiating session
WARN 2017-04-11 21:07:38,852 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2135ms for sessionid 0x0
INFO 2017-04-11 21:07:38,852 [main-SendThread(hxxx-xxx-0003.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2135ms for sessionid 0x0, closing socket connection and attempting reconnect
INFO 2017-04-11 21:07:39,809 [main-SendThread(hxxx-xxx-0002.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server xxx-xxx-0002.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667. Will not attempt to authenticate using SASL (unknown error)
INFO 2017-04-11 21:07:39,820 [main-SendThread(hxxx-xxx-0002.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Socket connection established to xxx-xxx-0002.xxxx.xxxx.net:6667/xxx.xxx.xxx.2xx:6667, initiating session
WARN 2017-04-11 21:07:40,374 [main-SendThread(hxxx-xxx-0001.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2135ms for sessionid 0x0
INFO 2017-04-11 21:07:40,374 [main-SendThread(hxxx-xxx-0001.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2135ms for sessionid 0x0, closing socket connection and attempting reconnect
INFO 2017-04-11 21:07:40,545 [ZkClient-EventThread-19-hxxx-xxx-0001.xxxx.xxxx.net:6667,hxxx-xxx-0002.xxxx.xxxx.net:6667,hxxx-xxx-0003.xxxx.xxxx.net:6667] org.I0Itec.zkclient.ZkEventThread - Terminate ZkClient event thread.
INFO 2017-04-11 21:07:41,318 [main-SendThread(hxxx-xxx-0002.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server hxxx-xxx-0001.xxxx.xxxx.net:6667/xxx.xxx.xxx.xxx:6667. Will not attempt to authenticate using SASL (unknown error)
INFO 2017-04-11 21:07:41,329 [main-SendThread(hxxx-xxx-0002.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Socket connection established to hak-dal-0002.corp.wayport.net/xxx.xxx.xxx.xxx:6667, initiating session
INFO 2017-04-11 21:07:41,365 [ZkClient-EventThread-19-hxxx-xxx-0001.xxxx.xxxx.net:6667hxxx-xxx-0002.xxxx.xxxx.net:6667,hxxx-xxx-0003.xxxx.xxxx.net:6667] org.I0Itec.zkclient.ZkEventThread - Terminate ZkClient event thread.
WARN 2017-04-11 21:07:41,954 [main-SendThread(hxxx-xxx-0002.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2134ms for sessionid 0x0
INFO 2017-04-11 21:07:42,061 [main] org.apache.zookeeper.ZooKeeper - Session: 0x0 closed
INFO 2017-04-11 21:07:42,068 [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x0
INFO 2017-04-11 21:07:43,319 [main] kafka.utils.VerifiableProperties - Verifying properties
WARN 2017-04-11 21:07:43,465 [main-SendThread(hxxx-xxx-0002.xxxx.xxxx.net:6667)] org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 2136ms for sessionid 0x0
My Concern is what does this "Will not attempt to authenticate using SASL (unknown error) " means ?
Is this an issue .If so how this can be resolved?
Thanks and Regards
Jinesh Luke
I have solved this issue by clustering zookeeper
Related
I'm using Confluent Community 6.0.1. Three nodes Kafka cluster:
devKafka04: Kafka Broker1, Zookeeper 1
devKafka05: Kafka Broker2, Zookeeper 2
devKafka06: Kafka Broker3, Zookeeper 3
The SSL encryption is already working well on the Kafka Brokers.
I'd like to add SASL to enable mutual authentication between Kafka and Zookeeper.
I was following the Confluent document:
https://docs.confluent.io/platform/current/kafka/incremental-security-upgrade.html#adding-security-to-a-running-zk-cluster
[Updates] After I applied the changes, Zookeeper could not start on the secureclientPort. That's why the Kafka broker couldn't start. Here are the error log and docker compose configurations.
I'm wondering if there's something with the confluent zookeeper image.
Please help me out. Thanks.
$ sudo docker logs zookeeper
===> User
uid=1000(appuser) gid=1000(appuser) groups=1000(appuser)
===> Configuring ...
===> Running preflight checks ...
===> Check if /var/lib/zookeeper/data is writable ...
===> Check if /var/lib/zookeeper/log is writable ...
===> Launching ...
===> Printing /var/lib/zookeeper/data/myid
1===> Launching zookeeper ...
[2021-03-24 19:03:08,857] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2021-03-24 19:03:08,862] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2021-03-24 19:03:08,862] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2021-03-24 19:03:08,876] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)
[2021-03-24 19:03:08,876] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)
[2021-03-24 19:03:08,876] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)
[2021-03-24 19:03:08,880] INFO Log4j 1.2 jmx support found and enabled. (org.apache.zookeeper.jmx.ManagedUtil)
[2021-03-24 19:03:08,904] INFO Starting quorum peer (org.apache.zookeeper.server.quorum.QuorumPeerMain)
[2021-03-24 19:03:08,909] INFO Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory (org.apache.zookeeper.server.ServerCnxnFactory)
[2021-03-24 19:03:08,917] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util)
[2021-03-24 19:03:08,953] INFO Server successfully logged in. (org.apache.zookeeper.Login)
[2021-03-24 19:03:08,957] INFO Configuring NIO connection handler with 10s sessionless connection timeout, 1 selector thread(s), 8 worker threads, and 64 kB direct buffers. (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2021-03-24 19:03:08,961] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxnFactory)
[2021-03-24 19:03:08,986] INFO Logging initialized #929ms to org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log)
[2021-03-24 19:03:09,081] WARN o.e.j.s.ServletContextHandler#6c2c1385{/,null,UNAVAILABLE} contextPath ends with /* (org.eclipse.jetty.server.handler.ContextHandler)
[2021-03-24 19:03:09,082] WARN Empty contextPath (org.eclipse.jetty.server.handler.ContextHandler)
[2021-03-24 19:03:09,097] INFO zookeeper.snapshot.trust.empty : false (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2021-03-24 19:03:09,102] INFO Local sessions disabled (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,102] INFO Local session upgrading disabled (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,102] INFO tickTime set to 3000 (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,102] INFO minSessionTimeout set to 6000 (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,102] INFO maxSessionTimeout set to 60000 (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,102] INFO initLimit set to 10 (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,115] INFO zookeeper.snapshotSizeFactor = 0.33 (org.apache.zookeeper.server.ZKDatabase)
[2021-03-24 19:03:09,116] INFO Using insecure (non-TLS) quorum communication (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,117] INFO Port unification disabled (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,117] INFO QuorumPeer communication is not secured! (SASL auth disabled) (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,117] INFO quorum.cnxn.threads.size set to 20 (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,118] INFO Reading snapshot /var/lib/zookeeper/data/version-2/snapshot.a00000000 (org.apache.zookeeper.server.persistence.FileSnap)
[2021-03-24 19:03:09,213] INFO jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.9.1+1-LTS (org.eclipse.jetty.server.Server)
[2021-03-24 19:03:09,261] INFO DefaultSessionIdManager workerName=node0 (org.eclipse.jetty.server.session)
[2021-03-24 19:03:09,261] INFO No SessionScavenger set, using defaults (org.eclipse.jetty.server.session)
[2021-03-24 19:03:09,263] INFO node0 Scavenging every 660000ms (org.eclipse.jetty.server.session)
[2021-03-24 19:03:09,272] INFO Started o.e.j.s.ServletContextHandler#6c2c1385{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler)
[2021-03-24 19:03:09,281] INFO Started ServerConnector#6d07a63d{HTTP/1.1,[http/1.1]}{0.0.0.0:8080} (org.eclipse.jetty.server.AbstractConnector)
[2021-03-24 19:03:09,281] INFO Started #1224ms (org.eclipse.jetty.server.Server)
[2021-03-24 19:03:09,281] INFO Started AdminServer on address 0.0.0.0, port 8080 and command URL /commands (org.apache.zookeeper.server.admin.JettyAdminServer)
[2021-03-24 19:03:09,288] INFO Election port bind maximum retries is 3 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2021-03-24 19:03:09,290] INFO 1 is accepting connections now, my election bind port: devkafka04/172.16.87.141:3888 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2021-03-24 19:03:09,301] INFO LOOKING (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,303] INFO New election. My id = 1, proposed zxid=0x1600000030 (org.apache.zookeeper.server.quorum.FastLeaderElection)
[2021-03-24 19:03:09,308] INFO Notification: 2 (message format version), 1 (n.leader), 0x1600000030 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x16 (n.peerEPoch), LOOKING (my state)0 (n.config version) (org.apache.zookeeper.server.quorum.FastLeaderElection)
[2021-03-24 19:03:09,310] INFO Have smaller server identifier, so dropping the connection: (myId:1 --> sid:3) (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2021-03-24 19:03:09,312] INFO Received connection request from /172.16.87.143:53340 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2021-03-24 19:03:09,315] INFO Have smaller server identifier, so dropping the connection: (myId:1 --> sid:2) (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2021-03-24 19:03:09,316] INFO Notification: 2 (message format version), 2 (n.leader), 0x150000002b (n.zxid), 0xa (n.round), FOLLOWING (n.state), 3 (n.sid), 0x16 (n.peerEPoch), LOOKING (my state)0 (n.config version) (org.apache.zookeeper.server.quorum.FastLeaderElection)
[2021-03-24 19:03:09,317] INFO Received connection request from /172.16.87.142:51704 (org.apache.zookeeper.server.quorum.QuorumCnxManager)
[2021-03-24 19:03:09,319] INFO Notification: 2 (message format version), 2 (n.leader), 0x150000002b (n.zxid), 0xa (n.round), LEADING (n.state), 2 (n.sid), 0x16 (n.peerEPoch), LOOKING (my state)0 (n.config version) (org.apache.zookeeper.server.quorum.FastLeaderElection)
[2021-03-24 19:03:09,320] INFO Notification: 2 (message format version), 2 (n.leader), 0x150000002b (n.zxid), 0xa (n.round), FOLLOWING (n.state), 3 (n.sid), 0x16 (n.peerEPoch), LOOKING (my state)0 (n.config version) (org.apache.zookeeper.server.quorum.FastLeaderElection)
[2021-03-24 19:03:09,320] INFO FOLLOWING (org.apache.zookeeper.server.quorum.QuorumPeer)
[2021-03-24 19:03:09,323] INFO Notification: 2 (message format version), 2 (n.leader), 0x150000002b (n.zxid), 0xa (n.round), LEADING (n.state), 2 (n.sid), 0x16 (n.peerEPoch), FOLLOWING (my state)0 (n.config version) (org.apache.zookeeper.server.quorum.FastLeaderElection)
[2021-03-24 19:03:09,330] INFO TCP NoDelay set to: true (org.apache.zookeeper.server.quorum.Learner)
[2021-03-24 19:03:09,336] INFO Server environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:host.name=devkafka04 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.version=11.0.9.1 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.vendor=Azul Systems, Inc. (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.home=/usr/lib/jvm/zulu11-ca (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.class.path=/usr/bin/../share/java/kafka/activation-1.1.1.jar:/usr/bin/../share/java/kafka/aopalliance-repackaged-2.6.1.jar:/usr/bin/../share/java/kafka/argparse4j-0.7.0.jar:/usr/bin/../share/java/kafka/audience-annotations-0.5.0.jar:/usr/bin/../share/java/kafka/commons-cli-1.4.jar:/usr/bin/../share/java/kafka/commons-lang3-3.8.1.jar:/usr/bin/../share/java/kafka/confluent-log4j-1.2.17-cp2.jar:/usr/bin/../share/java/kafka/connect-api-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-basic-auth-extension-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-file-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-json-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-mirror-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-mirror-client-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-runtime-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/connect-transforms-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/hk2-api-2.6.1.jar:/usr/bin/../share/java/kafka/hk2-locator-2.6.1.jar:/usr/bin/../share/java/kafka/hk2-utils-2.6.1.jar:/usr/bin/../share/java/kafka/jackson-annotations-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-core-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-databind-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-dataformat-csv-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-datatype-jdk8-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-jaxrs-base-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-jaxrs-json-provider-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-module-jaxb-annotations-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-module-paranamer-2.10.5.jar:/usr/bin/../share/java/kafka/jackson-module-scala_2.13-2.10.5.jar:/usr/bin/../share/java/kafka/jakarta.activation-api-1.2.1.jar:/usr/bin/../share/java/kafka/jakarta.annotation-api-1.3.5.jar:/usr/bin/../share/java/kafka/jakarta.inject-2.6.1.jar:/usr/bin/../share/java/kafka/jakarta.validation-api-2.0.2.jar:/usr/bin/../share/java/kafka/jakarta.ws.rs-api-2.1.6.jar:/usr/bin/../share/java/kafka/jakarta.xml.bind-api-2.3.2.jar:/usr/bin/../share/java/kafka/javassist-3.25.0-GA.jar:/usr/bin/../share/java/kafka/javassist-3.26.0-GA.jar:/usr/bin/../share/java/kafka/javax.servlet-api-3.1.0.jar:/usr/bin/../share/java/kafka/javax.ws.rs-api-2.1.1.jar:/usr/bin/../share/java/kafka/jaxb-api-2.3.0.jar:/usr/bin/../share/java/kafka/jersey-client-2.30.jar:/usr/bin/../share/java/kafka/jersey-common-2.30.jar:/usr/bin/../share/java/kafka/jersey-container-servlet-2.30.jar:/usr/bin/../share/java/kafka/jersey-container-servlet-core-2.30.jar:/usr/bin/../share/java/kafka/jersey-hk2-2.30.jar:/usr/bin/../share/java/kafka/jersey-media-jaxb-2.30.jar:/usr/bin/../share/java/kafka/jersey-server-2.30.jar:/usr/bin/../share/java/kafka/jetty-client-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-continuation-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-http-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-io-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-security-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-server-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-servlet-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-servlets-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jetty-util-9.4.24.v20191120.jar:/usr/bin/../share/java/kafka/jopt-simple-5.0.4.jar:/usr/bin/../share/java/kafka/kafka-clients-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka-log4j-appender-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-examples-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-scala_2.13-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka-streams-test-utils-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka-tools-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/kafka.jar:/usr/bin/../share/java/kafka/kafka_2.13-6.0.1-ccs-javadoc.jar:/usr/bin/../share/java/kafka/kafka_2.13-6.0.1-ccs-scaladoc.jar:/usr/bin/../share/java/kafka/kafka_2.13-6.0.1-ccs-sources.jar:/usr/bin/../share/java/kafka/kafka_2.13-6.0.1-ccs-test-sources.jar:/usr/bin/../share/java/kafka/kafka_2.13-6.0.1-ccs-test.jar:/usr/bin/../share/java/kafka/kafka_2.13-6.0.1-ccs.jar:/usr/bin/../share/java/kafka/lz4-java-1.7.1.jar:/usr/bin/../share/java/kafka/maven-artifact-3.6.3.jar:/usr/bin/../share/java/kafka/metrics-core-2.2.0.jar:/usr/bin/../share/java/kafka/netty-buffer-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-codec-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-common-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-handler-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-resolver-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-transport-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-transport-native-epoll-4.1.50.Final.jar:/usr/bin/../share/java/kafka/netty-transport-native-unix-common-4.1.50.Final.jar:/usr/bin/../share/java/kafka/osgi-resource-locator-1.0.3.jar:/usr/bin/../share/java/kafka/paranamer-2.8.jar:/usr/bin/../share/java/kafka/plexus-utils-3.2.1.jar:/usr/bin/../share/java/kafka/reflections-0.9.12.jar:/usr/bin/../share/java/kafka/rocksdbjni-5.18.4.jar:/usr/bin/../share/java/kafka/scala-collection-compat_2.13-2.1.6.jar:/usr/bin/../share/java/kafka/scala-java8-compat_2.13-0.9.1.jar:/usr/bin/../share/java/kafka/scala-library-2.13.2.jar:/usr/bin/../share/java/kafka/slf4j-api-1.7.30.jar:/usr/bin/../share/java/kafka/scala-logging_2.13-3.9.2.jar:/usr/bin/../share/java/kafka/scala-reflect-2.13.2.jar:/usr/bin/../share/java/kafka/slf4j-log4j12-1.7.30.jar:/usr/bin/../share/java/kafka/snappy-java-1.1.7.3.jar:/usr/bin/../share/java/kafka/zookeeper-3.5.8.jar:/usr/bin/../share/java/kafka/zookeeper-jute-3.5.8.jar:/usr/bin/../share/java/kafka/zstd-jni-1.4.4-7.jar:/usr/bin/../share/java/confluent-telemetry/* (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.io.tmpdir=/tmp (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,336] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:os.name=Linux (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:os.arch=amd64 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:os.version=3.10.0-1160.21.1.el7.x86_64 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:user.name=appuser (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:user.home=/home/appuser (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:user.dir=/home/appuser (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:os.memory.free=498MB (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:os.memory.max=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,337] INFO Server environment:os.memory.total=512MB (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,338] INFO minSessionTimeout set to 6000 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,339] INFO maxSessionTimeout set to 60000 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,339] INFO Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 60000 datadir /var/lib/zookeeper/log/version-2 snapdir /var/lib/zookeeper/data/version-2 (org.apache.zookeeper.server.ZooKeeperServer)
[2021-03-24 19:03:09,339] INFO FOLLOWING - LEADER ELECTION TOOK - 18 MS (org.apache.zookeeper.server.quorum.Learner)
[2021-03-24 19:03:09,345] INFO Getting a diff from the leader 0x1600000030 (org.apache.zookeeper.server.quorum.Learner)
[2021-03-24 19:03:09,350] INFO Learner received NEWLEADER message (org.apache.zookeeper.server.quorum.Learner)
[2021-03-24 19:03:09,363] INFO Learner received UPTODATE message (org.apache.zookeeper.server.quorum.Learner)
[2021-03-24 19:03:09,367] INFO Configuring CommitProcessor with 4 worker threads. (org.apache.zookeeper.server.quorum.CommitProcessor)
$ sudo docker logs kafka
===> User
uid=1000(appuser) gid=1000(appuser) groups=1000(appuser)
===> Configuring ...
SSL is enabled.
SASL is enabled.
===> Running preflight checks ...
===> Check if /var/lib/kafka/data is writable ...
===> Skipping Zookeeper health check for SSL connections...
===> Launching ...
===> Launching kafka ...
[2021-03-23 21:43:43,453] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
[2021-03-23 21:43:43,838] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util)
[2021-03-23 21:43:43,900] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler)
[2021-03-23 21:43:43,904] INFO starting (kafka.server.KafkaServer)
[2021-03-23 21:43:43,905] INFO Connecting to zookeeper on devkafka04:2182,devkafka05:2182,devkafka06:2182 (kafka.server.KafkaServer)
[2021-03-23 21:43:43,927] INFO [ZooKeeperClient Kafka server] Initializing a new session to devkafka04:2182,devkafka05:2182,devkafka06:2182. (kafka.zookeeper.ZooKeeperClient)
[2021-03-23 21:43:43,934] INFO Client environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT (org.apache.zookeeper.ZooKeeper)
[2021-03-23 21:43:43,934] INFO Client environment:host.name=devkafka04 (org.apache.zookeeper.ZooKeeper)
[2021-03-23 21:43:43,934] INFO Client environment:java.version=11.0.9.1 (org.apache.zookeeper.ZooKeeper)
[2021-03-23 21:43:43,934] INFO Client environment:java.vendor=Azul Systems, Inc. (org.apache.zookeeper.ZooKeeper)
------ Repeating lines removed ---------
'Client' (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:43:59,947] INFO Socket error occurred: devkafka05/172.16.87.142:2182: Connection refused (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,048] INFO Client successfully logged in. (org.apache.zookeeper.Login)
[2021-03-23 21:44:01,048] INFO Client will use DIGEST-MD5 as SASL mechanism. (org.apache.zookeeper.client.ZooKeeperSaslClient)
[2021-03-23 21:44:01,048] INFO Opening socket connection to server devkafka04/172.16.87.141:2182. Will attempt to SASL-authenticate using Login Context section 'Client' (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,049] INFO Socket error occurred: devkafka04/172.16.87.141:2182: Connection refused (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,150] INFO Client successfully logged in. (org.apache.zookeeper.Login)
[2021-03-23 21:44:01,150] INFO Client will use DIGEST-MD5 as SASL mechanism. (org.apache.zookeeper.client.ZooKeeperSaslClient)
[2021-03-23 21:44:01,150] INFO Opening socket connection to server devkafka06/172.16.87.143:2182. Will attempt to SASL-authenticate using Login Context section 'Client' (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,153] INFO Socket error occurred: devkafka06/172.16.87.143:2182: Connection refused (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,254] INFO Client successfully logged in. (org.apache.zookeeper.Login)
[2021-03-23 21:44:01,254] INFO Client will use DIGEST-MD5 as SASL mechanism. (org.apache.zookeeper.client.ZooKeeperSaslClient)
[2021-03-23 21:44:01,254] INFO Opening socket connection to server devkafka05/172.16.87.142:2182. Will attempt to SASL-authenticate using Login Context section 'Client' (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,255] INFO Socket error occurred: devkafka05/172.16.87.142:2182: Connection refused (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:01,952] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient)
[2021-03-23 21:44:02,356] INFO Client successfully logged in. (org.apache.zookeeper.Login)
[2021-03-23 21:44:02,357] INFO Client will use DIGEST-MD5 as SASL mechanism. (org.apache.zookeeper.client.ZooKeeperSaslClient)
[2021-03-23 21:44:02,357] INFO Opening socket connection to server devkafka04/172.16.87.141:2182. Will attempt to SASL-authenticate using Login Context section 'Client' (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:02,462] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper)
[2021-03-23 21:44:02,463] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn)
[2021-03-23 21:44:02,465] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient)
[2021-03-23 21:44:02,469] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING
at kafka.zookeeper.ZooKeeperClient.waitUntilConnected(ZooKeeperClient.scala:262)
at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:119)
at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1865)
at kafka.server.KafkaServer.createZkClient$1(KafkaServer.scala:419)
at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:444)
at kafka.server.KafkaServer.startup(KafkaServer.scala:222)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
at kafka.Kafka$.main(Kafka.scala:82)
at kafka.Kafka.main(Kafka.scala)
[2021-03-23 21:44:02,471] INFO shutting down (kafka.server.KafkaServer)
[2021-03-23 21:44:02,478] INFO shut down completed (kafka.server.KafkaServer)
[2021-03-23 21:44:02,478] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2021-03-23 21:44:02,479] INFO shutting down (kafka.server.KafkaServer)
$ sudo cat kafka-docker-compose.yml
version: '3'
services:
kafka:
image: confluentinc/cp-kafka:6.0.1
container_name: kafka
network_mode: host
restart: always
ports:
- "9092:9092"
- "9093:9093"
- "9094:9094"
- "49998:49998"
- "49999:49999"
environment:
KAFKA_BROKER_ID: 1
KAFKA_ZOOKEEPER_CONNECT: 'devkafka04:2182,devkafka05:2182,devkafka06:2182'
KAFKA_ZOOKEEPER_SSL_CLIENT_ENABLE: 'true'
KAFKA_ZOOKEEPER_CLIENTCNXNSOCKET: org.apache.zookeeper.ClientCnxnSocketNetty
KAFKA_ZOOKEEPER_SSL_TRUSTSTORE_FILENAME: kafka.server.truststore.jks
KAFKA_ZOOKEEPER_SSL_TRUSTSTORE_CREDENTIALS: creds
KAFKA_ZOOKEEPER_SET_ACL: 'true'
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://devkafka04:9092,SSL://devkafka04:9093,SASL_SSL://devkafka04:9094
KAFKA_LISTENERS: PLAINTEXT://devkafka04:9092,SSL://devkafka04:9093,SASL_SSL://devkafka04:9094
KAFKA_SASL_ENABLED_MECHANISMS: DIGEST-MD5
KAFKA_SECURITY_INTER_BROKER_PROTOCOL: SSL
KAFKA_SSL_CLIENT_AUTH: requested
KAFKA_SSL_TRUSTSTORE_FILENAME: kafka.server.truststore.jks
KAFKA_SSL_TRUSTSTORE_CREDENTIALS: creds
KAFKA_SSL_KEYSTORE_FILENAME: devkafka04.server.keystore.jks
KAFKA_SSL_KEYSTORE_CREDENTIALS: creds
KAFKA_SSL_KEY_CREDENTIALS: creds
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 3
KAFKA_GROUP_INITIAL_REBALANCE_DELAY_MS: 0
KAFKA_AUTO_CREATE_TOPICS_ENABLE: "false"
KAFKA_OPTS: -Djava.security.auth.login.config=/etc/kafka/jmx/kafka_server_jaas.conf -Djava.rmi.server.hostname=devkafka04 -Dcom.sun.management.jmxremote.local.only=false -Dcom.sun.management.jmxremote.rmi.port=49998 -Dcom.sun.management.jmxremote.port=49998 -Dcom.sun.management.jmxremote=true -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -javaagent:/etc/kafka/jmx/jmx_prometheus_javaagent-0.14.0.jar=49999:/etc/kafka/jmx/kafka-2_0_0.yml
CONFLUENT_SUPPORT_METRICS_ENABLE: "false"
volumes:
- /media/kafka/data:/var/lib/kafka/data
- /media/kafka/secrets:/etc/kafka/secrets
- /usr/local/src/kafka/jmx:/etc/kafka/jmx
$ sudo cat jmx/kafka_server_jaas.conf
KafkaServer {
org.apache.kafka.common.security.plain.PlainLoginModule required
username="kafkabroker"
password="kafkabroker-secret"
user_kafkabroker="kafkabroker-secret"
user_kafka-broker-metric-reporter="kafkabroker-metric-reporter-secret"
user_client="client-secret";
};
Client {
org.apache.zookeeper.server.auth.DigestLoginModule required
username="kafka"
password="kafka-secret";
};
$ sudo cat zookeeper-docker-compose.yml
version: '3'
services:
zookeeper:
image: confluentinc/cp-zookeeper:6.0.1
container_name: zookeeper
network_mode: host
restart: always
ports:
- "2181:2181"
- "2182:2182"
- "2888:2888"
- "3888:3888"
- "39998:39998"
- "39999:39999"
environment:
ZOOKEEPER_SERVER_ID: 1
ZOOKEEPER_CLIENT_PORT: 2181
ZOOKEEPER_SERVERS: devkafka04:2888:3888;devkafka05:2888:3888;devkafka06:2888:3888
ZOOKEEPER_AUTHPROVIDER_SASL: org.apache.zookeeper.server.auth.SASLAuthenticationProvider
ZOOKEEPER_AUTHPROVIDER_x509: org.apache.zookeeper.server.auth.X509AuthenticationProvider
ZOOKEEPER_SECURECLIENTPORT: 2182
ZOOKEEPER_SERVERCNXNFACTORY: org.apache.zookeeper.server.NettyServerCnxnFactory
ZOOKEEPER_SSL_TRUSTSTORE_FILENAME: kafka.server.truststore.jks
ZOOKEEPER_SSL_TRUSTSTORE_CREDENTIALS: creds
ZOOKEEPER_SSL_KEYSTORE_FILENAME: devkafka05.server.keystore.jks
ZOOKEEPER_SSL_KEYSTORE_CREDENTIALS: creds
ZOOKEEPER_SSL_KEY_CREDENTIALS: creds
ZOOKEEPER_SSL_CLIENTAUTH: none
KAFKA_OPTS: -Djava.security.auth.login.config=/etc/zookeeper/jmx/zookeeper_jaas.conf -Dzookeeper.4lw.commands.whitelist=* -Djava.rmi.server.hostname=devkafka04 -Dcom.sun.management.jmxremote.local.only=false -Dcom.sun.management.jmxremote.rmi.port=39998 -Dcom.sun.management.jmxremote.port=39998 -Dcom.sun.management.jmxremote=true -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -javaagent:/etc/zookeeper/jmx/jmx_prometheus_javaagent-0.14.0.jar=39999:/etc/zookeeper/jmx/jmx-zookeeper-prometheus.yaml
volumes:
- /media/zookeeper/data:/var/lib/zookeeper/data
- /media/zookeeper/log:/var/lib/zookeeper/log
- /media/zookeeper/secrets:/etc/zookeeper/secrets
- /usr/local/src/zookeeper/jmx:/etc/zookeeper/jmx
$ sudo cat jmx/zookeeper_jaas.conf
Server {
org.apache.zookeeper.server.auth.DigestLoginModule required
user_kafka="kafka-secret";
};
Try using KAFKA_ZOOKEEPER_CLIENT_CNXN_SOCKET instead of KAFKA_ZOOKEEPER_CLIENTCNXNSOCKET.
I am trying to install kafka in ubuntu. I have downloaded the kafka tar.gz file,unzipped it. started the zookeeper server .While trying to start the kafka server, getting the timeout exception.
Can some one pls let me know the resolution.
Following are the server logs:
kafka-server-start.sh ../config/server.properties
[2020-09-17 15:53:02,990] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
[2020-09-17 15:53:03,310] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util)
[2020-09-17 15:53:03,347] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler)
[2020-09-17 15:53:03,351] INFO starting (kafka.server.KafkaServer)
[2020-09-17 15:53:03,352] INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer)
[2020-09-17 15:53:03,368] INFO [ZooKeeperClient Kafka server] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient)
[2020-09-17 15:53:03,373] INFO Client environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,373] INFO Client environment:host.name=LAPTOP-D6RGQ60T.localdomain (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,373] INFO Client environment:java.version=1.8.0_261 (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,373] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,373] INFO Client environment:java.home=/opt/jdk/jre1.8.0_261 (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,373] INFO Client environment:java.class.path=/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/activation-1.1.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/aopalliance-repackaged-2.5.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/argparse4j-0.7.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/audience-annotations-0.5.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/commons-cli-1.4.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/commons-lang3-3.8.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-api-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-basic-auth-extension-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-file-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-json-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-mirror-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-mirror-client-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-runtime-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/connect-transforms-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/hk2-api-2.5.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/hk2-locator-2.5.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/hk2-utils-2.5.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-annotations-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-core-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-databind-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-dataformat-csv-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-datatype-jdk8-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-jaxrs-base-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-jaxrs-json-provider-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-module-jaxb-annotations-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-module-paranamer-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jackson-module-scala_2.12-2.10.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jakarta.activation-api-1.2.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jakarta.annotation-api-1.3.4.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jakarta.inject-2.5.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jakarta.ws.rs-api-2.1.5.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/javassist-3.22.0-CR2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/javassist-3.26.0-GA.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/javax.servlet-api-3.1.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/javax.ws.rs-api-2.1.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jaxb-api-2.3.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-client-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-common-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-container-servlet-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-container-servlet-core-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-hk2-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-media-jaxb-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jersey-server-2.28.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-client-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-continuation-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-http-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-io-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-security-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-server-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-servlet-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-servlets-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jetty-util-9.4.24.v20191120.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/jopt-simple-5.0.4.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-clients-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-log4j-appender-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-streams-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-streams-examples-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-streams-scala_2.12-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-streams-test-utils-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka-tools-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka_2.12-2.6.0-sources.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/kafka_2.12-2.6.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/log4j-1.2.17.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/lz4-java-1.7.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/maven-artifact-3.6.3.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/metrics-core-2.2.0.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-buffer-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-codec-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-common-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-handler-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-resolver-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-transport-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-transport-native-epoll-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/netty-transport-native-unix-common-4.1.50.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/osgi-resource-locator-1.0.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/paranamer-2.8.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/plexus-utils-3.2.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/reflections-0.9.12.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/rocksdbjni-5.18.4.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/scala-collection-compat_2.12-2.1.6.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/scala-java8-compat_2.12-0.9.1.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/scala-library-2.12.11.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/scala-logging_2.12-3.9.2.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/scala-reflect-2.12.11.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/slf4j-api-1.7.30.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/slf4j-log4j12-1.7.30.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/snappy-java-1.1.7.3.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/validation-api-2.0.1.Final.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/zookeeper-3.5.8.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/zookeeper-jute-3.5.8.jar:/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin/../libs/zstd-jni-1.4.4-7.jar (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:os.version=4.4.0-18362-Microsoft (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:user.name=sreekanth (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:user.home=/home/sreekanth (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:user.dir=/home/sreekanth/Downloads/kafka_2.12-2.6.0/bin (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:os.memory.free=976MB (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:os.memory.max=1024MB (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,374] INFO Client environment:os.memory.total=1024MB (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,376] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=18000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$#47af7f3d (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:53:03,380] INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket)
[2020-09-17 15:53:03,384] INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:03,386] INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient)
[2020-09-17 15:53:03,389] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:03,392] INFO Socket connection established, initiating session, client: /127.0.0.1:50975, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:21,394] WARN Client session timed out, have not heard from server in 18001ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:21,394] INFO Client session timed out, have not heard from server in 18001ms for sessionid 0x0, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:23,114] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:23,115] INFO Socket connection established, initiating session, client: /127.0.0.1:50976, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:41,117] WARN Client session timed out, have not heard from server in 18001ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:41,117] INFO Client session timed out, have not heard from server in 18001ms for sessionid 0x0, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:42,712] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:53:42,713] INFO Socket connection established, initiating session, client: /127.0.0.1:50977, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:00,714] WARN Client session timed out, have not heard from server in 18001ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:00,715] INFO Client session timed out, have not heard from server in 18001ms for sessionid 0x0, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:02,432] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:02,433] INFO Socket connection established, initiating session, client: /127.0.0.1:50980, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:03,388] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient)
[2020-09-17 15:54:20,433] WARN Client session timed out, have not heard from server in 18000ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:20,555] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper)
[2020-09-17 15:54:20,556] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn)
[2020-09-17 15:54:20,557] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient)
[2020-09-17 15:54:20,559] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING
at kafka.zookeeper.ZooKeeperClient.$anonfun$waitUntilConnected$3(ZooKeeperClient.scala:262)
at kafka.zookeeper.ZooKeeperClient.waitUntilConnected(ZooKeeperClient.scala:258)
at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:119)
at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1865)
at kafka.server.KafkaServer.createZkClient$1(KafkaServer.scala:419)
at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:444)
at kafka.server.KafkaServer.startup(KafkaServer.scala:222)
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
at kafka.Kafka$.main(Kafka.scala:82)
at kafka.Kafka.main(Kafka.scala)
[2020-09-17 15:54:20,561] INFO shutting down (kafka.server.KafkaServer)
[2020-09-17 15:54:20,565] INFO shut down completed (kafka.server.KafkaServer)
[2020-09-17 15:54:20,566] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2020-09-17 15:54:20,567] INFO shutting down (kafka.server.KafkaServer)
Many Zookeeper instances were running earlier. I killed all the zookeeper and Brokers , restarted them again freshly . It is working fine now.
I deployed Strimzi topic operator on openshift using the following documentation: https://strimzi.io/docs/0.12.2/full.html#deploying-the-topic-operator-standalone-deploying. This does not work and error shown below:
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib`enter code here`
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:java.io.tmpdir=/tmp
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:java.compiler=<NA>
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:os.name=Linux
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:os.arch=amd64
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:os.version=3.10.0-1062.12.1.el7.x86_64
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:user.name=?
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:user.home=?
2020-02-26 13:40:30 INFO ZooKeeper:100 - Client environment:user.dir=/opt/strimzi
2020-02-26 13:40:30 INFO ZooKeeper:442 - Initiating client connection, connectString=172.30.93.216:2181 sessionTimeout=500000 watcher=org.I0Itec.zkclient.ZkClient#74e374fc
2020-02-26 13:40:31 INFO ZkClient:936 - Waiting for keeper state SyncConnected
2020-02-26 13:40:31 INFO ClientCnxn:1025 - Opening socket connection to server soumo-zookeeper-client.kube-system.svc.cluster.local/172.30.93.216:2181. Will not attempt to authenticate using SASL (unknown error)
2020-02-26 13:40:31 INFO ClientCnxn:879 - Socket connection established to soumo-zookeeper-client.kube-system.svc.cluster.local/172.30.93.216:2181, initiating session
2020-02-26 13:40:31 WARN ClientCnxn:1164 - Session 0x0 for server soumo-zookeeper-client.kube-system.svc.cluster.local/172.30.93.216:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[?:1.8.0_242]
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) ~[?:1.8.0_242]
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) ~[?:1.8.0_242]
at sun.nio.ch.IOUtil.read(IOUtil.java:192) ~[?:1.8.0_242]
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:377) ~[?:1.8.0_242]
at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68) ~[org.apache.zookeeper.zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366) ~[org.apache.zookeeper.zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [org.apache.zookeeper.zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
2020-02-26 13:40:34 INFO ClientCnxn:1025 - Opening socket connection to server soumo-zookeeper-client.kube-system.svc.cluster.local/172.30.93.216:2181. Will not attempt to authenticate using SASL (unknown error)
2020-02-26 13:40:34 INFO ClientCnxn:879 - Socket connection established to soumo-zookeeper-client.kube-system.svc.cluster.local/172.30.93.216:2181, initiating session
2020-02-26 13:40:34 WARN ClientCnxn:1164 - Session 0x0 for server soumo-zookeeper-client.kube-system.svc.cluster.local/172.30.93.216:2181, unexpected error, closing socket connection and attempting reconnect
java.io.IOException: Connection reset by peer
I am facing this error when i run /bin/kafka-server-start.sh /config/server.properties
2020-02-27T13:23:34,540 ERROR [main] kafka.server.KafkaServer - [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown
java.lang.NoSuchMethodError: org.apache.zookeeper.ZooKeeper.multi(Ljava/lang/Iterable;Lorg/apache/zookeeper/AsyncCallback$MultiCallback;Ljava/lang/Object;)V
at kafka.zookeeper.ZooKeeperClient.send(ZooKeeperClient.scala:239) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zookeeper.ZooKeeperClient.$anonfun$handleRequests$2(ZooKeeperClient.scala:161) ~[kafka_2.12-2.4.0.jar:?]
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.10.jar:?]
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:253) ~[kafka_2.12-2.4.0.jar:?]
at kafka.utils.CoreUtils$.inReadLock(CoreUtils.scala:259) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zookeeper.ZooKeeperClient.$anonfun$handleRequests$1(ZooKeeperClient.scala:161) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zookeeper.ZooKeeperClient.$anonfun$handleRequests$1$adapted(ZooKeeperClient.scala:157) ~[kafka_2.12-2.4.0.jar:?]
at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) ~[scala-library-2.12.10.jar:?]
at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) ~[scala-library-2.12.10.jar:?]
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) ~[scala-library-2.12.10.jar:?]
at kafka.zookeeper.ZooKeeperClient.handleRequests(ZooKeeperClient.scala:157) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zk.KafkaZkClient.retryRequestsUntilConnected(KafkaZkClient.scala:1691) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zk.KafkaZkClient.retryRequestsUntilConnected(KafkaZkClient.scala:1678) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zk.KafkaZkClient.retryRequestUntilConnected(KafkaZkClient.scala:1673) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zk.KafkaZkClient$CheckedEphemeral.create(KafkaZkClient.scala:1743) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zk.KafkaZkClient.checkedEphemeralCreate(KafkaZkClient.scala:1720) ~[kafka_2.12-2.4.0.jar:?]
at kafka.zk.KafkaZkClient.registerBroker(KafkaZkClient.scala:93) ~[kafka_2.12-2.4.0.jar:?]
at kafka.server.KafkaServer.startup(KafkaServer.scala:270) [kafka_2.12-2.4.0.jar:?]
at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44) [kafka_2.12-2.4.0.jar:?]
at kafka.Kafka$.main(Kafka.scala:84) [kafka_2.12-2.4.0.jar:?]
at kafka.Kafka.main(Kafka.scala) [kafka_2.12-2.4.0.jar:?]
2020-02-27T13:23:34,549 INFO [main] kafka.server.KafkaServer - [KafkaServer id=0] shutting down
2020-02-27T13:23:34,556 INFO [main] kafka.network.SocketServer - [SocketServer brokerId=0] Stopping socket server request processors
2020-02-27T13:23:34,590 INFO [main] kafka.network.SocketServer - [SocketServer brokerId=0] Stopped socket server request processors
2020-02-27T13:23:34,606 INFO [main] kafka.server.ReplicaManager - [ReplicaManager broker=0] Shutting down
2020-02-27T13:23:34,610 INFO [main] kafka.server.ReplicaManager$LogDirFailureHandler - [LogDirFailureHandler]: Shutting down
2020-02-27T13:23:34,620 INFO [main] kafka.server.ReplicaManager$LogDirFailureHandler - [LogDirFailureHandler]: Shutdown completed
2020-02-27T13:23:34,623 INFO [main] kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 0] shutting down
2020-02-27T13:23:34,631 INFO [LogDirFailureHandler] kafka.server.ReplicaManager$LogDirFailureHandler - [LogDirFailureHandler]: Stopped
2020-02-27T13:23:34,631 INFO [main] kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 0] shutdown completed
2020-02-27T13:23:34,634 INFO [main] kafka.server.ReplicaAlterLogDirsManager - [ReplicaAlterLogDirsManager on broker 0] shutting down
2020-02-27T13:23:34,646 INFO [main] kafka.server.ReplicaAlterLogDirsManager - [ReplicaAlterLogDirsManager on broker 0] shutdown completed
2020-02-27T13:23:34,646 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-Fetch]: Shutting down
2020-02-27T13:23:34,774 INFO [ExpirationReaper-0-Fetch] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-Fetch]: Stopped
2020-02-27T13:23:34,774 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-Fetch]: Shutdown completed
2020-02-27T13:23:34,776 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-Produce]: Shutting down
2020-02-27T13:23:34,959 INFO [ExpirationReaper-0-Produce] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-Produce]: Stopped
2020-02-27T13:23:34,959 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-Produce]: Shutdown completed
2020-02-27T13:23:34,961 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-DeleteRecords]: Shutting down
2020-02-27T13:23:35,003 INFO [ExpirationReaper-0-DeleteRecords] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-DeleteRecords]: Stopped
2020-02-27T13:23:35,003 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-DeleteRecords]: Shutdown completed
2020-02-27T13:23:35,004 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-ElectLeader]: Shutting down
2020-02-27T13:23:35,012 INFO [ExpirationReaper-0-ElectLeader] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-ElectLeader]: Stopped
2020-02-27T13:23:35,013 INFO [main] kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper - [ExpirationReaper-0-ElectLeader]: Shutdown completed
2020-02-27T13:23:35,039 INFO [main] kafka.server.ReplicaManager - [ReplicaManager broker=0] Shut down completely
2020-02-27T13:23:35,042 INFO [main] kafka.log.LogManager - Shutting down.
2020-02-27T13:23:35,047 INFO [main] kafka.log.LogCleaner - Shutting down the log cleaner.
2020-02-27T13:23:35,048 INFO [main] kafka.log.LogCleaner - [kafka-log-cleaner-thread-0]: Shutting down
2020-02-27T13:23:35,050 INFO [kafka-log-cleaner-thread-0] kafka.log.LogCleaner - [kafka-log-cleaner-thread-0]: Stopped
2020-02-27T13:23:35,052 INFO [main] kafka.log.LogCleaner - [kafka-log-cleaner-thread-0]: Shutdown completed
2020-02-27T13:23:35,118 INFO [main] kafka.log.LogManager - Shutdown complete.
2020-02-27T13:23:35,120 INFO [main] kafka.zookeeper.ZooKeeperClient - [ZooKeeperClient Kafka server] Closing.
2020-02-27T13:23:35,145 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x17085a21f120000 closed
2020-02-27T13:23:35,150 INFO [main] kafka.zookeeper.ZooKeeperClient - [ZooKeeperClient Kafka server] Closed.
2020-02-27T13:23:35,151 INFO [main] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Fetch]: Shutting down
2020-02-27T13:23:35,152 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2020-02-27T13:23:35,156 INFO [ThrottledChannelReaper-Fetch] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Fetch]: Stopped
2020-02-27T13:23:35,159 INFO [main] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Fetch]: Shutdown completed
2020-02-27T13:23:35,159 INFO [main] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Produce]: Shutting down
2020-02-27T13:23:36,160 INFO [ThrottledChannelReaper-Produce] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Produce]: Stopped
2020-02-27T13:23:36,161 INFO [main] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Produce]: Shutdown completed
2020-02-27T13:23:36,161 INFO [main] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Request]: Shutting down
2020-02-27T13:23:36,163 INFO [ThrottledChannelReaper-Request] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Request]: Stopped
2020-02-27T13:23:36,163 INFO [main] kafka.server.ClientQuotaManager$ThrottledChannelReaper - [ThrottledChannelReaper-Request]: Shutdown completed
2020-02-27T13:23:36,167 INFO [main] kafka.network.SocketServer - [SocketServer brokerId=0] Shutting down socket server
2020-02-27T13:23:36,311 INFO [main] kafka.network.SocketServer - [SocketServer brokerId=0] Shutdown completed
2020-02-27T13:23:36,326 INFO [main] kafka.server.KafkaServer - [KafkaServer id=0] shut down completed
2020-02-27T13:23:36,329 ERROR [main] kafka.server.KafkaServerStartable - Exiting Kafka.
2020-02-27T13:23:36,337 INFO [kafka-shutdown-hook] kafka.server.KafkaServer - [KafkaServer id=0] shutting down
ERROR [main] kafka.server.KafkaServer - [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown
i am facing this problem when i start kafka server
I have installed Kerberos and Sentry on the CDH cluster successfully (cm-5.8.4), now I need to use Apache Kylin to do some data analysis, but I can't start Kylin and install the sample.sh. When I try to run sh sample.sh, I get this error message:
2017-08-02 14:44:44,805 INFO [main] zookeeper.ZooKeeper: Client
environment:java.library.path=/opt/cloudera/parcels/CDH-5.8.4-
1.cdh5.8.4.p0.5/lib/hadoop/lib/native/:/opt/cloudera/parcels/CDH-5.8.4-
1.cdh5.8.4.p0.5/lib/hadoop/lib/native/:/opt/cloudera/parcels/CDH-5.8.4-
1.cdh5.8.4.p0.5/lib/hadoop/lib/native:/opt/cloudera/parcels/CDH-5.8.4-
1.cdh5.8.4.p0.5/lib/hbase/bin/../lib/native/Linux-amd64-64 2017-08-02 14:44:44,806 INFO [main] zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp 2017-08-02 14:44:44,806 INFO [main]
zookeeper.ZooKeeper: Client environment:java.compiler= 2017-08-02
14:44:44,806 INFO [main] zookeeper.ZooKeeper: Client
environment:os.name=Linux 2017-08-02 14:44:44,806 INFO [main]
zookeeper.ZooKeeper: Client environment:os.arch=amd64 2017-08-02
14:44:44,806 INFO [main] zookeeper.ZooKeeper: Client
environment:os.version=3.10.0-229.el7.x86_64 2017-08-02 14:44:44,806
INFO [main] zookeeper.ZooKeeper: Client environment:user.name=root
2017-08-02 14:44:44,806 INFO [main] zookeeper.ZooKeeper: Client
environment:user.home=/root 2017-08-02 14:44:44,806 INFO [main]
zookeeper.ZooKeeper: Client
environment:user.dir=/data1/apache-kylin-1.6.0-cdh5.7-bin 2017-08-02
14:44:44,806 INFO [main] zookeeper.ZooKeeper: Initiating client
connection, connectString=localhost:2181 sessionTimeout=90000
watcher=hconnection-0x3cc79c020x0, quorum=localhost:2181,
baseZNode=/hbase 2017-08-02 14:44:44,823 INFO
[main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening
socket connection to server localhost/127.0.0.1:2181. Will not
attempt to authenticate using SASL (unknown error) 2017-08-02
14:44:44,829 WARN [main-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error,
closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-08-02 14:44:45,934 INFO [main-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL
(unknown error) 2017-08-02 14:44:45,935 WARN
[main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0
for server null, unexpected error, closing socket connection and
attempting reconnect
Does anyone know how to solve this problem or show me a guide to use Kylin on a kerberized cluster? Thanks!
The version of Kylin is apache-kylin-1.6.0-cdh5.7-bin.
to install kylin on kerberized cluster is quiet simple.
step 1. ensure you install kylin on a cdh gateway.
step 2. setup the environment correctly.
such as hadoop_home;hive_conf;hbase_conf etc.
step 3. follow the install instruction on kylin website.
if you need more help, leave me a message , so i can show you more detailed documentation on the first 2 steps.