kafka 오류 분석

15628 단어 bigdata
kafka 버전을 업데이트한 후 다음 오류를 보고합니다.
2015-12-02 15:14:12  [ pool-1-thread-2:4217697 ] - [ ERROR ]  Failed to collate messages by topic, partition due to: fetching topic metadata for topics [Set(test)] from broker [ArrayBuffer(id:0,host:172.16.4.214,port:9092)] failed
2015-12-02 15:14:12  [ pool-1-thread-5:4217707 ] - [ ERROR ]  Producer connection to 172.16.4.214:9092 unsuccessful
java.net.ConnectException: Connection refused: connect
    at sun.nio.ch.Net.connect0(Native Method)
    at sun.nio.ch.Net.connect(Net.java:435)
    at sun.nio.ch.Net.connect(Net.java:427)
    at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:643)
    at kafka.network.BlockingChannel.connect(Unknown Source)
    at kafka.producer.SyncProducer.connect(Unknown Source)
    at kafka.producer.SyncProducer.getOrMakeConnection(Unknown Source)
    at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(Unknown Source)
	at kafka.producer.SyncProducer.send(Unknown Source)
	at kafka.client.ClientUtils$.fetchTopicMetadata(Unknown Source)
	at kafka.producer.BrokerPartitionInfo.updateInfo(Unknown Source)
	at kafka.producer.async.DefaultEventHandler$$anonfun$handle$2.apply$mcV$sp(Unknown Source)
    at kafka.utils.Utils$.swallow(Unknown Source)
    at kafka.utils.Logging$class.swallowError(Unknown Source)
    at kafka.utils.Utils$.swallowError(Unknown Source)
    at kafka.producer.async.DefaultEventHandler.handle(Unknown Source)
    at kafka.producer.Producer.send(Unknown Source)
    at kafka.javaapi.producer.Producer.send(Unknown Source)
    at com.hta.webmagic.pipeline.TestKafkaPipeline.KafkaProducer(TestKafkaPipeline.java:42)
    at com.hta.webmagic.pipeline.TestKafkaPipeline.process(TestKafkaPipeline.java:35)
    at us.codecraft.webmagic.Spider.processRequest(Spider.java:439)
    at us.codecraft.webmagic.Spider$1.run(Spider.java:336)
    at us.codecraft.webmagic.thread.CountableThreadPool$1.run(CountableThreadPool.java:74)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
2015-12-02 15:14:12  [ pool-1-thread-5:4217707 ] - [ ERROR ]  fetching topic metadata for topics [Set(test)] from broker [ArrayBuffer(id:0,host:172.16.4.214,port:9092)] failed
kafka.common.KafkaException: fetching topic metadata for topics [Set(test)] from broker [ArrayBuffer(id:0,host:172.16.4.214,port:9092)] failed
    at kafka.client.ClientUtils$.fetchTopicMetadata(Unknown Source)
    at kafka.producer.BrokerPartitionInfo.updateInfo(Unknown Source)
    at kafka.producer.async.DefaultEventHandler$$anonfun$handle$2.apply$mcV$sp(Unknown Source)
	at kafka.utils.Utils$.swallow(Unknown Source)
	at kafka.utils.Logging$class.swallowError(Unknown Source)
	at kafka.utils.Utils$.swallowError(Unknown Source)
	at kafka.producer.async.DefaultEventHandler.handle(Unknown Source)
	at kafka.producer.Producer.send(Unknown Source)
	at kafka.javaapi.producer.Producer.send(Unknown Source)
	at com.hta.webmagic.pipeline.TestKafkaPipeline.KafkaProducer(TestKafkaPipeline.java:42)
	at com.hta.webmagic.pipeline.TestKafkaPipeline.process(TestKafkaPipeline.java:35)
	at us.codecraft.webmagic.Spider.processRequest(Spider.java:439)
	at us.codecraft.webmagic.Spider$1.run(Spider.java:336)
	at us.codecraft.webmagic.thread.CountableThreadPool$1.run(CountableThreadPool.java:74)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: Connection refused: connect
	at sun.nio.ch.Net.connect0(Native Method)
	at sun.nio.ch.Net.connect(Net.java:435)
	at sun.nio.ch.Net.connect(Net.java:427)
	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:643)
	at kafka.network.BlockingChannel.connect(Unknown Source)
	at kafka.producer.SyncProducer.connect(Unknown Source)
	at kafka.producer.SyncProducer.getOrMakeConnection(Unknown Source)
	at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(Unknown Source)
    at kafka.producer.SyncProducer.send(Unknown Source)
    ... 17 more

인터넷에서 프로필에 문제가 생겼다고 하는데log 디렉터리를 삭제하는 것도 추천합니다.
연구 해결 방법은 다음과 같다. 먼저 판본을 보자.
이전 버전: kafka_2.10-0.8.2.2 기본적으로 서버입니다.xml 설정 문제,hostname와zookeer의 IP 주소가 정확한지 확인
오류 보고: topicList를 볼 수 있습니다. 새 topic을 만들 수 있습니다.
메시지를 제대로 수신, 전송할 수 없음
새 버전: kafka_2.10-0.9.0.0 마지막 오류는hosts 파일 설정 문제일 수 있습니다. 대응하는 관계를 설정해야 한다는 점은clouder의 집단 설치와 유사하게 서버를 검사해야 합니다.xml 프로필
새 본보 오류: 로컬 명령줄은 정상적으로 메시지를 보내고 받을 수 있으며, Eclipse와 원격 기기는 메시지를 보낼 수 없습니다.

좋은 웹페이지 즐겨찾기