首页 文章

由于未加载主题,Kafka启动失败

提问于
浏览
1

我在here的帮助下在Windows机器中设置了Kafka服务器和一个zookeeper . 我成功地设置了一个主题 - MTETest,如下面的日志,生成和使用此主题的消息 .

在尝试使用管理员命令提示符中安装时附带的批处理文件停止和启动Kafka和Zookeeper时,我遇到一个问题,即kafka服务器无法启动以下消息 -

[2017-11-30 21:26:24,601]错误日志加载期间其中一个线程出错:java.nio.file.FileSystemException:C:SourceKafkakafka_2.11-0.11.0.1 \ MTETest-0 \ 00000000000000000000 .timeindex:进程无法访问该文件,因为它正由另一个进程使用 . (kafka.log.LogManager)[2017-11-30 21:26:24,603]致命[Kafka Server 0],KafkaServer启动时出现致命错误 . 准备关机(kafka.server.KafkaServer)java.nio.file.FileSystemException:C:SourceKafkakafka_2.11-0.11.0.1 \ MTETest-0 \ 00000000000000000000.timeindex:进程无法访问该文件,因为它正被另一个进程使用 . 在Sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97)sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102)sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:86) )at.nio.fs.WindowsFileSystemProvider.implDelete(WindowsFileSystemProvider.java:269)at sun.nio.fs.AbstractFileSystemProvider.deleteIfExists(AbstractFileSystemProvider.java:108)at java.nio.file.Files.deleteIfExists(Files.java: 1165)at kafka.log.Log $$ anonfun $ loadSegmentFiles $ 3.apply(Log.scala:318)at kafka.log.Log $$ anonfun $ loadSegmentFiles $ 3.apply(Log.scala:279)at scala.collection.TraversableLike scala.collection.mutable.ArrayOps $ ofRef.foreach(ArrayOps.scala)scala.collection.IndexedSeqOptimized $ class.foreach(IndexedSeqOptimized.scala:33)$ WithFilter $$ anonfun $ foreach $ 1.apply(TraversableLike.scala:733) :186)at scala.collection.TraversableLike $ WithFilter.foreach(TraversableLike.scala:732)at kafka.log.Log.loadSegmentFiles(Log.scala:279)at kafka.lo g.Log.loadSegments(Log.scala:383)at kafka.log.Log . (Log.scala:186)at kafka.log.Log $ .apply(Log.scala:1609)at kafka.log.LogManager $$ anonfun $ loadLogs $ 2 $$ anonfun $ 5 $$ anonfun $ apply $ 12 $$ anonfun $ apply $ 1.apply $ mcV $ sp(LogManager.scala:172)at kafka.utils.CoreUtils $$ anon $ 1.run(CoreUtils.scala: 57)at java.util.concurrent.Executors $ RunnableAdapter.call(Executors.java:511)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor) .java:1149)java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:624)at java.lang.Thread.run(Thread.java:748)[2017-11-30 21:26:24,606 ] WARN由于需求失败而发现损坏的索引文件:找到损坏的索引,索引文件(C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11-0.11.0.1 \ MTETestTopic-0 \ 00000000000000000000.index)具有非零大小,但最后一个偏移量为0,不大于基本偏移量0.} . 删除C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11-0.11.0.1 \ MTETestTopic-0 \ 00000000000000000000.timeindex,C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11 -0.11.0.1 \ MTETestTopic-0 \ 00000000000000000000.index,和C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11-0.11.0.1 \ MTETestTopic-0 \ 00000000000000000000.txnindex和重建索引...... (kafka.log.Log)[2017-11-30 21:26:24,609] INFO [Kafka Server 0],关闭(kafka.server.KafkaServer)[2017-11-30 21:26:24,613] INFO终止ZkClient事件线程 . (org.I0Itec.zkclient.ZkEventThread)[2017-11-30 21:26:24,615] WARN由于要求失败而发现损坏的索引文件:找到损坏的索引,索引文件(C:\ Source \ Kafka \ kafka_2.11- 0.11.0.1 \ SourceKafkakafka_2.11-0.11.0.1__consumer_offsets-0 \ 00000000000000000000.index)具有非零大小,但最后一个偏移量为0,不大于基本偏移量0.} . 删除C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11-0.11.0.1__consumer_offsets-0 \ 00000000000000000000.timeindex,C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11- 0.11.0.1__consumer_offsets-0 \ 00000000000000000000.index,和C:\ Source \ Kafka \ kafka_2.11-0.11.0.1 \ SourceKafkakafka_2.11-0.11.0.1__consumer_offsets-0 \ 00000000000000000000.txnindex and rebuilding index ...(kafka . log.Log)[2017-11-30 21:26:24,616] INFO会话:0x1600d98747a0001已关闭(org.apache.zookeeper.ZooKeeper)[2017-11-30 21:26:24,623] INFO EventThread关闭会话:0x1600d98747a0001 (org.apache.zookeeper.ClientCnxn)[2017-11-30 21:26:24,625] INFO [Kafka Server 0],关闭完成(kafka.server.KafkaServer)[2017-11-30 21:26:24,626]致命的离开 Kafka . (kafka.server.KafkaServerStartable)[2017-11-30 21:26:24,628] INFO [Kafka Server 0],关闭(kafka.server.KafkaServer)

我已尝试将设置 - delete.topic.enable更改为true,根据kafka中类似问题here中的建议server.properties,但它没有帮助 . 另外,我没有手动打开主题或其相关文件 . 有人遇到这个问题,请帮忙 . 这个问题特定于Windows吗?

当我删除由Kafka创建的主题及其相关的物理文件夹时,它会成功加载,但这不是正确的事情 . 请建议正确的解决方案 . 谢谢 .

1 回答

相关问题