Kafka SASL zookeeper认证

2 回答

• 4

  我通过将日志级别增加到DEBUG来找到问题 . 基本上按照以下步骤 . 我不使用SSL，但你会毫无问题地整合它 .

  以下是我的配置文件：

  server.properties

  security.inter.broker.protocol=SASL_PLAINTEXT
  sasl.mechanism.inter.broker.protocol=PLAIN
  sasl.enabled.mechanisms=PLAIN
  
  authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer
  allow.everyone.if.no.acl.found=true
  auto.create.topics.enable=false
  broker.id=0
  listeners=SASL_PLAINTEXT://localhost:9092
  advertised.listeners=SASL_PLAINTEXT://localhost:9092
  num.network.threads=3
  num.io.threads=8
  socket.send.buffer.bytes=102400
  socket.receive.buffer.bytes=102400
  socket.request.max.bytes=104857600
  
  advertised.host.name=localhost
  num.partitions=1
  num.recovery.threads.per.data.dir=1
  log.flush.interval.messages=30000000
  log.flush.interval.ms=1800000
  log.retention.minutes=30
  log.segment.bytes=1073741824
  log.retention.check.interval.ms=300000
  delete.topic.enable=true
  zookeeper.connect=localhost:2181
  zookeeper.connection.timeout.ms=6000
  super.users=User:admin
  

  zookeeper.properties

  dataDir=/tmp/zookeeper
  clientPort=2181
  maxClientCnxns=0
  authProvider.1=org.apache.zookeeper.server.auth.SASLAuthenticationProvider
  requireClientAuthScheme=sasl
  jaasLoginRenew=3600000
  

  producer.properties

  security.protocol=SASL_PLAINTEXT
  sasl.mechanism=PLAIN
  bootstrap.servers=localhost:9092
  compression.type=none
  

  consumer.properties

  security.protocol=SASL_PLAINTEXT
  sasl.mechanism=PLAIN
  zookeeper.connect=localhost:2181
  zookeeper.connection.timeout.ms=6000
  group.id=test-consumer-group
  

  现在是使您的服务器启动没有任何问题的最重要的文件：

  zookeeper_jaas.conf

  Server {
     org.apache.kafka.common.security.plain.PlainLoginModule required
     username="admin"
     password="admin-secret"
     user_admin="admin-secret";
  };
  

  kafka_server_jaas.conf

  KafkaServer {
     org.apache.kafka.common.security.plain.PlainLoginModule required
     username="admin"
     password="admin-secret"
     user_admin="admin-secret";
  };
  
  Client {
     org.apache.kafka.common.security.plain.PlainLoginModule required
     username="admin"
     password="admin-secret";
  };
  

  完成所有这些配置后，在第一个终端窗口上：

  Terminal 1

  来自kafka根目录

  $ export KAFKA_OPTS="-Djava.security.auth.login.config=/home/usename/Documents/kafka_2.11-0.10.1.0/config/zookeeper_jaas.conf"
  $ bin/zookeeper-server-start.sh config/zookeeper.properties
  

  Terminal 2

  来自kafka根目录

  $ export KAFKA_OPTS="-Djava.security.auth.login.config=/home/usename/Documents/kafka_2.11-0.10.1.0/config/kafka_server_jaas.conf"
  $ bin/kafka-server-start.sh config/server.properties
  

  [BEGIN UPDATE]

  kafka_client_jaas.conf

  KafkaClient {
    org.apache.kafka.common.security.plain.PlainLoginModule required
    username="admin"
    password="admin-secret";
  };
  

  Terminal 3

  在客户端终端上，导出客户端jaas conf文件并启动使用者：

  $ export KAFKA_OPTS="-Djava.security.auth.login.config=/home/username/Documents/kafka_2.11-0.10.1.0/kafka_client_jaas.conf"
  $ ./bin/kafka-console-consumer.sh --new-consumer --zookeeper localhost:2181 --topic test-topic --from-beginning --consumer.config=config/consumer.properties  --bootstrap-server=localhost:9092
  

  Terminal 4

  如果您还想 生产环境 ，请在另一个终端窗口上执行此操作：

  $ export KAFKA_OPTS="-Djava.security.auth.login.config=/home/username/Documents/kafka_2.11-0.10.1.0/kafka_client_jaas.conf"
  $ ./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test-topic --producer.config=config/producer.properties
  

  [END UPDATE]

  回复于 2024-05-08T15:44:42+08:00
• 22

  您需要为Zookeeper创建一个JAAS配置文件并使其使用它 .

  为Zookeeper创建一个文件JAAS配置文件，其内容如下：

  Server {
      org.apache.zookeeper.server.auth.DigestLoginModule required
      user_admin="admin-secret";
  };
  

  用户（admin）和密码（admin-secret）必须与Kafka JAAS配置文件的Client部分中的用户名和密码匹配 .

  要使Zookeeper使用JAAS配置文件，请将以下JVM标志传递给指向之前创建的文件的Zookeeper .

  -Djava.security.auth.login.config=/path/to/server/jaas/file.conf"
  

  如果您正在使用Kafka包中包含的Zookeeper，您可以像这样启动Zookeeper，假设您的Zookeeper JAAS配置文件位于./config/zookeeper_jaas.conf中

  EXTRA_ARGS=-Djava.security.auth.login.config=./config/zookeeper_jaas.conf ./bin/zookeeper-server-start.sh ./config/zookeeper.properties
  

  回复于 2024-05-08T15:44:42+08:00