kafka 설정

StoragClassapiVersion: storage.k8s.io/v1kind: StorageClassmetadata: name: kafka-storageprovisioner: nfs.csi.k8s.io # Use the correct NFS CSI drivervolumeBindingMode: ImmediatePV: statefulset의 replicas에 맞추처 만들면 됨apiVersion: v1kind: PersistentVolumemetadata: name: kafka-pv-0spec: capacity: storage: 5Gi accessModes: - ReadWriteOnce storageClassName: kafka-storage # Changed from nfs-sto..

usage: zk-ready [-h] ZOOKEEPER_CONNECT TIMEOUT_IN_MSzk-ready: error: too few arguments/bin/sh: line 2: zookeeper-1.zookeeper-headless:2181,: command not found/bin/sh: line 3: zookeeper-2.zookeeper-headless:2181: command not found/bin/sh: line 4: 40000: co

원인: KAFKA_ZOOKEEPER_CONNECT is not formatted correctlymultiline YAML block (|)이 정상적으로 적용되지 않음조치# 변경전 KAFKA_ZOOKEEPER_CONNECT: | zookeeper-0.zookeeper-headless:2181, zookeeper-1.zookeeper-headless:2181, zookeeper-2.zookeeper-headless:2181 # 변경후 KAFKA_ZOOKEEPER_CONNECT: "zookeeper-0.zookeeper-headless:2181,zookeeper-1.zookeeper-headless:2181,zookeeper-2.zookeeper-headless:2181"

ERROR Invalid config, exiting abnormally (org.apache.zookeeper.server.quorum.QuorumPeerMain)org.apache.zookeeper.server.quorum.QuorumPeerConfig$ConfigException: 2181 does not have the form server_config or server_config;client_config where server_config i

ZOOKEEPER_SERVERS의 설정이 형식에 어긋나서 발생함# 변경전 ZOOKEEPER_SERVERS: | server.1=zookeeper-0.zookeeper-headless.kafka:2888:3888;2181 server.2=zookeeper-1.zookeeper-headless.kafka:2888:3888;2181 server.3=zookeeper-2.zookeeper-headless.kafka:2888:3888;2181# 변경후 server.1=zookeeper-0.zookeeper-headless.kafka:2888:3888 server.2=zookeeper-1.zookeeper-headless.kafka:2888:3888 server.3=zookeepe..

ERROR Exception while listening to address zookeeper-1.zookeeper-headless.kafka/<unresolved>:3888

coreDNS에서 찾지를 못함coreDNS에 bind pod를 forward한 것이 문제가 되어서, 일단 제거함

zookeeper 설정

ConfigMap apiVersion: v1kind: ConfigMapmetadata: name: zookeeper-config namespace: kafkadata: ZOOKEEPER_CLIENT_PORT: "2181" ZOOKEEPER_TICK_TIME: "2000" ZOOKEEPER_INIT_LIMIT: "5" ZOOKEEPER_SYNC_LIMIT: "2" ZOOKEEPER_SERVERS: | # ZOOKEEPER_SERVER_ID는 1부터 시작함 # pod의 hostname은 0부터 시작함 server.1=zookeeper-0.zookeeper-headless:2888:3888 server.2=zookeeper-1.zookeeper-headless:2888:3888 ..

zookeeper에서 특정 pod만 status가 ContainerCreating인 경우

증상kubectl get pod -n kafkaNAME READY STATUS RESTARTS AGEzookeeper-0 1/1 Running 0 9szookeeper-1 1/1 Running 0 7szookeeper-2 0/1 ContainerCreating 0 5skubectl logs -f pod/zookeeper-2 -n kafkaError from server (BadRequest): container "zookeeper" in pod "zookeeper-2" is waiting to start: ContainerCreati..