k8s(196)
-
Kafka Consumer topic을 pattern으로 정의하기
@KafkaListener(topicPattern = "TEST.*", groupId = "test")public void consume(GenericRecord record, Acknowledgment ack) { // your logic}
2025.03.27 -
Kafka Consumer @timestamp 추가하기
// Add @timestamp field Object originalTimestamp = jsonMap.remove("timestamp"); if (originalTimestamp != null) { jsonMap.put("@timestamp", originalTimestamp); }
2025.03.27 -
Elasticsearch rejected: {"error":{"root_cause":[{"type":"invalid_index_name_exception","reason":"Invalid index name [HOME], must be lowercase","index_uuid":"_na_","index":"HOME"}],"type":"invalid_index_name_exception","reason":"Invalid index name [HOME],
elasticsearch의 index이름은 대문자 사용안됨
2025.03.22 -
elasticsearch version 확인
GET /
2025.03.16 -
Schema being registered is incompatible with an earlier schema for subject "TEMP-value", details: [{errorType:'NAME_MISMATCH', description:'The name of the schema has changed (path '/name')', additionalInfo:'expected: com.temp.TEST'}]
schema의 name과 topic 이름이 일치해야 함
2025.03.14 -
in the new schema has no default value and is missing in the old schema
신규 컬럼 추가시, 과거 자료를 위해서 default값 지정 필요{ "type": "record", "name": "TEST", "namespace": "com.example.kafka", "fields": [ { "name": "a", "type": "int" }, { "name": "b", "type": "string" }, { "name": "c", "type": "string" }, { "name": "ip", "type": "string", "default": "" }, // ✅ Add default { "name": "xforwardedfor", "type": "string", "default": "" }, // ✅ Add default { "name..
2025.03.14