k8s/EFK(80)
-
td-agent avro @timestamp 추가하기
@type record_transformer enable_ruby true value_schema '{\"type\":\"record\",\"namespace\":\"com.hys.ubuntu\",\"name\":\"ubuntu_syslog\",\"fields\":[{\"name\":\"timestamp\",\"type\":\"string\"},{\"name\":\"host\",\"type\":\"string\"},{\"name\":\"ident\",\"type\":\"string\"},{\"name\":\"pid\",\"type\":\"string\"},{\"name\":\"message\",\"type\":\"string\"}]}' records [{"value":{"timestamp..
2025.04.10 -
fluent-plugin-out-http(1.3.4)
참조https://rubygems.org/gems/fluent-plugin-out-http/versions/1.3.4?locale=en fluent-plugin-out-http | RubyGems.org | your community gem host rubygems.orghttps://www.rubydoc.info/gems/fluent-plugin-out-http/1.3.4 File: README — Documentation for fluent-plugin-out-http (1.3.4)fluent-plugin-out-http, a plugin for Fluentd A generic fluentd output plugin for sending logs to an HTTP endpoint. NOTE: Thi..
2025.04.08 -
td-agent 사용하는 plugin 목록 확인
td-agent-gem list | grep fluent-plugin
2025.04.07 -
td-agent rest api/avro 방식으로 syslog 전달
# 디버깅 추가 log_level debug# syslog 정보 가져오기 @type tail path /var/log/syslog pos_file /var/log/td-agent/syslog.pos tag syslog.all read_from_head true @type syslog # AVRO 방식으로 데이터 전송# records는 필요한 컬럼 하나씩 상세히 기술해줘야 함 @type record_transformer enable_ruby true value_schema '{\"type\":\"record\",\"name\":\"SyslogRecord\",\"fields\":[{\"name\":\"host\",\"type\":\"string\"},{\"name\":\"i..
2025.04.07 -
td-agent 디버깅
/etc/td-agent/td-agent.conf log_level debug로그 확인# 재기동sudo systemctl restart td-agent# 로그확인tail -f /var/log/td-agent/td-agent.log
2025.04.05 -
ubuntu에 td-agent 설치
설치curl -fsSL https://packages.treasuredata.com/GPG-KEY-td-agent | sudo apt-key add -echo "deb https://packages.treasuredata.com/4/ubuntu/focal/ focal contrib" | sudo tee /etc/apt/sources.list.d/td-agent.listsudo apt updatesudo apt install td-agent오류# 오류The following packages have unmet dependencies: td-agent : Depends: libssl1.1 (>= 1.1.1) but it is not installableE: Unable to correct problems, ..
2025.04.05