千家信息网

logstash获取北京时间

发表于:2024-10-07 作者:千家信息网编辑
千家信息网最后更新 2024年10月07日,由于logstash会自动将@timestamp时间转成UTC时间,网上搜了很多种方法无果后。只好从日志中提取年月日来进行按北京时间分表。日志格式JSON:{"@timestamp":"2016-08
千家信息网最后更新 2024年10月07日logstash获取北京时间

由于logstash会自动将@timestamp时间转成UTC时间,网上搜了很多种方法无果后。只好从日志中提取年月日来进行按北京时间分表。

日志格式JSON:

{"@timestamp":"2016-08-22T09:13:06.024Z",......}
input { redis {            host => "192.168.1.21"            port => "6379"            key => "filebeat"            data_type => "list"            password => "nginx_pass"            threads => 50        }}filter {        mutate {                gsub => ["message", "\\x", "\\\x"]        }        if [type] == "nginxacclog" {                json {                                    source => "message"                        }                ruby {                        code => "event['ctime'] = event['@timestamp'].time.localtime"                        #code => "event['ctime'] = event['@timestamp'].time.localtime + 8*60*60"                     }                grok{                        match => { "ctime" => ["%{INT:years_dik3k}-%{INT:months_dik3k}-%{INT:days_dik3k}T*"]}                    }                grok {                                                add_field => ["type_xi09wnk", "nginxacclog"]                        match => ["requesturi", "%{URIPATH:baseurl}(?:\?%{NOTSPACE:request})"]                   remove_tag => "requesturi"                        }                kv {                        source => "request"                        field_split => "&?"                        value_split => "="                     }                                kv {                        source => "post_requ"                        field_split => "&?"                        value_split => "="                }             }}output {if [type_xi09wnk] == "nginxacclog" {        mongodb{            collection => "nginx_log%{years_dik3k}%{months_dik3k}%{days_dik3k}"            isodate => true            database => "logdb"            uri => "mongodb://user:pass@10.10.1.102:27017/logdb"        }}



0