goaccess 經過jsonpath 轉換爲prometheus metrics

時間 2019-11-22

標籤 goaccess 經過 jsonpath 轉換 prometheus metrics 简体版

原文原文鏈接

goaccess 是一個不錯的日誌分析工具，包含了json 數據同時支持基於websocket 的實時數據處理，固然咱們能夠經過jsonpath
的exporter 轉換爲支持promethues 的metrics，仍是很方便的html

環境準備

docker-compose 文件

version: "3"
services:
  metrics:
   image: sunbird/prometheus-jsonpath-exporter
   volumes: 
   - "./conf/config.yml:/etc/prometheus-jsonpath-exporter/config.yml"
   ports:
   - "9158:9158"
   command: /etc/prometheus-jsonpath-exporter/config.yml
  g:
    image: grafana/grafana
    ports:
    - "3000:3000"
  p:
    image: prom/prometheus
    volumes:
    - "./conf/prometheus.yml:/etc/prometheus/prometheus.yml"
    ports:
    - "9090:9090" 
  log:
    image: dalongrong/goaccess-geo
    ports:
    - "7890:7890"
    volumes: 
    - "./data:/srv/data"
    - "./logs:/srv/logs"
    - "./html:/srv/report"
    - "./geoip/:/src/geoip/"
  web:
    image: nginx
    ports: 
    - "8080:80"
    volumes: 
    - "./html/:/usr/share/nginx/html/"

prometheus 配置

conf/prometheus.ymlnginx

scrape_configs:
  - job_name: go_access
    metrics_path: /
    static_configs:
      - targets: ['metrics:9158']

jsonpath exporter 配置

conf/config.ymlgit

exporter_port: 9158 # Port on which prometheus can call this exporter to get metrics
log_level: info
json_data_url: http://web/app.json # Url to get json data used for fetching metric values
metric_name_prefix: go_access # All metric names will be prefixed with this value
metrics:
- name: total_request # Final metric name will be go_access_total_request
  description: Number of total request
  path: $.general.total_requests

goaccess 配置

主要是添加支持json 的處理data/goaccess.confgithub

geoip-database /src/geoip/GeoLiteCity.dat
log-format COMBINED
real-time-html true
log-file /srv/logs/access.log
output /srv/report/index.html
output /srv/report/app.json