Prometheus Node_exporter 之 CPU Memory Net Disk

1. CPU

type: Graph
Unit: short
max: "100"
min: "0"
Label: Percentage
System - cpu 在內核模式下執行的進程佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode="system",instance=~"$node:$port",job=~"$job"}[5m])) * 100


User - cpu 在用戶模式下執行的正常進程佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='user',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Nice - cpu 在用戶模式下執行的 nice 進程佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='nice',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Idle - cpu 在空閒模式下的佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='idle',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Iowait - cpu 在 io 等待的佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='iowait',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Irq - cpu 在服務中斷的佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='irq',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Softirq - cpu 在服務軟中斷的佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='softirq',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Steal - 在 VM 中運行時其餘 VM 佔用的本 VM 的 cpu 的佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='steal',instance=~"$node:$port",job=~"$job"}[5m])) * 100


Guest - 運行各類 VM 使用的 CPU 佔比

metrics:

sum by (mode)(irate(node_cpu_seconds_total{mode='guest',instance=~"$node:$port",job=~"$job"}[5m])) * 100

2. Memory Stack 內存堆棧 /proc/meminfo

type: Graph
Unit: bytes
min: "0"
Label: Bytes
Apps - 用戶空間應用程序使用的內存

metrics:

node_memory_MemTotal_bytes{instance=~"$node:$port",job=~"$job"} - node_memory_MemFree_bytes{instance=~"$node:$port",job=~"$job"}
- node_memory_Buffers_bytes{instance=~"$node:$port",job=~"$job"} - node_memory_Cached_bytes{instance=~"$node:$port",job=~"$job"}
- node_memory_Slab_bytes{instance=~"$node:$port",job=~"$job"} - node_memory_PageTables_bytes{instance=~"$node:$port",job=~"$job"}
- node_memory_SwapCached_bytes{instance=~"$node:$port",job=~"$job"}


PageTables - 用於在虛擬和物理內存地址之間映射的內存

metrics:

node_memory_PageTables_bytes{instance=~"$node:$port",job=~"$job"}


SwapCache - 用於跟蹤已從交換區中提取出來但還沒有修改的頁面的內存

metrics:

node_memory_SwapCached_bytes{instance=~"$node:$port",job=~"$job"}


Slab - 內核用於緩存數據結構以供本身使用的內存（如 inode，dentry 等緩存）

metrics:

node_memory_Slab_bytes{instance=~"$node:$port",job=~"$job"}


Cache - 頻繁訪問的文件數據或內容的緩存

metrics:

node_memory_Cached_bytes{instance=~"$node:$port",job=~"$job"}


Buffers - 塊設備（例如硬盤）緩存

metrics:

node_memory_Buffers_bytes{instance=~"$node:$port",job=~"$job"}


Unused - 未使用的內存大小

metrics:

node_memory_MemFree_bytes{instance=~"$node:$port",job=~"$job"}


Swap - 交換分區使用的空間

metrics:

(node_memory_SwapTotal_bytes{instance=~"$node:$port",job=~"$job"} - node_memory_SwapFree_bytes{instance=~"$node:$port",job=~"$job"})


Harware Corrupted - 內核識別爲已損壞或不工做的內存量

metrics:

node_memory_HardwareCorrupted_bytes{instance=~"$node:$port",job=~"$job"}

3. Network Traffic 各個網絡接口的傳輸速率

type: Graph
Unit: bytes/sec
Label: Bytes out(-)/in(+)
{{device}} - Receive 各個網絡接口下載速率

metrics:

irate(node_network_receive_bytes_total{instance=~"$node:$port",job=~"$job"}[5m])


{{device}} - Transmit 各個網絡接口上傳速率

metrics:

irate(node_network_transmit_bytes_total{instance=~"$node:$port",job=~"$job"}[5m])

4. Disk Space Used 全部掛載的文件系統的磁盤空間大小

type: Graph
Unit: bytes
min: "0"
Label: Bytes
metrics:

node_filesystem_size_bytes{instance=~"$node:$port",job=~"$job",device!~'rootfs'} - node_filesystem_avail_bytes{instance=~"$node:$port",job=~"$job",device!~'rootfs'}

5. Disk IOps 磁盤讀寫

type: Graph
Unit: I/O ops/sec (iops)
Label: IO read(-)/write(+)
{{device}} - Reads completed 磁盤的讀取速率（五分鐘內）

metrics:

irate(node_disk_reads_completed_total{instance=~"$node:$port",job=~"$job",device=~"[a-z]*[a-z]"}[5m])


{{device}} - Writes completed 磁盤的寫入速率（五分鐘內）

metrics:

irate(node_disk_writes_completed_total{instance=~"$node:$port",job=~"$job",device=~"[a-z]*[a-z]"}[5m])

 

 

6. I/O Usage Read / Write

type: Graph
Unit: bytes
Label: Bytes read(-)/write(+)
成功讀取的字節數（五分鐘內）

metrics:

irate(node_disk_read_bytes_total{instance=~"$node:$port",job=~"$job",device=~"[a-z]*[a-z]"}[5m])


成功寫入的字節數（五分鐘內）

metrics:

irate(node_disk_written_bytes_total{instance=~"$node:$port",job=~"$job",device=~"[a-z]*[a-z]"}[5m])

7. I/O Usage Times 執行I / O所花費的總時間。

type: Graph
Unit: ms
Label: Milliseconds
metrics:

irate(node_disk_io_time_seconds_total{instance=~"$node:$port",job=~"$job",device=~"[a-z]*[a-z]"} [5m])