使用Prometheus和Grafana监控Mysql服务器性能

这是一篇快速入门文章,介绍了如何使用 Prometheus 和 Grafana 对Mysql服务器性能进行监控。内容基于 这篇 文章,结合了自己的实际实

这是一篇快速入门文章,介绍了如何使用 PrometheusGrafana 对Mysql服务器性能进行监控。内容基于 这篇 文章,结合了自己的实际实践并根据最新版本的应用进行了调整。下面是两张效果图:

使用Prometheus和Grafana监控Mysql服务器性能

使用Prometheus和Grafana监控Mysql服务器性能

概述

Prometheus 是一个开源的服务监控系统,它通过HTTP协议从远程的机器收集数据并存储在本地的时序数据库上。它提供了一个简单的网页界面、一个功能强大的查询语言以及HTTP接口等等。Prometheus通过安装在远程机器上的 exporter 来收集监控数据,我们用到了以下两个exporter:

  • node_exporter – 用于机器系统数据

  • mysqld_exporter – 用于Mysql服务器数据

Grafana 是一个开源的功能丰富的数据可视化平台,通常用于时序数据的可视化。它内置了以下数据源的支持:

使用Prometheus和Grafana监控Mysql服务器性能

并可以通过插件扩展支持的数据源。

架构图

下面是我们安装时用到的架构图:

使用Prometheus和Grafana监控Mysql服务器性能

安装和运行Prometheus

首先我们安装Prometheus:

$ wget https://github.com/prometheus/prometheus/releases/download/v1.1.3/prometheus-1.1.3.linux-amd64.tar.gz -O prometheus-1.1.3.linux-amd64.tar.gz$ mkdir /usr/local/services/prometheus$ tar zxf prometheus-1.1.3.linux-amd64.tar.gz -C /usr/local/services/prometheus --strip-components=1

然后在安装目下编辑配置文件 prometheus.yml

global: scrape_interval: 15s evaluation_interval: 15sscrape_configs: - job_name: linux static_configs: - targets: ['192.168.204.63:9100'] labels: instance: db1 - job_name: mysql static_configs: - targets: ['192.168.204.63:9104'] labels: instance: db1

192.168.204.63 是我们数据库主机的IP,端口则是对应的 exporter 的监听端口。

然后我们启动Prometheus:

$ ./prometheus INFO[0000] Starting prometheus (version=1.1.3, branch=master, revision=ac374aa6748e1382dbeb72a00abf47d982ee8fff) source=main.go:73INFO[0000] Build context (go=go1.6.3, user=root@3e392b8b8b44, date=20160916-11:36:30) source=main.go:74INFO[0000] Loading configuration file prometheus.yml source=main.go:221INFO[0000] Loading series map and head chunks... source=storage.go:358INFO[0000] 4 series loaded. source=storage.go:363INFO[0000] Starting target manager... source=targetmanager.go:76WARN[0000] No AlertManagers configured, not dispatching any alerts source=notifier.go:176INFO[0000] Listening on :9090 source=web.go:235

Prometheus内置了一个web界面,我们可通过 http://monitor_host:9090 进行访问:

使用Prometheus和Grafana监控Mysql服务器性能

Status -> Targets 页面下,我们可以看到我们配置的两个Target,它们的 StateDOWN

使用Prometheus和Grafana监控Mysql服务器性能

下一步我们需要安装并运行exporter。下载exporters并解压:

$ wget https://github.com/prometheus/node_exporter/releases/download/0.12.0/node_exporter-0.12.0.linux-amd64.tar.gz -O node_exporter-0.12.0.linux-amd64.tar.gz$ wget https://github.com/prometheus/mysqld_exporter/releases/download/v0.9.0/mysqld_exporter-0.9.0.linux-amd64.tar.gz -O mysqld_exporter-0.9.0.linux-amd64.tar.gz$ mkdir /usr/local/services/prometheus_exporters$ tar zxf node_exporter-0.12.0.linux-amd64.tar.gz -C /usr/local/services/prometheus_exporters --strip-components=1$ tar zxf mysqld_exporter-0.9.0.linux-amd64.tar.gz -C /usr/local/services/prometheus_exporters --strip-components=1

运行node_exporter :

$ cd /usr/local/services/prometheus_exporters$ ./node_exporter INFO[0000] Starting node_exporter (version=0.12.0, branch=master, revision=df8dcd2) source=node_exporter.go:135INFO[0000] Build context (go=go1.6.2, user=root@ff68505a5469, date=20160505-22:14:18) source=node_exporter.go:136INFO[0000] No directory specified, see --collector.textfile.directory source=textfile.go:57INFO[0000] Enabled collectors: source=node_exporter.go:155INFO[0000] - vmstat source=node_exporter.go:157INFO[0000] - conntrack source=node_exporter.go:157INFO[0000] - filesystem source=node_exporter.go:157INFO[0000] - meminfo source=node_exporter.go:157INFO[0000] - netdev source=node_exporter.go:157INFO[0000] - stat source=node_exporter.go:157INFO[0000] - entropy source=node_exporter.go:157INFO[0000] - mdadm source=node_exporter.go:157INFO[0000] - sockstat source=node_exporter.go:157INFO[0000] - time source=node_exporter.go:157INFO[0000] - uname source=node_exporter.go:157INFO[0000] - diskstats source=node_exporter.go:157INFO[0000] - filefd source=node_exporter.go:157INFO[0000] - loadavg source=node_exporter.go:157INFO[0000] - netstat source=node_exporter.go:157INFO[0000] - textfile source=node_exporter.go:157INFO[0000] Listening on :9100 source=node_exporter.go:176

mysqld_exporter需要连接到Mysql,所以需要Mysql的权限,我们先为它创建用户并赋予所需的权限:

mysql> GRANT REPLICATION CLIENT, PROCESS ON *.* TO 'prom'@'localhost' identified by 'abc123';mysql> GRANT SELECT ON performance_schema.* TO 'prom'@'localhost';

创建 .my.cnf 文件并运行mysqld_exporter:

$ cd /usr/local/services/prometheus_exporters$ cat << EOF > .my.cnf[client]user=prompassword=abc123EOF$ ./mysqld_exporter -config.my-cnf=".my.cnf" INFO[0000] Starting mysqld_exporter (version=0.9.0, branch=master, revision=8400af20ccdbf6b5e0faa2c925c56c48cd78d70b) source=mysqld_exporter.go:432INFO[0000] Build context (go=go1.6.3, user=root@2c131c66ca20, date=20160926-18:28:09) source=mysqld_exporter.go:433INFO[0000] Listening on :9104 source=mysqld_exporter.go:451

我们再次回到 Status -> Targets 页面,可以看到两个Target的状态已经变成 UP 了:

使用Prometheus和Grafana监控Mysql服务器性能

安装和运行Grafana

下载并解压Grafana:

$ wget https://grafanarel.s3.amazonaws.com/builds/grafana-3.1.1-1470047149.linux-x64.tar.gz$ mkdir /usr/local/services/grafana$ tar zxvf grafana-3.1.1-1470047149.linux-x64.tar.gz -C /usr/local/services/grafana --strip-components=1

编辑配置文件 /usr/local/services/grafana/conf/defaults.ini ,修改 dashboards.json 段落下两个参数的值:

[dashboards.json]enabled = truepath = /var/lib/grafana/dashboards

安装仪表盘:

$ git clone https://github.com/percona/grafana-dashboards.git$ cp -r grafana-dashboards/dashboards /var/lib/grafana

运行以下命令为Grafana打个补丁,不然图表不能正常显示:

$ sed -i 's/expr=/(./)/.replace(/(./)/.expr,/(./)/.scopedVars/(.*/)var /(./)=/(./)/.interval/expr=/1.replace(/2.expr,/3.scopedVars/4var /5=/1.replace(/6.interval, /3.scopedVars)/' /usr/local/services/grafana/public/app/plugins/datasource/prometheus/datasource.js$ sed -i 's/,range_input/.replace(//"{//g,"//"").replace(//}"//g,"//""),range_input/; s/step_input:""/step_input:this.target.step/' /usr/local/services/grafana/public/app/plugins/datasource/prometheus/query_ctrl.js

最后我们运行Grafana服务:

$ cd /usr/local/services/grafana/bin/$ ./grafana-serverINFO[09-28|12:23:33] Starting Grafana logger=main version=3.1.1 commit=a4d2708 compiled=2016-08-01T18:20:16+0800INFO[09-28|12:23:33] Config loaded from logger=settings file=/usr/local/services/grafana/conf/defaults.iniINFO[09-28|12:23:33] Path Home logger=settings path=/usr/local/services/grafanaINFO[09-28|12:23:33] Path Data logger=settings path=/usr/local/services/grafana/dataINFO[09-28|12:23:33] Path Logs logger=settings path=/usr/local/services/grafana/data/logINFO[09-28|12:23:33] Path Plugins logger=settings path=data/pluginsINFO[09-28|12:23:33] Initializing DB logger=sqlstore dbtype=mysqlINFO[09-28|12:23:33] Starting DB migration logger=migratorINFO[09-28|12:23:33] Creating json dashboard index for path: [/var/lib/grafana/dashboards] INFO[09-28|12:23:33] Starting plugin search logger=pluginsINFO[09-28|12:23:33] Server Listening logger=server address=0.0.0.0:3000 protocol=http subUrl=

我们可通过 http://monitor_host:3000 访问Grafana网页界面(缺省的帐号/密码为admin/admin):

使用Prometheus和Grafana监控Mysql服务器性能

使用Prometheus和Grafana监控Mysql服务器性能

然后我们到 Data Sources 页面添加数据源:

使用Prometheus和Grafana监控Mysql服务器性能

最后我们就可以通过选择不同的仪表盘(左上角)和时间段(右上角)来呈现图表了:

使用Prometheus和Grafana监控Mysql服务器性能

使用Prometheus和Grafana监控Mysql服务器性能

使用Prometheus和Grafana监控Mysql服务器性能

参考资料

https://prometheus.io/

http://grafana.org/

https://github.com/percona/gr...

https://www.percona.com/blog/...
未登录用户
全部评论0
到底啦