Using Docker to visualize MySQL performance schema

2 min read

Sep 30, 2015 12:00:00 AM

Last week, I was pleased to present at Percona Live Amsterdam 2015 regarding the importance of Performance Schema and how to begin approaching visualizing the data that is available to diagnose performance issues and fine tune your MySQL environment. You can download the slides from the Percona Live conference page. The session highlighted using the ELK ( Elasticsearch+ Logstash+ Kibana) stack to assist visualizing event data, in addition to graphite+graphana to visualize time-series data. As many people who attend conferences are aware, the availability of internet access is sketchy at best. To combat this, the visualization stack that I created was strictly local utilizing Docker, specifically the Docker Toolbox. The docker-compose.yml file that creates the stack is fairly straightforward. Since the session was about the upcoming changes to the Performance Schema in MySQL 5.7, I chose to use MySQL's official 5.7 Docker image: https://gist.github.com/dtest/23fc9d36a612ff98072f#file-mysql-docker-compose-yml Pay attention to two aspects of this output.

I am creating a mysql_data container. Using a Data Volume Container is highly recommended when working with any data that should be persisted and not baked into the Docker image.
I am building the container using the `build` command. Throughout the entire docker-compose.yml file, I am adding additional functionality to base containers provided by the Docker Hub. For the MySQL container, the Dockerfile looks like this: https://gist.github.com/dtest/23fc9d36a612ff98072f#file-mysql-dockerfile

The rest of the docker-compose.yml file follows similar guidelines, and I won't explain each aspect here. You can find the full docker-compose.yml file and the Dockerfiles for each component of the stack in the dtest/visualize-mysql github repository. To bring the stack up, the steps are straightforward:

Install Docker Toolbox on your machine
Create the docker-machine: https://gist.github.com/dtest/23fc9d36a612ff98072f#file-create_machine-sh
Clone the dtest/visualize-mysql repository and change into the parent directory. https://gist.github.com/dtest/23fc9d36a612ff98072f#file-clone-repo-sh
Bring the environment up: https://gist.github.com/dtest/23fc9d36a612ff98072f#file-docker-up-sh
Verify that the containers are running, noting that the data volume containers should have exited with status 0: https://gist.github.com/dtest/23fc9d36a612ff98072f#file-docker-ps-sh
You can then point your browser to the Kibana (https://<docker-machine IP>:9292/) and Graphana (https://<docker-machine IP>:8000/) dashboards. The Graphana dashboard requires login, and the default credentials are admin/admin.

The dashboards for the presentation are not automatically loaded, so you can find some basic dashboards in the dashboards directory of the repository. Unfortunately, I did not export them before discarding the machine so have lost some of the fine-tuning changes I had made. I do intend to recreate them and even try out the newer versions of the ELK stack available. The goal here is to show how easy it is to setup a local environment using Docker and existing images on the Docker Hub to get started with your own projects. Discover more about our expertise in MySQL.

On this page

Ready to unlock value from your data?

With Pythian, you can accomplish your data transformation goals and more.

Speak with Pythian consultants now →

What We Do

Using Docker to visualize MySQL performance schema

Share this

Share this

More resources

Backing up your MySQL instance physically with Docker

Part 1: How to effectively use a performance schema

What to expect at ProxySQL Technology Day in Ghent

Ready to unlock value from your data?