You are here
ZooKeeper Monitoring
ZooKeeper Opspack
ZooKeeper is a distributed hierarchical key-value store, which is used to provide a distributed configuration service, synchronization service, and naming registry for large distributed systems. ZooKeeper was a sub-project of Hadoop.
ZooKeeper's architecture achieves high availability through redundant services and ZooKeeper nodes store their data in a hierarchical name space, which maintains the consistency of a shared configuration service. ZooKeeper is utilized by a variety of large organizations including Rackspace, Yahoo!, Reddit, and eBay as well as open source enterprise search systems such as Solr.
What You Can Monitor
Opsview Monitor contains all the performance metrics needed to monitor and keep your Zookeeper host online. Critical metrics are monitored and alerted on, to keep you aware of the number of Zookeeper file descriptors, the latency of Zookeeper, the Server mode and more.
Service Checks
| Service Check | Description |
|---|---|
| Open_file_descriptor_percentage | Number of ZooKeeper file descriptors. |
| Latency | The average/minimum/maximum latency of ZooKeeper. |
| Server_mode | The current mode of the server (leader, follower and standalone) |
| Watch_count | The number of watchers on the ZooKeeper nodes. |
| Ephemerals_count | Number of temporary nodes. |
| Approximate_data_size | The size of the nodes. |
| Synced_followers | The number of followers that the leader is synced with (only available on the Leader server) |
| Pending_syncs | The number of followers that the leader is waiting to sync with (only available on the Leader server) |
| Followers | The number of followers the leader server has (only available on the Leader server) |
| Packets_received | The total number of packets received by ZooKeeper. |
| Packets_sent | The total number of packets sent by ZooKeeper. |
| Connections | The ZooKeeper connection count. |
| Outstanding_requests | The total number of oustanding requests. |
| Node_count | The ZooKeeper node count. |
Prerequisites
This Opspack has been tested against ZooKeeper 3.3.0 and 3.4.9, other versions may be compatible but are not officially supported. Some of the service checks will only work with ZooKeeper version 3.4+ and the leader server.
If you are running a version older than 3.4, then you will need to disable the following service checks; approximate_data_size, ephemeral_count, followers, open_file_descriptor_percentage, pending_syncs, synced_followers and watch_count.
If you are monitoring a server that is in 'follower' or 'standalone' mode, then you will need to disable the following service checks; pending_followers and synced_followers as these metrics are only available on the leader machine.
If you are running ZooKeeper with a non-Unix operating system, you will need to disable the open_file_descriptor_percentage service check.
Setup and Configuration
To configure and utilize this Opspack, you simply need to add the 'Application - ZooKeeper' Opspack to your Opsview Monitor system.
Step 1: Add the Host Template
Add the Application - Zookeeper Host Template to your Opsview Monitor host.
For more information, refer to Opsview Knowledge Center - Adding Host Templates to Hosts.
Step 2: Add and configure variables required for this host
| Variable | Description |
|---|---|
| ZOOKEEPER_PORT | Specify the Zookeeper's port number (default: 2181) |
For more information, refer to Opsview Knowledge Center - Adding Variables to Hosts.
Step 3: Apply changes and the system will now be monitored
