Apache Hive Monitoring

Last updated on 18 January, 2022

The LogicMonitor monitoring suite for Apache Hive uses JMX to query Hive for a variety of health and performance issues.

Compatibility

As of Jan 2022, LogicMonitor’s Apache Hive package is known to be compatible with:

  • Version 2.3.8 and up.

As Apache releases newer versions of Hive, LogicMonitor will test and extend coverage as necessary.

Setup Requirements

Add resources into monitoring

Add your Apache Hive hosts into monitoring. For more information on adding resources into monitoring, see Adding Devices.

Assign properties to Resources

The following custom properties must be set on the Apache Hive resource within LogicMonitor. For more information on setting properties, see Resource and Instance Properties.

PropertyValue
jmx.ports(Optional) Network port number where the JMX metrics are available. Defaults to 8808.
system.categoryApacheHive. Added automatically by the PropertySource, addCategory_ApacheHive.

Ports

By default, port number 8808 is used for JMX metrics.

Import LogicModules

From the LogicMonitor public repository, import all Apache Hive LogicModules, which are listed in the LogicModules in Package section of this support article. If these LogicModules are already present, ensure you have the most recent versions.

After the LogicModules are imported (assuming all previous setup requirements have been met), data collection will automatically commence.

Troubleshooting

  • Not all modules may return data. Some Hive and Metastore configurations do not provide all metrics. See Hive’s Metrics Documentation.
  • The version of your HiveServer installation can also determine the number of metrics that are returned.

LogicModules in Package

LogicMonitor’s package for Apache Hive consists of the following LogicModules. For full coverage, please ensure that all of these LogicModules are imported into your LogicMonitor platform.

Display Name Type Description
addCategory_ApacheHive PropertySource Checks if Apache Hive is running on the configured JMX port.
Hive Metastore API Events DataSource Apache Hive Metastore API Events, including Add, Alter, Create, Drop, and other miscellaneous events per second.
Hive Metastore API Active Calls DataSource Apache Hive Metastore API Active Calls, including Add, Alter, Create, Drop, and other miscellaneous events.
Hive Metastore DataSource Apache HiveServer2 Metastore database, table and partition metrics.
Hive JVM DataSource Apache HiveServer2 JVM metrics regarding memory and thread utilization.
Hive HiveServer2 API Events DataSource Apache HiveServer2 API Events, including HS2 Operation and SQL operations.
Hive HiveServer2 API Active Calls DataSource Apache HiveServer2 API Active Calls, including HS2 Operation and SQL operations.
Hive HiveServer2 DataSource Apache HiveServer2 operation metrics, including SQL operations, running and finished queries, sessions and more.

When setting static datapoint thresholds on the various metrics tracked by this package’s DataSources, LogicMonitor follows the technology owner’s best practice KPI recommendations. If necessary, we encourage you to adjust these predefined thresholds to meet the unique needs of your environment. For more information on tuning datapoint thresholds, see Tuning Static Thresholds for Datapoints.

In This Article