Ranger Admin
Collect Ranger Admin Metrics
Configuration¶
1. Ranger Admin Configuration¶
1.1 Download jmx-exporter¶
Download URL: https://github.com/prometheus/jmx_exporter
1.2 Download jmx Script¶
Download URL: https://github.com/lrwh/jmx-exporter/blob/main/common.yml
1.3 Ranger Admin Startup Parameter Adjustment¶
Add the following to Ranger Admin's startup parameters:
{JAVA_GC_ARGS} -javaagent:/opt/jmx/jmx_exporter-1.0.1.jar=localhost:17143:/opt/jmx/common.yml
1.4 Restart Ranger Admin¶
2. DataKit Collector Configuration¶
2.1 Install DataKit¶
2.2 Configure Collector¶
Since jmx-exporter can directly expose the metrics
URL, you can use the prom collector to collect the metrics.
Navigate to the conf.d/prom
directory under the DataKit installation directory, and copy prom.conf.sample
to ranger-admin.conf
.
cp prom.conf.sample ranger-admin.conf
Modify the content of ranger_admin.conf
as follows:
urls = ["http://localhost:17143/metrics"]
source ="ranger-admin"
[inputs.prom.tags]
component = "ranger-admin"
interval = "10s"
Adjust other configurations as needed, parameter adjustment instructions:
- urls: The
jmx-exporter
metrics URL, fill in the metrics URL exposed by the corresponding component - source: Collector alias, recommended to differentiate
- keep_exist_metric_name: Keep the metric name
- interval: Collection interval
- inputs.prom.tags: Add additional tags
3. Restart DataKit¶
Metrics¶
Hadoop Measurement¶
Ranger Admin metrics are located under the Hadoop Measurement. Here we mainly introduce the Ranger Admin related metrics.
Metrics | Description | Unit |
---|---|---|
hadoop_admin_contextenrichercount |
Number of context enrichers |
count |
hadoop_admin_contextenrichercounttag |
Number of context enrichers with specific tags |
count |
hadoop_admin_denyconditioncount |
Number of deny conditions |
count |
hadoop_admin_denyconditioncounttag |
Number of deny conditions with specific tags |
count |
hadoop_admin_droppedpuball |
Total number of dropped publish operations |
count |
hadoop_admin_gccounttotal |
Total number of garbage collection (GC) operations |
count |
hadoop_admin_gctimemax |
Maximum time spent on garbage collection (GC) |
ms |
hadoop_admin_gctimetotal |
Total time spent on garbage collection (GC) |
ms |
hadoop_admin_getgroupsavgtime |
Average time to get user groups |
ms |
hadoop_admin_getgroupsnumops |
Number of operations to get user groups |
count |
hadoop_admin_groupcount |
Number of user groups |
count |
hadoop_admin_loginfailureavgtime |
Average time spent on login failures |
ms |
hadoop_admin_loginfailurenumops |
Number of login failures |
count |
hadoop_admin_loginsuccessavgtime |
Average time spent on successful logins |
ms |
hadoop_admin_loginsuccessnumops |
Number of successful logins |
count |
hadoop_admin_maskingcount |
Number of data masking operations |
count |
hadoop_admin_memorycurrent |
Current memory usage |
count |
hadoop_admin_memorymax |
Maximum memory usage |
count |
hadoop_admin_numactivesinks |
Number of active sinks |
count |
hadoop_admin_numactivesources |
Number of active sources |
count |
hadoop_admin_numallsinks |
Total number of sinks |
count |
hadoop_admin_numallsources |
Total number of sources |
count |
hadoop_admin_processorsavailable |
Number of available processors |
count |
hadoop_admin_publishavgtime |
Average time spent on publish operations |
ms |
hadoop_admin_publishnumops |
Number of publish operations |
count |
hadoop_admin_renewalfailures |
Number of renewal failures |
count |
hadoop_admin_renewalfailurestotal |
Total number of renewal failures |
count |
hadoop_admin_resourceaccesscount |
Number of resource accesses |
count |
hadoop_admin_resourceaccesscountatlas |
Number of accesses to Atlas resources |
count |
hadoop_admin_resourceaccesscounthbase |
Number of accesses to HBase resources |
count |
hadoop_admin_resourceaccesscounthdfs |
Number of accesses to HDFS resources |
count |
hadoop_admin_resourceaccesscounthive |
Number of accesses to Hive resources |
count |
hadoop_admin_resourceaccesscountkafka_connect |
Number of accesses to Kafka Connect resources |
count |
hadoop_admin_resourceaccesscountkms |
Number of accesses to KMS (Key Management System) resources |
count |
hadoop_admin_resourceaccesscountknox |
Number of accesses to Knox resources |
count |
hadoop_admin_resourceaccesscountkudu |
Number of accesses to Kudu resources |
count |
hadoop_admin_resourceaccesscountozone |
Number of accesses to Ozone resources |
count |
hadoop_admin_resourceaccesscountsolr |
Number of accesses to Solr resources |
count |
hadoop_admin_resourceaccesscounttag |
Number of resource accesses with specific tags |
count |
hadoop_admin_resourceaccesscountyarn |
Number of resource accesses using ARN (Amazon Resource Name) |
count |
hadoop_admin_rowfilteringcount |
Number of row filtering operations |
count |
hadoop_admin_servicecount |
Total number of services |
count |
hadoop_admin_servicecountatlas |
Number of Atlas services |
count |
hadoop_admin_servicecounthbase |
Number of HBase services |
count |
hadoop_admin_servicecounthdfs |
Number of HDFS services |
count |
hadoop_admin_servicecounthive |
Number of Hive services |
count |
hadoop_admin_servicecountkafka |
Number of Kafka services |
count |
hadoop_admin_servicecountkafka_connect |
Number of Kafka Connect services |
count |
hadoop_admin_servicecountkms |
Number of KMS services |
count |
hadoop_admin_servicecountknox |
Number of Knox services |
count |
hadoop_admin_servicecountkudu |
Number of Kudu services |
count |
hadoop_admin_servicecountsolr |
Number of Solr services |
count |
hadoop_admin_servicecounttag |
Number of services with specific tags |
count |
hadoop_admin_servicecountyarn |
Number of services using ARN |
count |
hadoop_admin_sink_jsonavgtime |
Average time spent on JSON sinks |
ms |
hadoop_admin_sink_jsondropped |
Number of messages dropped by JSON sinks |
count |
hadoop_admin_sink_jsonnumops |
Number of JSON sink operations |
count |
hadoop_admin_sink_jsonqsize |
Queue size of JSON sinks |
count |
hadoop_admin_sink_prometheusavgtime |
Average time spent on Prometheus sinks |
count |
hadoop_admin_sink_prometheusdropped |
Number of messages dropped by Prometheus sinks |
count |
hadoop_admin_sink_prometheusnumops |
Number of Prometheus sink operations |
count |
hadoop_admin_sink_prometheusqsize |
Queue size of Prometheus sinks |
count |
hadoop_admin_snapshotavgtime |
Average time spent on snapshot operations |
count |
hadoop_admin_snapshotnumops |
Number of snapshot operations |
count |
hadoop_admin_systemloadavg |
System load average |
count |
hadoop_admin_threadsblocked |
Number of blocked threads |
count |
hadoop_admin_threadsbusy |
Number of busy threads |
count |
hadoop_admin_threadsremaining |
Number of remaining threads |
count |
hadoop_admin_threadswaiting |
Number of waiting threads |
count |
hadoop_admin_usercount |
Total number of users |
count |
hadoop_admin_systemloadavg |
System load average |
count |
hadoop_admin_usercountsysadmin |
Number of system administrator users |
count |
hadoop_admin_usercountuser |
Number of regular users |
count |