Monitoring Near Real-Time Performance
Pepperdata provides the same performance monitoring capabilities as standard Linux performance commands, along with detailed data visualizations. The cluster environment—YARN or Kubernetes—determines which performance statistics are exposed.
Performance Statistics: YARN Clusters
The table shows which Linux commands correspond to which Pepperdata metrics.
| Linux Command | Pepperdata Metrics Group |
|
Task: I/O Stat group, Local FS stats group Node: Disk Stat group |
|
Task: Memory group Node: Memory group For related information, see Memory Swapping Detection and Mitigation in the Pepperdata Supervisor. |
|
Task: CPU resource group Node: CPU usage group, Load average group |
|
Task: Socket stat group Node: Network stat group, Network TCP stat group |
| (no equivalent Linux command) | Task: Resource prioritization group, HDFS stats group, Shuffle stats
group, Task JVM Node: Dynamic allocation group |
Performance Statistics: Kubernetes Clusters
For Kubernetes clusters, Pepperdata gathers the performance metrics that are exposed by Prometheus, which differ based on the operating system. For detailed collector support information, refer to the Prometheus GitHub site .