1. Resolve problems faster and gain end-to-end visibility
across your Hadoop® environment
Splunk® App for HadoopOps
F a c t S h e e t
Enter Splunk
The Splunk App for HadoopOps meets this challenge with a
single interface to search, monitor and analyze the full Hadoop
environment including cluster resources beyond Hadoop itself,
such as the network, switch, rack, operating system and database.
The Splunk App provides end-to-end visibility and lets you
perform rapid troubleshooting and analysis across your Hadoop
environment. Search, monitor, alert, troubleshoot and analyze
Hadoop nodes, Hadoop distributed file systems (HDFS),
MapReduce jobs and more.
Features and Benefits
The Splunk App for HadoopOps provides a number of specialized
features that help you monitor Hadoop:
Monitor Nodes on Cluster – Get a complete view of all the servers
in the cluster. See the health of the cluster, track hard disk, CPU
and RAM utilization from a single view. Cluster visualization
display the rack or node where a specific failure might occur
Troubleshoot MapReduce Jobs – Gain real-time and historical
statistics on the individual and combined Map and Reduce tasks.
Troubleshoot MapReduce performance issues by comparing
similar jobs and comparing JobIDs to TaskIDs. Correlate between
the used core slots and MapReduce tasks and pinpoint the
MapReduce attempts that are using them.
Monitor Hadoop Services – Expose Hadoop metrics and view
the health of the Hadoop file system daemons. Monitor the key
load, capacity and resource metrics for enabling hardware and
software capacity planning.
Manage Services – Enable Hadoop administrators to establish
specific views of nodes so they can monitor only the nodes need
to see. For example, an administrator can choose to view only
the production nodes within a cluster
Challenge of Monitoring Hadoop Environments
Monitoring Hadoop deployments is a complex and time-consuming
function. Existing Hadoop monitoring tools are designed solely
to monitor the Hadoop environment—with a lack of visibility
into the network, switch, OS and other supporting infrastructure
administrators are faced with a significant visibility gap. Without
an end-to-end view, critical problems impacting the Hadoop
environment will often reoccur and remain unresolved.
• Real-time operational health and performance
monitoring of entire Hadoop environment
• Integrated alerting to track and respond to
activities from MapReduce to the individual node
in the cluster
• A centralized real-time view of Hadoop nodes
using an intuitive heat map display
H i g h l i g h t s
The Splunk App for HadoopOps delivers visibility and analysis across the entire
Hadoop ecosystem.
Centralized real-time view of Hadoop nodes using intuitive heat map display.