It is a Hadoop service offering hosted in Azure that enables clusters of managed hadoop instances. It deploys and provisions Apache Hadoop clusters in the cloud, providing a software framework designed to manage, analyze, and report on big data with high reliability and availability. HD Insight uses the Hortonworks Data Platform (HDP) Hadoop distribution.
How Azure HD Insight is used?
It is mainly used to deliver hadoop as a service on top of the Azure platform. Organizations can use HD Insight to:
- Create hadoop powered big data solution and services
- Manage and monitor hadoop clusters
- Analyze and report statistics on big data availability and utilization.
What to monitor in Azure HD Insight? / KPI of Azure HD Insight
- Disk Usage
- CPU Utilization
- Cluster Load
- Memory Utilization
- Network Utilization
- API / RPC / Calls