Kafka MirrorMaker2 Monitoring Guide
Complete guide to monitoring Kafka MirrorMaker2 replication performance, cross-cluster data synchronization, lag tracking, and disaster recovery readiness.
Essential MirrorMaker2 Metrics
Monitor these critical aspects of MirrorMaker2 for reliable cross-cluster replication.
Replication Lag
Track replication lag between source and target clusters for all mirrored topics.
Throughput Metrics
Monitor data transfer rates, message throughput, and bandwidth utilization.
Connector Health
Monitor connector status, task failures, and automatic restart behavior.
MirrorMaker2 Component Monitoring
Monitor each component of the MirrorMaker2 architecture for comprehensive visibility.
MirrorSourceConnector
Key Metrics
- • Source partition consumption rate
- • Topic discovery and filtering
- • Offset translation accuracy
- • Record transformation latency
Health Indicators
- • Connector task status
- • Consumer group lag
- • Rebalancing frequency
MirrorCheckpointConnector
Key Metrics
- • Checkpoint sync frequency
- • Consumer group offset mapping
- • Checkpoint topic health
- • Offset commit success rate
Health Indicators
- • Checkpoint lag monitoring
- • Consumer group discovery
- • Failover readiness
Performance Tuning & Optimization
Optimize MirrorMaker2 configuration for maximum throughput and minimal latency.
Configuration Tuning
Consumer Configuration
max.poll.records=1000
fetch.min.bytes=1024
fetch.max.wait.ms=500
session.timeout.ms=30000Producer Configuration
batch.size=32768
linger.ms=10
compression.type=lz4
acks=1Performance Alerts
- Replication lag exceeding threshold (5 minutes)
- Connector task failure or restart events
- Throughput degradation below baseline
- Source cluster connectivity issues
- Topic creation or deletion events
Disaster Recovery Readiness
Monitor disaster recovery capabilities and failover readiness across clusters.
Failover Testing
Automated failover testing and recovery time objective (RTO) validation.
Data Consistency
Monitor data consistency between source and target clusters for critical topics.
Recovery Validation
Validate consumer group offset synchronization and application readiness.
MirrorMaker2 Performance Dashboard
Real-time visibility into MirrorMaker2 replication performance and health status.
Replication Status
Throughput Metrics
Monitor MirrorMaker2 with KLogic
Get comprehensive MirrorMaker2 monitoring and ensure reliable cross-cluster data replication.