Accumulators

Apache Spark - Accumulators with Examples

When processing data across a distributed cluster, you often need to aggregate information back to a central location. Counting malformed records, tracking processing metrics, or summing values…