Sparksession

Jan 23, 2026 Engineering

Spark Scala - SparkSession Configuration

Before Spark 2.0, developers juggled multiple entry points: SparkContext for core RDD operations, SQLContext for DataFrames, and HiveContext for Hive integration. This fragmentation created confusion…

Jan 10, 2025 Data Engineering

Apache Spark - SparkContext vs SparkSession

Before Spark 2.0, developers needed to create multiple contexts depending on their use case. You’d initialize a SparkContext for core RDD operations, a SQLContext for DataFrame operations, and a…