Hdfs

Apache Spark - Read/Write from HDFS

Spark reads from and writes to HDFS through Hadoop’s FileSystem API. When running on a Hadoop cluster with YARN or Mesos, Spark automatically detects HDFS configuration from core-site.xml and…