Load Multipe CSV files in PySpark

spark= SparkSession.builder \
.master(“local”) \
.appName(“Data Exploration”) \

#load data as Spark DataFrame
data2=spark.read.format(“csv”) \
.option(“header”,”true”) \
.option(“mode”,”DROPMALFORMED”) \

Captain Marvel the quick review

In a world where the internet is ruled by funny cats the cat is the sole redeeming feature.  Nearly all top actors are wasted in a movie which will make Wonder Woman seem like Casablanca.  Special effects are toonish and the direction is a set back for director. Almost all your money is redeemed in the two after credit scenes. One of which has a 🐱

%d bloggers like this: