Action | Syntax |
show Dataframe | df.show() |
Stop Spark Session | spark.stop() |
Count entries in dataframe | df.count() |
Write to Delta table | df.write.format(“delta”).mode(“overwrite”).save(“/venv/storage”) |
Read from Delta Table | df = spark.read.format(“delta”).load(“/venv/storage”) |
Remove Duplicates | df = df.dropDuplicates() |
Categories: Apache SparkDelta Lake
0 Comments