One Line Command to Install PySpark Environment
Spark 3.0.0 released for a while, in TPC-DS 30TB benchmark, Spark 3.0 is roughly two times faster than Spark 2.4 and add Java 11 support. with the anaconda help, the PySpark environment installation becomes very easy, just one line command is enought. conda install -c conda-forge openjdk pyspark -y it …