By | August 1, 2015

Spark Installation – Spark installation in windows

Step 1 – Get the latest version of Spark from

http://spark-project.org/download

Step 2 – It is important to choose the version of Scala that matches the version requested by Spark.

http://scala-lang.org/download/

Step 3 – Download and extract the scala package

wget http://www.scala-lang.org/files/archive/scala-2.9.3.tgz

tar -zxvf scala-2.9.3.tgz

cd scala-2.9.3

export PATH=`pwd`/bin:$PATH

export SCALA_HOME=`pwd`

or add this in environment “.bashrc



Step 4 – Download appropriate spark version which will match with your Hadoop

Step 5 – Extract tar

tar -xvf spark-1.2.0.tgz

cd spark-1.2.0

Step 6 – Setup is ready, now lets run 1st example

./run spark.examples.GroupByTest local[4]

[ Local - in local mode 4 (four thread) ]

 

Share this knowledge ! Join us on Facebook ! Now Whatsapp sharing is supportable ! TooDey Inc.

Leave a Reply

Your email address will not be published. Required fields are marked *