Spark compiles but unable to run a test program within Intellij? - scala

Question

Spark has compiled within Intellij via Maven. I am running one of the test suites. It does launch but fails at a basic scala library. What is going on?
Caused by: java.lang.ClassNotFoundException: scala.collection.GenTraversableOnce$class
Note that this is a maven project and the tests run successfully from the command line using mvn test.
Here is scala library info:
Here is the project definition:
Here is the module info showing the scala 2.11 dependency:
Here is the run configuration:
Here is the result of running:
UPDATE I was asked about the pom.xml. It is the pom.xml from spark for scala-2.11. https://github.com/apache/spark/blob/master/pom.xml
Here is the snippet
<profile>
<id>scala-2.11</id>
<activation>
<property><name>scala-2.11</name></property>
</activation>
<properties>
<scala.version>2.11.7</scala.version>
<scala.binary.version>2.11</scala.binary.version>
</properties>
</profile>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-compiler</artifactId>
<version>${scala.version}</version>
</dependency>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-reflect</artifactId>
<version>${scala.version}</version>
</dependency>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-library</artifactId>
<version>${scala.version}</version>
</dependency>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scala-actors</artifactId>
<version>${scala.version}</version>
</dependency>
<dependency>
<groupId>org.scala-lang</groupId>
<artifactId>scalap</artifactId>
<version>${scala.version}</version>
</dependency>

Answer 1

You need to make sure that Spark lib is on your class_path.
To build it run
build/mvn -DskipTests clean package
then include '/assembly/target/scala-$SCALA_VERSION/spark-assemblyhadoop-deps.jar' to your project.