[info] echo: AB: 889614 | YX: 43 | ZY: 889571
[info] Executing: |store | javascript{storedVars.BLA.replace('AB: ','')} | BLA2 |
[info] Executing: |store | javascript{storedVars.BLA2.replace(' |-','')} | BLA3 |
[info] Executing: |echo | ${BLA3} | |
[info] echo: 889614 | YX: 43 | ZY: 889571
How to can in Selenium IDE - HTML replace the text to the right side?
I like get only the first number in a variable.
Can someone show me an example of how to do this?
you want to split the sentence and store only numeric value. use below code
<tr>
<td>store</td>
<td>AB: 889614 | YX: 43 | ZY: 889571</td>
<td>num1</td>
</tr>
<tr>
<td>store</td>
<td>1</td>
<td>dim</td>
</tr>
<tr>
<td>store</td>
<td>javascript{storedVars['num1'].split('AB:')[storedVars['dim']]}</td>
<td>num2</td>
</tr>
<tr>
<td>store</td>
<td>0</td>
<td>dim1</td>
</tr>
<tr>
<td>store</td>
<td>javascript{storedVars['num2'].split('| ')[storedVars['dim1']]}</td>
<td>num3</td>
</tr>
<tr>
<td>echo</td>
<td>${num3}</td>
<td></td>
</tr>
<tr>
<td>store</td>
<td>1</td>
<td>dim2</td>
</tr>
<tr>
<td>store</td>
<td>javascript{storedVars['num1'].split('YX:')[storedVars['dim2']]}</td>
<td>num4</td>
</tr>
<tr>
<td>echo</td>
<td>${num4}</td>
<td></td>
</tr>
<tr>
<td>store</td>
<td>0</td>
<td>dim3</td>
</tr>
<tr>
<td>store</td>
<td>javascript{storedVars['num4'].split('| ')[storedVars['dim3']]}</td>
<td>num5</td>
</tr>
<tr>
<td>echo</td>
<td>${num5}</td>
<td></td>
</tr>
<tr>
<td>store</td>
<td>1</td>
<td>dim4</td>
</tr>
<tr>
<td>store</td>
<td>javascript{storedVars['num1'].split('ZY:')[storedVars['dim4']]}</td>
<td>num6</td>
</tr>
<tr>
<td>echo</td>
<td>${num6}</td>
<td></td>
</tr>
Execution of above command in selenium ide
[info] Executing: |store | AB: 889614 | YX: 43 | ZY: 889571 | num1 |
[info] Executing: |store | 1 | dim |
[info] Executing: |store | javascript{storedVars['num1'].split('AB:')[storedVars['dim']]} | num2 |
[info] Executing: |store | 0 | dim1 |
[info] Executing: |store | javascript{storedVars['num2'].split('| ')[storedVars['dim1']]} | num3 |
[info] Executing: |echo | ${num3} | |
[info] echo: 889614
[info] Executing: |store | 1 | dim2 |
[info] Executing: |store | javascript{storedVars['num1'].split('YX:')[storedVars['dim2']]} | num4 |
[info] Executing: |echo | ${num4} | |
[info] echo: 43 | ZY: 889571
[info] Executing: |store | 0 | dim3 |
[info] Executing: |store | javascript{storedVars['num4'].split('| ')[storedVars['dim3']]} | num5 |
[info] Executing: |echo | ${num5} | |
[info] echo: 43
[info] Executing: |store | 1 | dim4 |
[info] Executing: |store | javascript{storedVars['num1'].split('ZY:')[storedVars['dim4']]} | num6 |
[info] Executing: |echo | ${num6} | |
[info] echo: 889571
So if you are looking for 889614 from
AB: 889614 | YX: 43 | ZY: 889571
Then you can try below solution -
store | AB: 889614 | YX: 43 | ZY: 889571 | var1
store | 1 | delimiter
store | javascript{storedVars['var1'].split('AB:')[storedVars['delimiter']]} | var2
store | 0 | delimiter1
store | javascript{storedVars['var2'].split('| ')[storedVars['delimiter1']]} |variable
echo | ${variable}
Related
I'm working on a rather big project. I need to use azure-security-keyvault-secrets, so I added following to my pom.xml file:
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-security-keyvault-secrets</artifactId>
<version>4.0.1</version>
</dependency>
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-identity</artifactId>
<version>1.0.1</version>
</dependency>
When I run this sample code:
object Test {
def main(args: Array[String]): Unit = {
// get vault name from system env -> databricks
val secretClient = new SecretClientBuilder()
.vaultUrl("https://myVault.vault.azure.net/")
.credential(new DefaultAzureCredentialBuilder().build())
.buildClient
val secret = secretClient.getSecret("AzureAccountName")
println("===================== " + secret.getValue)
}
}
I get following error:
java.lang.NoSuchMethodError: com.fasterxml.jackson.datatype.jsr310.deser.JSR310DateTimeDeserializerBase.findFormatOverrides(Lcom/fasterxml/jackson/databind/DeserializationContext;Lcom/fasterxml/jackson/databind/BeanProperty;Ljava/lang/Class;)Lcom/fasterxml/jackson/annotation/JsonFormat$Value;
at com.fasterxml.jackson.datatype.jsr310.deser.JSR310DateTimeDeserializerBase.createContextual(JSR310DateTimeDeserializerBase.java:79)
at com.fasterxml.jackson.datatype.jsr310.deser.InstantDeserializer.createContextual(InstantDeserializer.java:241)
at com.fasterxml.jackson.databind.DeserializationContext.handleSecondaryContextualization(DeserializationContext.java:669)
at com.fasterxml.jackson.databind.DeserializationContext.findContextualValueDeserializer(DeserializationContext.java:430)
at com.fasterxml.jackson.databind.deser.std.StdDeserializer.findDeserializer(StdDeserializer.java:947)
at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.resolve(BeanDeserializerBase.java:439)
at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCache2(DeserializerCache.java:296)
at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCacheValueDeserializer(DeserializerCache.java:244)
at com.fasterxml.jackson.databind.deser.DeserializerCache.findValueDeserializer(DeserializerCache.java:142)
at com.fasterxml.jackson.databind.DeserializationContext.findContextualValueDeserializer(DeserializationContext.java:428)
at com.fasterxml.jackson.databind.deser.std.StdDeserializer.findDeserializer(StdDeserializer.java:947)
at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.resolve(BeanDeserializerBase.java:439)
at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCache2(DeserializerCache.java:296)
at com.fasterxml.jackson.databind.deser.DeserializerCache._createAndCacheValueDeserializer(DeserializerCache.java:244)
at com.fasterxml.jackson.databind.deser.DeserializerCache.findValueDeserializer(DeserializerCache.java:142)
at com.fasterxml.jackson.databind.DeserializationContext.findRootValueDeserializer(DeserializationContext.java:461)
at com.fasterxml.jackson.databind.ObjectMapper._findRootDeserializer(ObjectMapper.java:3838)
at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3732)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2764)
at com.azure.core.util.serializer.JacksonAdapter.deserialize(JacksonAdapter.java:174)
After some intensive use of Google, it always came back to the same cause. There must be some inconsistency between my dependency versions. So probably some other dependency imports an other version of Jackson. But when I print the tree I don't see any mismatch:
- com.fasterxml.jackson.module:jackson-module-scala_2.11:jar:2.10.0:compile
+- com.fasterxml.jackson.core:jackson-core:jar:2.10.0:compile
+- com.fasterxml.jackson.core:jackson-annotations:jar:2.10.0:compile
\- com.fasterxml.jackson.core:jackson-databind:jar:2.10.0:compile
Full tree:
+- org.scalatest:scalatest_2.11:jar:3.0.1:compile
| +- org.scala-lang:scala-library:jar:2.11.12:compile
| +- org.scalactic:scalactic_2.11:jar:3.0.1:compile
| +- org.scala-lang:scala-reflect:jar:2.11.8:compile
| +- org.scala-lang.modules:scala-xml_2.11:jar:1.0.5:compile
| \- org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.4:compile
+- joda-time:joda-time:jar:2.9.4:compile
+- org.joda:joda-convert:jar:1.2:compile
+- org.apache.spark:spark-graphx_2.11:jar:2.4.3:provided
| +- org.apache.spark:spark-core_2.11:jar:2.4.3:compile
| | +- com.thoughtworks.paranamer:paranamer:jar:2.8:compile
| | +- org.apache.avro:avro:jar:1.8.2:compile
| | | +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
| | | \- org.tukaani:xz:jar:1.5:compile
| | +- org.apache.avro:avro-mapred:jar:hadoop2:1.8.2:compile
| | | \- org.apache.avro:avro-ipc:jar:1.8.2:compile
| | +- com.twitter:chill_2.11:jar:0.9.3:compile
| | | \- com.esotericsoftware:kryo-shaded:jar:4.0.2:compile
| | | \- com.esotericsoftware:minlog:jar:1.3.0:compile
| | +- com.twitter:chill-java:jar:0.9.3:compile
| | +- org.apache.hadoop:hadoop-client:jar:2.6.5:compile
| | | +- org.apache.hadoop:hadoop-hdfs:jar:2.6.5:compile
| | | | +- xerces:xercesImpl:jar:2.9.1:compile
| | | | | \- xml-apis:xml-apis:jar:1.3.04:compile
| | | | \- org.htrace:htrace-core:jar:3.0.4:compile
| | | +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.6.5:compile
| | | | +- org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.6.5:compile
| | | | | +- org.apache.hadoop:hadoop-yarn-client:jar:2.6.5:compile
| | | | | \- org.apache.hadoop:hadoop-yarn-server-common:jar:2.6.5:compile
| | | | \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.6.5:compile
| | | +- org.apache.hadoop:hadoop-yarn-api:jar:2.6.5:compile
| | | +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.6.5:compile
| | | | \- org.apache.hadoop:hadoop-yarn-common:jar:2.6.5:compile
| | | +- org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.6.5:compile
| | | \- org.apache.hadoop:hadoop-annotations:jar:2.6.5:compile
| | +- org.apache.spark:spark-launcher_2.11:jar:2.4.3:compile
| | +- org.apache.spark:spark-kvstore_2.11:jar:2.4.3:compile
| | | \- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:compile
| | +- org.apache.spark:spark-network-common_2.11:jar:2.4.3:compile
| | +- org.apache.spark:spark-network-shuffle_2.11:jar:2.4.3:compile
| | +- org.apache.spark:spark-unsafe_2.11:jar:2.4.3:compile
| | +- javax.activation:activation:jar:1.1.1:compile
| | +- org.apache.curator:curator-recipes:jar:2.6.0:compile
| | | \- org.apache.curator:curator-framework:jar:2.6.0:compile
| | +- org.apache.zookeeper:zookeeper:jar:3.4.6:compile
| | +- javax.servlet:javax.servlet-api:jar:3.1.0:compile
| | +- org.apache.commons:commons-math3:jar:3.4.1:compile
| | +- com.google.code.findbugs:jsr305:jar:1.3.9:compile
| | +- org.slf4j:jul-to-slf4j:jar:1.7.16:compile
| | +- org.slf4j:jcl-over-slf4j:jar:1.7.16:compile
| | +- com.ning:compress-lzf:jar:1.0.3:compile
| | +- org.lz4:lz4-java:jar:1.4.0:compile
| | +- com.github.luben:zstd-jni:jar:1.3.2-2:compile
| | +- org.roaringbitmap:RoaringBitmap:jar:0.7.45:compile
| | | \- org.roaringbitmap:shims:jar:0.7.45:compile
| | +- commons-net:commons-net:jar:3.1:compile
| | +- org.json4s:json4s-jackson_2.11:jar:3.5.3:compile
| | | \- org.json4s:json4s-core_2.11:jar:3.5.3:compile
| | | +- org.json4s:json4s-ast_2.11:jar:3.5.3:compile
| | | \- org.json4s:json4s-scalap_2.11:jar:3.5.3:compile
| | +- org.glassfish.jersey.core:jersey-client:jar:2.22.2:compile
| | | +- javax.ws.rs:javax.ws.rs-api:jar:2.0.1:compile
| | | +- org.glassfish.hk2:hk2-api:jar:2.4.0-b34:compile
| | | | +- org.glassfish.hk2:hk2-utils:jar:2.4.0-b34:compile
| | | | \- org.glassfish.hk2.external:aopalliance-repackaged:jar:2.4.0-b34:compile
| | | +- org.glassfish.hk2.external:javax.inject:jar:2.4.0-b34:compile
| | | \- org.glassfish.hk2:hk2-locator:jar:2.4.0-b34:compile
| | | \- org.javassist:javassist:jar:3.18.1-GA:compile
| | +- org.glassfish.jersey.core:jersey-common:jar:2.22.2:compile
| | | +- javax.annotation:javax.annotation-api:jar:1.2:compile
| | | +- org.glassfish.jersey.bundles.repackaged:jersey-guava:jar:2.22.2:compile
| | | \- org.glassfish.hk2:osgi-resource-locator:jar:1.0.1:compile
| | +- org.glassfish.jersey.core:jersey-server:jar:2.22.2:compile
| | | +- org.glassfish.jersey.media:jersey-media-jaxb:jar:2.22.2:compile
| | | \- javax.validation:validation-api:jar:1.1.0.Final:compile
| | +- org.glassfish.jersey.containers:jersey-container-servlet:jar:2.22.2:compile
| | +- org.glassfish.jersey.containers:jersey-container-servlet-core:jar:2.22.2:compile
| | +- io.netty:netty-all:jar:4.1.17.Final:compile
| | +- com.clearspring.analytics:stream:jar:2.7.0:compile
| | +- io.dropwizard.metrics:metrics-core:jar:3.1.5:compile
| | +- io.dropwizard.metrics:metrics-jvm:jar:3.1.5:compile
| | +- io.dropwizard.metrics:metrics-json:jar:3.1.5:compile
| | +- io.dropwizard.metrics:metrics-graphite:jar:3.1.5:compile
| | +- org.apache.ivy:ivy:jar:2.4.0:compile
| | +- oro:oro:jar:2.0.8:compile
| | +- net.razorvine:pyrolite:jar:4.13:compile
| | +- net.sf.py4j:py4j:jar:0.10.7:compile
| | \- org.apache.commons:commons-crypto:jar:1.0.0:compile
| +- org.apache.spark:spark-mllib-local_2.11:jar:2.4.3:provided
| | \- org.scalanlp:breeze_2.11:jar:0.13.2:provided
| | +- org.scalanlp:breeze-macros_2.11:jar:0.13.2:provided
| | +- net.sf.opencsv:opencsv:jar:2.3:provided
| | +- com.github.rwl:jtransforms:jar:2.4.0:provided
| | \- org.spire-math:spire_2.11:jar:0.13.0:provided
| | +- org.spire-math:spire-macros_2.11:jar:0.13.0:provided
| | \- org.typelevel:machinist_2.11:jar:0.6.1:provided
| +- org.apache.xbean:xbean-asm6-shaded:jar:4.8:compile
| +- com.github.fommil.netlib:core:jar:1.1.2:provided
| +- net.sourceforge.f2j:arpack_combined_all:jar:0.1:provided
| +- org.apache.spark:spark-tags_2.11:jar:2.4.3:compile
| \- org.spark-project.spark:unused:jar:1.0.0:compile
+- org.apache.commons:commons-csv:jar:1.5:compile
+- org.apache.commons:commons-lang3:jar:3.5:compile
+- be.bluecrux:bluecrux-lop-commons:jar:1.0.3-SNAPSHOT:compile
| +- org.apache.spark:spark-sql_2.11:jar:2.4.3:compile
| | +- com.univocity:univocity-parsers:jar:2.7.3:compile
| | +- org.apache.spark:spark-sketch_2.11:jar:2.4.3:compile
| | +- org.apache.spark:spark-catalyst_2.11:jar:2.4.3:compile
| | | +- org.codehaus.janino:janino:jar:3.0.9:compile
| | | +- org.codehaus.janino:commons-compiler:jar:3.0.9:compile
| | | \- org.antlr:antlr4-runtime:jar:4.7:compile
| | +- org.apache.orc:orc-core:jar:nohive:1.5.5:compile
| | | +- org.apache.orc:orc-shims:jar:1.5.5:compile
| | | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
| | | +- commons-lang:commons-lang:jar:2.6:compile
| | | \- io.airlift:aircompressor:jar:0.10:compile
| | +- org.apache.orc:orc-mapreduce:jar:nohive:1.5.5:compile
| | +- org.apache.parquet:parquet-column:jar:1.10.1:compile
| | | +- org.apache.parquet:parquet-common:jar:1.10.1:compile
| | | \- org.apache.parquet:parquet-encoding:jar:1.10.1:compile
| | +- org.apache.parquet:parquet-hadoop:jar:1.10.1:compile
| | | +- org.apache.parquet:parquet-format:jar:2.4.0:compile
| | | \- org.apache.parquet:parquet-jackson:jar:1.10.1:compile
| | \- org.apache.arrow:arrow-vector:jar:0.10.0:compile
| | +- org.apache.arrow:arrow-format:jar:0.10.0:compile
| | +- org.apache.arrow:arrow-memory:jar:0.10.0:compile
| | +- com.carrotsearch:hppc:jar:0.7.2:compile
| | \- com.vlkan:flatbuffers:jar:1.2.0-3f79e055:compile
| +- au.com.bytecode:opencsv:jar:2.4:compile
| +- mysql:mysql-connector-java:jar:6.0.6:compile
| +- com.typesafe:config:jar:1.2.1:compile
| +- com.github.scopt:scopt_2.11:jar:3.2.0:compile
| +- com.microsoft.azure:azure-storage:jar:8.6.0:compile
| +- org.apache.hadoop:hadoop-azure:jar:2.9.0:compile
| | +- org.apache.hadoop:hadoop-common:jar:2.9.0:compile
| | | +- commons-cli:commons-cli:jar:1.2:compile
| | | +- xmlenc:xmlenc:jar:0.52:compile
| | | +- commons-collections:commons-collections:jar:3.2.2:compile
| | | +- javax.servlet:servlet-api:jar:2.5:compile
| | | +- org.mortbay.jetty:jetty:jar:6.1.26:compile
| | | +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
| | | +- org.mortbay.jetty:jetty-sslengine:jar:6.1.26:compile
| | | +- javax.servlet.jsp:jsp-api:jar:2.1:runtime
| | | +- com.sun.jersey:jersey-json:jar:1.9:compile
| | | | +- org.codehaus.jettison:jettison:jar:1.1:compile
| | | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:compile
| | | | \- org.codehaus.jackson:jackson-xc:jar:1.8.3:compile
| | | +- log4j:log4j:jar:1.2.17:compile
| | | +- net.java.dev.jets3t:jets3t:jar:0.9.0:compile
| | | | \- com.jamesmurty.utils:java-xmlbuilder:jar:0.4:compile
| | | +- org.slf4j:slf4j-log4j12:jar:1.7.25:compile
| | | +- org.apache.hadoop:hadoop-auth:jar:2.9.0:compile
| | | | \- org.apache.directory.server:apacheds-kerberos-codec:jar:2.0.0-M15:compile
| | | | +- org.apache.directory.server:apacheds-i18n:jar:2.0.0-M15:compile
| | | | +- org.apache.directory.api:api-asn1-api:jar:1.0.0-M20:compile
| | | | \- org.apache.directory.api:api-util:jar:1.0.0-M20:compile
| | | +- com.jcraft:jsch:jar:0.1.54:compile
| | | +- org.apache.curator:curator-client:jar:2.7.1:compile
| | | +- org.apache.htrace:htrace-core4:jar:4.1.0-incubating:compile
| | | +- org.codehaus.woodstox:stax2-api:jar:3.1.4:compile
| | | \- com.fasterxml.woodstox:woodstox-core:jar:5.0.3:compile
| | \- com.google.guava:guava:jar:11.0.2:compile
| +- com.github.tototoshi:scala-csv_2.11:jar:1.3.5:compile
| \- org.mockito:mockito-inline:jar:2.27.0:compile
| \- org.mockito:mockito-core:jar:2.27.0:compile
| +- net.bytebuddy:byte-buddy:jar:1.9.10:compile
| +- net.bytebuddy:byte-buddy-agent:jar:1.9.10:compile
| \- org.objenesis:objenesis:jar:2.6:compile
+- org.apache.logging.log4j:log4j-slf4j-impl:jar:2.9.0:compile
| +- org.slf4j:slf4j-api:jar:1.7.25:compile
| +- org.apache.logging.log4j:log4j-api:jar:2.9.0:compile
| \- org.apache.logging.log4j:log4j-core:jar:2.9.0:runtime
+- com.chuusai:shapeless_2.11:jar:2.3.0:compile
| \- org.typelevel:macro-compat_2.11:jar:1.1.1:compile
+- com.microsoft.sqlserver:mssql-jdbc:jar:6.2.1.jre8:compile
+- neo4j-contrib:neo4j-spark-connector:jar:2.4.0-M6:compile
| +- org.neo4j.driver:neo4j-java-driver:jar:1.7.2:compile
| \- graphframes:graphframes:jar:0.7.0-spark2.4-s_2.11:compile
+- org.opencypher:spark-cypher:jar:0.2.1:compile
| +- org.opencypher:okapi-relational:jar:0.2.1:compile
| | \- org.opencypher:okapi-logical:jar:0.2.1:compile
| | \- org.opencypher:okapi-ir:jar:0.2.1:compile
| | \- org.atnos:eff_2.11:jar:5.0.0:compile
| +- org.opencypher:okapi-neo4j-io:jar:0.2.1:compile
| | \- org.opencypher:okapi-api:jar:0.2.1:compile
| | +- org.typelevel:cats-core_2.11:jar:1.0.1:compile
| | | +- org.typelevel:cats-macros_2.11:jar:1.0.1:compile
| | | \- org.typelevel:cats-kernel_2.11:jar:1.0.1:compile
| | +- org.opencypher:front-end-9.0:jar:9.0.20181030:compile
| | | +- org.opencypher:util-9.0:jar:9.0.20181030:compile
| | | +- org.opencypher:expressions-9.0:jar:9.0.20181030:compile
| | | +- org.opencypher:rewriting-9.0:jar:9.0.20181030:compile
| | | | \- org.opencypher:ast-9.0:jar:9.0.20181030:compile
| | | +- org.opencypher:parser-9.0:jar:9.0.20181030:compile
| | | \- org.scalacheck:scalacheck_2.11:jar:1.12.5:compile
| | | \- org.scala-sbt:test-interface:jar:1.0:compile
| | \- com.lihaoyi:upickle_2.11:jar:0.6.6:compile
| | \- com.lihaoyi:ujson_2.11:jar:0.6.6:compile
| +- org.opencypher:graph-ddl:jar:0.2.1:compile
| | +- org.opencypher:okapi-trees:jar:0.2.1:compile
| | \- com.lihaoyi:fastparse_2.11:jar:1.0.0:compile
| | +- com.lihaoyi:fastparse-utils_2.11:jar:1.0.0:compile
| | \- com.lihaoyi:sourcecode_2.11:jar:0.1.4:compile
| +- org.scala-lang:scala-compiler:jar:2.11.12:compile
| \- org.apache.logging.log4j:log4j-api-scala_2.11:jar:11.0:compile
+- org.neo4j.test:neo4j-harness:jar:3.5.6:test
| +- org.neo4j:neo4j:jar:3.5.6:test
| | +- org.neo4j:neo4j-lucene-index:jar:3.5.6:test
| | | +- org.apache.lucene:lucene-analyzers-common:jar:5.5.5:test
| | | +- org.apache.lucene:lucene-queryparser:jar:5.5.5:test
| | | \- org.apache.lucene:lucene-codecs:jar:5.5.5:test
| | +- org.neo4j:neo4j-fulltext-index:jar:3.5.6:test
| | +- org.neo4j:neo4j-graph-algo:jar:3.5.6:test
| | +- org.neo4j:neo4j-udc:jar:3.5.6:test
| | +- org.neo4j:neo4j-data-collector:jar:3.5.6:test
| | | +- org.neo4j:neo4j-parser-3.5:jar:3.5.6:test
| | | | +- org.neo4j:neo4j-ast-3.5:jar:3.5.6:test
| | | | \- org.neo4j:neo4j-expressions-3.5:jar:3.5.6:test
| | | \- org.neo4j:neo4j-rewriting-3.5:jar:3.5.6:test
| | +- org.neo4j:neo4j-cypher:jar:3.5.6:test
| | | +- org.neo4j:neo4j-graph-matching:jar:3.1.9:test
| | | +- org.neo4j:neo4j-codegen:jar:3.5.6:test
| | | | +- org.ow2.asm:asm:jar:6.2:compile
| | | | +- org.ow2.asm:asm-util:jar:6.2:test
| | | | +- org.ow2.asm:asm-analysis:jar:6.2:test
| | | | \- org.ow2.asm:asm-tree:jar:6.2:test
| | | +- org.neo4j:neo4j-cypher-compiler-2.3:jar:2.3.12:test
| | | | +- org.neo4j:neo4j-cypher-frontend-2.3:jar:2.3.12:test
| | | | \- com.googlecode.concurrentlinkedhashmap:concurrentlinkedhashmap-lru:jar:1.4.2:test
| | | +- org.neo4j:neo4j-cypher-compiler-3.1:jar:3.1.9:test
| | | | +- org.neo4j:neo4j-cypher-frontend-3.1:jar:3.1.9:test
| | | | \- com.github.ben-manes.caffeine:caffeine:jar:2.3.3:test
| | | +- org.neo4j:neo4j-cypher-planner-3.4:jar:3.4.13:test
| | | | +- org.neo4j:openCypher-frontend-1:jar:3.4.13:test
| | | | | +- org.neo4j:neo4j-cypher-util-3.4:jar:3.4.13:test
| | | | | \- org.neo4j:neo4j-cypher-expression-3.4:jar:3.4.13:test
| | | | +- org.neo4j:neo4j-cypher-ir-3.4:jar:3.4.13:test
| | | | +- org.neo4j:neo4j-cypher-logical-plans-3.4:jar:3.4.13:test
| | | | \- org.neo4j:neo4j-cypher-planner-spi-3.4:jar:3.4.13:test
| | | +- org.neo4j:neo4j-legacy:jar:3.5.6:test
| | | +- org.neo4j:neo4j-util-3.5:jar:3.5.6:test
| | | +- org.neo4j:neo4j-cypher-planner-3.5:jar:3.5.6:test
| | | | +- org.neo4j:neo4j-cypher-ir-3.5:jar:3.5.6:test
| | | | | \- org.neo4j:neo4j-front-end-3.5:jar:3.5.6:test
| | | | \- org.neo4j:neo4j-cypher-logical-plans-3.5:jar:3.5.6:test
| | | +- org.neo4j:neo4j-cypher-planner-spi-3.5:jar:3.5.6:test
| | | +- org.neo4j:neo4j-cypher-runtime-util:jar:3.5.6:test
| | | +- org.neo4j:neo4j-cypher-interpreted-runtime:jar:3.5.6:test
| | | \- org.parboiled:parboiled-scala_2.11:jar:1.1.7:compile
| | | \- org.parboiled:parboiled-core:jar:1.1.7:compile
| | +- org.neo4j:neo4j-jmx:jar:3.5.6:test
| | +- org.neo4j:neo4j-bolt:jar:3.5.6:test
| | \- org.neo4j:neo4j-consistency-check:jar:3.5.6:test
| +- org.neo4j.app:neo4j-server:jar:3.5.6:test
| | +- org.neo4j:neo4j:pom:3.5.6:test
| | +- org.neo4j:neo4j-security:jar:3.5.6:test
| | +- org.neo4j:neo4j-dbms:jar:3.5.6:test
| | | +- org.neo4j:neo4j-import-tool:jar:3.5.6:test
| | | +- org.jprocesses:jProcesses:jar:1.6.4:test
| | | | \- com.profesorfalken:WMI4Java:jar:1.6.1:test
| | | | \- com.profesorfalken:jPowerShell:jar:1.9:test
| | | +- org.neo4j.licensing-proxy:zstd-proxy:jar:3.5.6:test
| | | \- jdk.tools:jdk.tools:jar:1.6:system
| | +- org.neo4j:neo4j-command-line:jar:3.5.6:test
| | | \- org.apache.commons:commons-text:jar:1.4:test
| | +- org.neo4j:server-api:jar:3.5.6:test
| | | \- org.neo4j.3rdparty.javax.ws.rs:jsr311-api:jar:1.1.2.r612:test
| | +- org.neo4j.client:neo4j-browser:jar:3.2.20:test
| | +- org.eclipse.jetty:jetty-server:jar:9.4.17.v20190418:test
| | | +- org.eclipse.jetty:jetty-http:jar:9.4.17.v20190418:test
| | | | \- org.eclipse.jetty:jetty-util:jar:9.4.17.v20190418:test
| | | \- org.eclipse.jetty:jetty-io:jar:9.4.17.v20190418:test
| | +- org.eclipse.jetty:jetty-webapp:jar:9.4.17.v20190418:test
| | | +- org.eclipse.jetty:jetty-xml:jar:9.4.17.v20190418:test
| | | \- org.eclipse.jetty:jetty-servlet:jar:9.4.17.v20190418:test
| | | \- org.eclipse.jetty:jetty-security:jar:9.4.17.v20190418:test
| | +- com.sun.jersey:jersey-server:jar:1.19.3:test
| | +- com.sun.jersey:jersey-servlet:jar:1.19.3:test
| | +- commons-configuration:commons-configuration:jar:1.10:compile
| | +- commons-io:commons-io:jar:2.6:test
| | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.13:compile
| | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
| | +- org.bouncycastle:bcprov-jdk15on:jar:1.60:test
| | +- org.bouncycastle:bcpkix-jdk15on:jar:1.60:test
| | +- org.glassfish.jaxb:jaxb-runtime:jar:2.3.0.1:test
| | | +- org.jvnet.staxex:stax-ex:jar:1.7.8:test
| | | \- com.sun.xml.fastinfoset:FastInfoset:jar:1.2.13:test
| | +- org.glassfish.jaxb:jaxb-core:jar:2.3.0.1:test
| | | +- org.glassfish.jaxb:txw2:jar:2.3.0.1:test
| | | \- com.sun.istack:istack-commons-runtime:jar:3.0.5:test
| | \- javax.xml.bind:jaxb-api:jar:2.3.0:test
| +- org.neo4j:neo4j-common:test-jar:tests:3.5.6:test
| +- org.neo4j:neo4j-kernel:test-jar:tests:3.5.6:test
| | +- org.neo4j:neo4j-annotation-processors:jar:3.5.6:test
| | +- org.neo4j:neo4j-graphdb-api:jar:3.5.6:test
| | | \- org.neo4j:neo4j-resource:jar:3.5.6:test
| | +- org.neo4j:neo4j-procedure-api:jar:3.5.6:test
| | +- org.neo4j:neo4j-kernel-api:jar:3.5.6:test
| | | \- org.neo4j:neo4j-diagnostics:jar:3.5.6:test
| | +- org.neo4j:neo4j-common:jar:3.5.6:test
| | +- org.neo4j:neo4j-values:jar:3.5.6:test
| | +- org.neo4j:neo4j-collections:jar:3.5.6:test
| | +- org.neo4j:neo4j-io:jar:3.5.6:test
| | +- org.neo4j:neo4j-csv:jar:3.5.6:test
| | +- org.neo4j:neo4j-logging:jar:3.5.6:test
| | +- org.neo4j:neo4j-lucene-upgrade:jar:3.5.6:test
| | +- org.apache.lucene:lucene-core:jar:5.5.5:test
| | +- org.neo4j:neo4j-configuration:jar:3.5.6:test
| | +- org.neo4j:neo4j-index:jar:3.5.6:test
| | +- org.neo4j:neo4j-spatial-index:jar:3.5.6:test
| | +- org.neo4j:neo4j-ssl:jar:3.5.6:test
| | \- org.eclipse.collections:eclipse-collections:jar:9.2.0:test
| | \- org.eclipse.collections:eclipse-collections-api:jar:9.2.0:test
| +- org.neo4j:neo4j-io:test-jar:tests:3.5.6:test
| | +- org.neo4j:neo4j-unsafe:jar:3.5.6:test
| | \- org.neo4j:neo4j-concurrent:jar:3.5.6:test
| +- com.sun.jersey:jersey-client:jar:1.19.3:test
| | \- com.sun.jersey:jersey-core:jar:1.19.3:test
| +- org.neo4j.app:neo4j-server:test-jar:tests:3.5.6:test
| +- commons-codec:commons-codec:jar:1.11:compile
| +- org.apache.httpcomponents:httpclient:jar:4.5.6:compile
| +- org.apache.httpcomponents:httpcore:jar:4.4.10:compile
| \- org.neo4j:neo4j-kernel:jar:3.5.6:test
+- com.azure:azure-security-keyvault-secrets:jar:4.0.1:compile
| +- com.azure:azure-core:jar:1.1.0:compile
| | +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.10.0:compile
| | +- com.fasterxml.jackson.dataformat:jackson-dataformat-xml:jar:2.10.0:compile
| | | \- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.10.0:compile
| | | +- jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2:compile
| | | \- jakarta.activation:jakarta.activation-api:jar:1.2.1:compile
| | +- io.projectreactor:reactor-core:jar:3.3.0.RELEASE:compile
| | | \- org.reactivestreams:reactive-streams:jar:1.0.3:compile
| | \- io.netty:netty-tcnative-boringssl-static:jar:2.0.26.Final:compile
| \- com.azure:azure-core-http-netty:jar:1.1.0:compile
| +- io.netty:netty-handler:jar:4.1.42.Final:compile
| | +- io.netty:netty-common:jar:4.1.42.Final:compile
| | +- io.netty:netty-transport:jar:4.1.42.Final:compile
| | | \- io.netty:netty-resolver:jar:4.1.42.Final:compile
| | \- io.netty:netty-codec:jar:4.1.42.Final:compile
| +- io.netty:netty-handler-proxy:jar:4.1.42.Final:compile
| | \- io.netty:netty-codec-socks:jar:4.1.42.Final:compile
| +- io.netty:netty-buffer:jar:4.1.42.Final:compile
| +- io.netty:netty-codec-http:jar:4.1.42.Final:compile
| +- io.netty:netty-codec-http2:jar:4.1.42.Final:compile
| +- io.netty:netty-transport-native-unix-common:jar:4.1.42.Final:compile
| +- io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.42.Final:compile
| \- io.projectreactor.netty:reactor-netty:jar:0.9.0.RELEASE:compile
| \- io.projectreactor.addons:reactor-pool:jar:0.1.0.RELEASE:compile
+- com.azure:azure-identity:jar:1.0.1:compile
| +- com.microsoft.azure:msal4j:jar:0.5.0-preview:compile
| | +- com.google.code.gson:gson:jar:2.8.5:compile
| | \- org.projectlombok:lombok:jar:1.18.6:compile
| +- com.nimbusds:oauth2-oidc-sdk:jar:6.14:compile
| | +- com.sun.mail:javax.mail:jar:1.6.1:compile
| | +- com.github.stephenc.jcip:jcip-annotations:jar:1.0-1:compile
| | +- net.minidev:json-smart:jar:2.3:compile (version selected from constraint [1.3.1,2.3])
| | | \- net.minidev:accessors-smart:jar:1.2:compile
| | +- com.nimbusds:lang-tag:jar:1.4.4:compile (version selected from constraint [1.4.3,))
| | \- com.nimbusds:nimbus-jose-jwt:jar:8.4:compile (version selected from constraint [6.0.1,))
| +- org.nanohttpd:nanohttpd:jar:2.3.1:compile
| \- net.java.dev.jna:jna-platform:jar:5.4.0:compile
| \- net.java.dev.jna:jna:jar:5.4.0:compile
+- com.fasterxml.jackson.module:jackson-module-scala_2.11:jar:2.10.0:compile
| +- com.fasterxml.jackson.core:jackson-core:jar:2.10.0:compile
| +- com.fasterxml.jackson.core:jackson-annotations:jar:2.10.0:compile
| +- com.fasterxml.jackson.core:jackson-databind:jar:2.10.0:compile
| \- com.fasterxml.jackson.module:jackson-module-paranamer:jar:2.10.0:compile
+- org.testcontainers:mssqlserver:jar:1.12.3:test
| \- org.testcontainers:jdbc:jar:1.12.3:test
| \- org.testcontainers:database-commons:jar:1.12.3:test
| \- org.testcontainers:testcontainers:jar:1.12.3:test
| +- junit:junit:jar:4.12:test
| | \- org.hamcrest:hamcrest-core:jar:1.3:test
| +- org.jetbrains:annotations:jar:17.0.0:test
| +- org.apache.commons:commons-compress:jar:1.19:test
| +- org.rnorth.duct-tape:duct-tape:jar:1.0.8:test
| +- org.rnorth.visible-assertions:visible-assertions:jar:2.1.2:test
| \- org.rnorth:tcp-unix-socket-proxy:jar:1.0.2:test
| +- com.kohlschutter.junixsocket:junixsocket-native-common:jar:2.0.4:test
| | \- org.scijava:native-lib-loader:jar:2.0.2:test
| \- com.kohlschutter.junixsocket:junixsocket-common:jar:2.0.4:test
\- com.zaxxer:HikariCP:jar:3.4.1:test
Can someone please tell me what I'm missing here ?
EDIT
I'm using Databricks Runtime 6.2. This runtime version uses jackson version 2.6.7 and azure-security-keyvault-secrets uses version 2.10.0.
I think this is conflicting and causes the error to occur. Is there maybe a possibility to ignore the jackson version in Databricks?
Use older version of JSR310
Below dependency worked for me
<!-- https://mvnrepository.com/artifact/com.fasterxml.jackson.datatype/jackson-datatype-jsr310 -->
<dependency>
<groupId>com.fasterxml.jackson.datatype</groupId>
<artifactId>jackson-datatype-jsr310</artifactId>
<version>2.7.9</version>
</dependency>
So I managed to fix the problem with the maven-shade-plugin. I added following piece of code to my pom.xml file:
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-shade-plugin</artifactId>
<version>3.2.1</version>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>META-INF/*.SF</exclude>
<exclude>META-INF/*.DSA</exclude>
<exclude>META-INF/*.RSA</exclude>
</excludes>
</filter>
</filters>
<shadedArtifactAttached>true</shadedArtifactAttached>
<relocations>
<relocation>
<pattern>com.fasterxml.jackson</pattern>
<shadedPattern>com.company-name.shaded.com.fasterxml.jackson</shadedPattern>
</relocation>
</relocations>
<transformers>
<transformer
implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer">
<mainClass>com.company-name.Test</mainClass>
</transformer>
</transformers>
<finalName>${project.artifactId}-${project.version}-shaded-jar-with-dependencies</finalName>
</configuration>
</execution>
</executions>
</plugin>
With this shaded-fat-jar I am able to use an higher version of jackson, which causes my code to run fine.
I can't make increment number of rows on my table..
I used revel framework, and try make simple crud.
The question is: "How to show increment number with Golang.?".
This my code of controller book.go
This controller to show data from postgresql database.
func allBooks() ([]models.Book, error) {
//Retrieve
books := []models.Book{}
rows, err := db.Query("SELECT id, name, author, pages, publication_date FROM books order by id")
defer rows.Close()
if err == nil {
for rows.Next() {
var id int
var name string
var author string
var pages int
var publicationDate pq.NullTime
err = rows.Scan(&id, &name, &author, &pages, &publicationDate)
if err == nil {
currentBook := models.Book{ID: id, Name: name, Author: author, Pages: pages}
if publicationDate.Valid {
currentBook.PublicationDate = publicationDate.Time
}
books = append(books, currentBook)
} else {
return books, err
}
}
} else {
return books, err
}
return books, err
}
And this html on my views index.html:
<table class="table table-striped">
<thead>
<tr>
<th>No</th>
<th>ID</th>
<th>Name</th>
<th>Author</th>
<th>Pages</th>
<th>Publication Date</th>
<th>Action</th>
</tr>
</thead>
<tbody>
{{range .books}}
<tr>
<td>{{.Nomor}}</td>
<td>{{.ID}}</td>
<td>{{.Name}}</td>
<td>{{.Author}}</td>
<td>{{.Pages}}</td>
<td>{{.PublicationDateStr}}</td>
</tr>
{{end}}
<tr>
<td></td>
<td></td>
<td></td>
<td></td>
<td></td>
<td>New book</td>
</tr>
</tbody>
</table>
hope result like this
|No.|ID |Name |Author | Pages | Publication Date |
|1 |2 |Jack |Holly | 255 | 2017-10-15 |
|2 |4 |hans |Holly | 255 | 2017-10-15 |
|3 |6 |Juri |Holly | 255 | 2017-10-15 |
|4 |7 |Hank |Holly | 255 | 2017-10-15 |
but what I get is
|No.|ID |Name |Author | Pages | Publication Date |
|0 |2 |Jack |Holly | 255 | 2017-10-15 |
|0 |4 |hans |Holly | 255 | 2017-10-15 |
|0 |6 |Juri |Holly | 255 | 2017-10-15 |
|0 |7 |Hank |Holly | 255 | 2017-10-15 |
I do not see the property Nomor populated anywhere.
You should keep a counter and do something like
...
currentBook := models.Book{Nomor: count, ID: id, Name: name, Author: author, Pages: pages}
count = count + 1
...
You could try assinging the values of slice index to a variable and try printing it, something like
{{range $index, _ := .books}}
and use the index instead of Nomor
I'm aware this question has been asked (and answered) numerous times, but the existing answers do not address my case.
I am trying to build the DataStax spark-cassandra-connector (tag v1.5.0-M3) as per this tutorial
./sbt/sbt assembly
but I get the following errors
java.lang.RuntimeException: deduplicate: different file contents found in the following:
/Users/me/.ivy2/cache/io.netty/netty/bundles/netty-3.8.0.Final.jar:META-INF/jboss-beans.xml
/Users/me/.ivy2/cache/org.jboss.netty/netty/bundles/netty-3.2.2.Final.jar:META-INF/jboss-beans.xml
at sbtassembly.Assembly$.sbtassembly$Assembly$$applyStrategy$1(Assembly.scala:106)
at sbtassembly.Assembly$$anonfun$13.apply(Assembly.scala:123)
at sbtassembly.Assembly$$anonfun$13.apply(Assembly.scala:120)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:105)
at sbtassembly.Assembly$.applyStrategies(Assembly.scala:125)
at sbtassembly.Assembly$.x$1$lzycompute$1(Assembly.scala:25)
at sbtassembly.Assembly$.x$1$1(Assembly.scala:23)
at sbtassembly.Assembly$.stratMapping$lzycompute$1(Assembly.scala:23)
at sbtassembly.Assembly$.stratMapping$1(Assembly.scala:23)
at sbtassembly.Assembly$.inputs$lzycompute$1(Assembly.scala:67)
at sbtassembly.Assembly$.inputs$1(Assembly.scala:57)
at sbtassembly.Assembly$.apply(Assembly.scala:83)
at sbtassembly.Assembly$$anonfun$assemblyTask$1.apply(Assembly.scala:226)
at sbtassembly.Assembly$$anonfun$assemblyTask$1.apply(Assembly.scala:223)
at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40)
at sbt.std.Transform$$anon$4.work(System.scala:63)
at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17)
at sbt.Execute.work(Execute.scala:235)
at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159)
at sbt.CompletionService$$anon$2.call(CompletionService.scala:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
java.lang.RuntimeException: deduplicate: different file contents found in the following:
/Users/me/.ivy2/cache/org.apache.spark/spark-network-common_2.10/jars/spark-network-common_2.10-1.5.1.jar:META-INF/maven/com.google.guava/guava/pom.properties
/Users/me/.ivy2/cache/com.google.guava/guava/bundles/guava-16.0.1.jar:META-INF/maven/com.google.guava/guava/pom.properties
at sbtassembly.Assembly$.sbtassembly$Assembly$$applyStrategy$1(Assembly.scala:106)
at sbtassembly.Assembly$$anonfun$13.apply(Assembly.scala:123)
at sbtassembly.Assembly$$anonfun$13.apply(Assembly.scala:120)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251)
at scala.collection.AbstractTraversable.flatMap(Traversable.scala:105)
at sbtassembly.Assembly$.applyStrategies(Assembly.scala:125)
at sbtassembly.Assembly$.x$1$lzycompute$1(Assembly.scala:25)
at sbtassembly.Assembly$.x$1$1(Assembly.scala:23)
at sbtassembly.Assembly$.stratMapping$lzycompute$1(Assembly.scala:23)
at sbtassembly.Assembly$.stratMapping$1(Assembly.scala:23)
at sbtassembly.Assembly$.inputs$lzycompute$1(Assembly.scala:67)
at sbtassembly.Assembly$.inputs$1(Assembly.scala:57)
at sbtassembly.Assembly$.apply(Assembly.scala:83)
at sbtassembly.Assembly$$anonfun$assemblyTask$1.apply(Assembly.scala:226)
at sbtassembly.Assembly$$anonfun$assemblyTask$1.apply(Assembly.scala:223)
at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40)
at sbt.std.Transform$$anon$4.work(System.scala:63)
at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17)
at sbt.Execute.work(Execute.scala:235)
at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159)
at sbt.CompletionService$$anon$2.call(CompletionService.scala:28)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[error] (spark-cassandra-connector-java/*:assembly) deduplicate: different file contents found in the following:
[error] /Users/me/.ivy2/cache/io.netty/netty/bundles/netty-3.8.0.Final.jar:META-INF/jboss-beans.xml
[error] /Users/me/.ivy2/cache/org.jboss.netty/netty/bundles/netty-3.2.2.Final.jar:META-INF/jboss-beans.xml
[error] (spark-cassandra-connector/*:assembly) deduplicate: different file contents found in the following:
[error] /Users/me/.ivy2/cache/org.apache.spark/spark-network-common_2.10/jars/spark-network-common_2.10-1.5.1.jar:META-INF/maven/com.google.guava/guava/pom.properties
[error] /Users/me/.ivy2/cache/com.google.guava/guava/bundles/guava-16.0.1.jar:META-INF/maven/com.google.guava/guava/pom.properties
[error] Total time: 44 s, completed 10-Dec-2015 16:22:01
Any of the suggested answers I have read (such as this one) refer to changes required in the build.sbt file, but in my case I have no such file. In the project directory I have
.
├── BuildUtil.scala
├── CassandraSparkBuild.scala
├── Publish.scala
├── Settings.scala
├── SparkInstaller.scala
├── Versions.scala
├── build.properties
├── plugins.sbt
├── project
└── target
2 directories, 8 files
So I don't know which file(s) to edit and what edits are necessary. I am on OSX and have the following versions installed
Spark 1.5.2
Java 1.8.0_45
Scala 2.11.7
sbt 0.13.9
UPDATE
If I follow the instruction here and build for Scala 2.11 I get the following prompt
$ sbt -Dscala-2.11=true
[info] Loading project definition from /usr/local/share/spark-cassandra-connector/project
[info] Updating {file:/usr/local/share/spark-cassandra-connector/project/}spark-cassandra-connector-build...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
Using releases: https://oss.sonatype.org/service/local/staging/deploy/maven2 for releases
Using snapshots: https://oss.sonatype.org/content/repositories/snapshots for snapshots
Scala: 2.11.7
Scala Binary: 2.11
Java: target=1.7 user=1.8.0_45
[info] Set current project to root (in build file:/usr/local/share/spark-cassandra-connector/)
SBT 39dcadbe40e833b610357ce84811201f03d8f350 root
Dependency Graph
Below is the result of using sbt-dependency-graph as per #AlexeyRomanovs suggestion
[info] default:project_2.10:0.1-SNAPSHOT [S]
[info] +-com.scalapenos:sbt-prompt:0.2.1
[info] | +-com.typesafe.sbt:sbt-git:0.6.4
[info] | +-org.eclipse.jgit:org.eclipse.jgit.pgm:3.3.2.201404171909-r
[info] | +-args4j:args4j:2.0.12
[info] | +-org.apache.commons:commons-compress:1.6
[info] | | +-org.tukaani:xz:1.4
[info] | |
[info] | +-org.eclipse.jgit:org.eclipse.jgit.archive:3.3.2.201404171909-r
[info] | | +-org.apache.commons:commons-compress:1.6
[info] | | | +-org.tukaani:xz:1.4
[info] | | |
[info] | | +-org.eclipse.jgit:org.eclipse.jgit:3.3.2.201404171909-r
[info] | | | +-com.googlecode.javaewah:JavaEWAH:0.7.9
[info] | | | +-com.jcraft:jsch:0.1.50
[info] | | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.8
[info] | | | | +-commons-logging:commons-logging:1.1.1
[info] | | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | | |
[info] | | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.8
[info] | | | +-commons-logging:commons-logging:1.1.1
[info] | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | |
[info] | | +-org.osgi:org.osgi.core:4.3.1
[info] | |
[info] | +-org.eclipse.jgit:org.eclipse.jgit.ui:3.3.2.201404171909-r
[info] | | +-org.eclipse.jgit:org.eclipse.jgit:3.3.2.201404171909-r
[info] | | +-com.googlecode.javaewah:JavaEWAH:0.7.9
[info] | | +-com.jcraft:jsch:0.1.50
[info] | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.8
[info] | | | +-commons-logging:commons-logging:1.1.1
[info] | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | |
[info] | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.8
[info] | | +-commons-logging:commons-logging:1.1.1
[info] | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | |
[info] | +-org.eclipse.jgit:org.eclipse.jgit:3.3.2.201404171909-r
[info] | +-com.googlecode.javaewah:JavaEWAH:0.7.9
[info] | +-com.jcraft:jsch:0.1.50
[info] | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.8
[info] | | +-commons-logging:commons-logging:1.1.1
[info] | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | |
[info] | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | +-commons-codec:commons-codec:1.8
[info] | +-commons-logging:commons-logging:1.1.1
[info] | +-org.apache.httpcomponents:httpcore:4.2.5
[info] |
[info] +-com.typesafe.sbt:sbt-git:0.6.4
[info] | +-org.eclipse.jgit:org.eclipse.jgit.pgm:3.3.2.201404171909-r
[info] | +-args4j:args4j:2.0.12
[info] | +-org.apache.commons:commons-compress:1.6
[info] | | +-org.tukaani:xz:1.4
[info] | |
[info] | +-org.eclipse.jgit:org.eclipse.jgit.archive:3.3.2.201404171909-r
[info] | | +-org.apache.commons:commons-compress:1.6
[info] | | | +-org.tukaani:xz:1.4
[info] | | |
[info] | | +-org.eclipse.jgit:org.eclipse.jgit:3.3.2.201404171909-r
[info] | | | +-com.googlecode.javaewah:JavaEWAH:0.7.9
[info] | | | +-com.jcraft:jsch:0.1.50
[info] | | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.8
[info] | | | | +-commons-logging:commons-logging:1.1.1
[info] | | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | | |
[info] | | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.8
[info] | | | +-commons-logging:commons-logging:1.1.1
[info] | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | |
[info] | | +-org.osgi:org.osgi.core:4.3.1
[info] | |
[info] | +-org.eclipse.jgit:org.eclipse.jgit.ui:3.3.2.201404171909-r
[info] | | +-org.eclipse.jgit:org.eclipse.jgit:3.3.2.201404171909-r
[info] | | +-com.googlecode.javaewah:JavaEWAH:0.7.9
[info] | | +-com.jcraft:jsch:0.1.50
[info] | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.8
[info] | | | +-commons-logging:commons-logging:1.1.1
[info] | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | |
[info] | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.8
[info] | | +-commons-logging:commons-logging:1.1.1
[info] | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | |
[info] | +-org.eclipse.jgit:org.eclipse.jgit:3.3.2.201404171909-r
[info] | +-com.googlecode.javaewah:JavaEWAH:0.7.9
[info] | +-com.jcraft:jsch:0.1.50
[info] | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.8
[info] | | +-commons-logging:commons-logging:1.1.1
[info] | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | |
[info] | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | +-commons-codec:commons-codec:1.8
[info] | +-commons-logging:commons-logging:1.1.1
[info] | +-org.apache.httpcomponents:httpcore:4.2.5
[info] |
[info] +-com.typesafe.sbt:sbt-scalariform:1.3.0
[info] | +-org.scalariform:scalariform_2.10:0.1.4 [S]
[info] |
[info] +-net.virtual-void:sbt-dependency-graph:0.8.0
[info] | +-com.github.mdr:ascii-graphs_2.10:0.0.3 [S]
[info] |
[info] +-org.scalastyle:scalastyle-sbt-plugin:0.6.0
[info] | +-org.scalastyle:scalastyle_2.10:0.6.0 [S]
[info] | +-com.danieltrinh:scalariform_2.10:0.1.5 [S]
[info] | +-com.typesafe:config:1.2.0
[info] |
[info] +-org.scoverage:sbt-scoverage:1.0.4
[info] | +-org.scoverage:scalac-scoverage-plugin_2.10:1.0.4 [S]
[info] |
[info] +-org.spark-packages:sbt-spark-package:0.2.3
[info] | +-com.eed3si9n:sbt-assembly:0.12.0
[info] | +-org.apache.directory.studio:org.apache.commons.codec:1.8
[info] | | +-commons-codec:commons-codec:1.8
[info] | |
[info] | +-org.scalaj:scalaj-http_2.10:1.1.4 [S]
[info] |
[info] +-org.typelevel:sbt-typelevel:0.3.1
[info] +-com.eed3si9n:sbt-buildinfo:0.3.2
[info] +-com.github.gseitz:sbt-release:0.8.4
[info] +-com.typesafe.sbt:sbt-pgp:0.8.2
[info] | +-com.jsuereth:gpg-library_2.10:0.8.2 [S]
[info] | | +-net.databinder:dispatch-http_2.10:0.8.10 [S]
[info] | | | +-net.databinder:dispatch-core_2.10:0.8.10 [S]
[info] | | | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | | | +-commons-codec:commons-codec:1.8
[info] | | | | | +-commons-logging:commons-logging:1.1.1
[info] | | | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | | | |
[info] | | | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.8
[info] | | | | +-commons-logging:commons-logging:1.1.1
[info] | | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | | |
[info] | | | +-net.databinder:dispatch-futures_2.10:0.8.10 [S]
[info] | | | | +-org.scala-lang:scala-actors:2.10.2 [S]
[info] | | | |
[info] | | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | | +-commons-codec:commons-codec:1.8
[info] | | | | +-commons-logging:commons-logging:1.1.1
[info] | | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | | |
[info] | | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.8
[info] | | | +-commons-logging:commons-logging:1.1.1
[info] | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | |
[info] | | +-org.bouncycastle:bcpg-jdk15on:1.49
[info] | | +-org.bouncycastle:bcprov-jdk15on:1.49
[info] | |
[info] | +-net.databinder:dispatch-http_2.10:0.8.10 [S]
[info] | +-net.databinder:dispatch-core_2.10:0.8.10 [S]
[info] | | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | | +-commons-codec:commons-codec:1.8
[info] | | | +-commons-logging:commons-logging:1.1.1
[info] | | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | | |
[info] | | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.8
[info] | | +-commons-logging:commons-logging:1.1.1
[info] | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | |
[info] | +-net.databinder:dispatch-futures_2.10:0.8.10 [S]
[info] | | +-org.scala-lang:scala-actors:2.10.2 [S]
[info] | |
[info] | +-org.apache.httpcomponents:httpclient:4.1.3 (evicted by: 4.2.6)
[info] | | +-commons-codec:commons-codec:1.4 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | | +-commons-codec:commons-codec:1.8
[info] | | +-commons-logging:commons-logging:1.1.1
[info] | | +-org.apache.httpcomponents:httpcore:4.1.4 (evicted by: 4.2.5)
[info] | | +-org.apache.httpcomponents:httpcore:4.2.5
[info] | |
[info] | +-org.apache.httpcomponents:httpclient:4.2.6
[info] | +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] | +-commons-codec:commons-codec:1.8
[info] | +-commons-logging:commons-logging:1.1.1
[info] | +-org.apache.httpcomponents:httpcore:4.2.5
[info] |
[info] +-com.typesafe:sbt-mima-plugin:0.1.6
[info] | +-com.typesafe:mima-reporter_2.10:0.1.6 [S]
[info] | +-com.typesafe:config:1.0.0 (evicted by: 1.2.0)
[info] | +-com.typesafe:config:1.2.0
[info] | +-com.typesafe:mima-core_2.10:0.1.6 [S]
[info] | | +-org.scala-lang:scala-compiler:2.10.2 [S]
[info] | | +-org.scala-lang:scala-reflect:2.10.2 [S]
[info] | |
[info] | +-org.scala-lang:scala-actors:2.10.2 [S]
[info] | +-org.scala-lang:scala-swing:2.10.2 [S]
[info] |
[info] +-net.virtual-void:sbt-dependency-graph:0.7.4 (evicted by: 0.8.0)
[info] +-net.virtual-void:sbt-dependency-graph:0.8.0
[info] | +-com.github.mdr:ascii-graphs_2.10:0.0.3 [S]
[info] |
[info] +-org.xerial.sbt:sbt-sonatype:0.2.1
[info] +-org.apache.httpcomponents:httpclient:4.2.6
[info] +-commons-codec:commons-codec:1.6 (evicted by: 1.8)
[info] +-commons-codec:commons-codec:1.8
[info] +-commons-logging:commons-logging:1.1.1
[info] +-org.apache.httpcomponents:httpcore:4.2.5
[info]
If you look at the SBT tutorial, you'll find that project/*.scala files are equivalent to *.sbt files in the root directory. So that's where you need to make the changes (specifically, in CassandraSparkBuild.scala).
The problem is that there are two versions of Netty in transitive dependencies and SBT doesn't notice this because the group IDs are different: org.jboss.netty for 3.2.2 and io.netty for 3.8. Find where they come from (using e.g. https://github.com/jrudolph/sbt-dependency-graph) and exclude the older version (and hope nothing breaks).
Basically I need to run a scalding job on EMR. The same job runs perfectly fine on local hadoop on my macbook, but fails on Hadoop on EMR.
I am trying hard to get help for this issue in the cascading-user and scala-user groups as well, and haven't been able to. So far I haven't made much progress after trying various changes in the past couple days.
Here is the error before I delve into the details:
Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
at com.aggregation.job.DataAggregation$.(DataAggregation.scala:30)
at com.aggregation.job.DataAggregation$.(DataAggregation.scala)
at com.aggregation.job.DataAggregation.main(DataAggregation.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
They said it might be a scala conflict with the binaries, but I couldn't see anything obvious. It would be great if someone could help with figuring it out.
Environment:
Amazon EMR AMI: 3.8.0 (which includes Scala 2.11.1, Hadoop 2.4.0, Java 1.7.0_76 - AMI details here)
Application environment: Scalding 0.15.0, Scala 2.11.1, Java 1.7.0_80, Hadoop 2.4.0
I have tried various changes to configuration and even manually installing a higher scala version in EMR, but so far the error is not going away.
Please help! Thank you.
L
Setup
build.sbt:
scalaVersion := "2.11.1"
ivyScala := ivyScala.value map {
_.copy(overrideScalaVersion = true)
}
dependencies.sbt:
import AssemblyKeys._
val hadoopVersion = "2.4.0"
val scaldingVersion = "0.15.0"
libraryDependencies ++= Seq(
"com.twitter" %% "scalding-core" % scaldingVersion,
"com.twitter" %% "scalding-json" % scaldingVersion,
"com.twitter" %% "scalding-jdbc" % scaldingVersion,
"com.github.nscala-time" %% "nscala-time" % "2.0.0",
"org.apache.hadoop" % "hadoop-common" % hadoopVersion % "provided",
"org.apache.hadoop" % "hadoop-mapreduce-client-core" % hadoopVersion % "provided"
)
excludedJars in assembly <<= (fullClasspath in assembly) map { cp =>
val excludes = Set(
"jsp-api-2.1-6.1.14.jar",
"jsp-2.1-6.1.14.jar",
"jasper-compiler-5.5.12.jar",
"minlog-1.2.jar", // Otherwise causes conflicts with Kyro (which bundles it)
"janino-2.5.16.jar", // Janino includes a broken signature, and is not needed anyway
"commons-beanutils-core-1.8.0.jar", // Clash with each other and with commons-collections
"commons-beanutils-1.7.0.jar", // "
"hadoop-core-1.2.1.jar", // Provided by Amazon EMR. Delete this line if you're not on EMR
"hadoop-tools-1.2.1.jar" // "
)
cp filter { jar => excludes(jar.data.getName) }
}
resolvers ++= Seq(
"Conjars repo" at "http://conjars.org/repo"
)
assembly.sbt
import AssemblyKeys._
assemblySettings
mergeStrategy in assembly := Merge.mergeStrategy
project/build.properties:
sbt.version=0.13.1
project/assembly.sbt:
addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.11.0")
Finally this is the dependency tree using the sbt-dependency-graph plugin to see if I've got the right versions. Sorry, it's quite long, if I should be displaying this info any other way, please recommend suggestions.
sbt dependency tree:
[info] com.abc.aggregator_2.11:0.1-20150628T184441 [S]
[info] +-com.github.nscala-time:nscala-time_2.11:2.0.0 [S]
[info] | +-joda-time:joda-time:2.7
[info] | +-org.joda:joda-convert:1.2
[info] |
[info] +-com.twitter:scalding-core_2.11:0.15.0 [S]
[info] | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-cascading:cascading-hadoop:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-cascading:cascading-local:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | | +-org.codehaus.janino:janino:2.7.5
[info] | | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | | |
[info] | | | +-riffle:riffle:0.1-dev
[info] | | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | | |
[info] | | +-com.google.guava:guava:14.0.1 (evicted by: 15.0)
[info] | | +-com.google.guava:guava:15.0
[info] | | +-org.slf4j:slf4j-api:1.6.6
[info] | | +-org.slf4j:slf4j-api:1.7.2 (evicted by: 1.6.6)
[info] | |
[info] | +-com.twitter:algebird-core_2.11:0.10.1 [S]
[info] | | +-com.googlecode.javaewah:JavaEWAH:0.6.6
[info] | |
[info] | +-com.twitter:bijection-core_2.11:0.8.0 [S]
[info] | +-com.twitter:chill-algebird_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:algebird-core_2.11:0.10.0 (evicted by: 0.10.1)
[info] | | +-com.twitter:algebird-core_2.11:0.10.1 [S]
[info] | | | +-com.googlecode.javaewah:JavaEWAH:0.6.6
[info] | | |
[info] | | +-com.twitter:chill_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:chill-hadoop:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-org.slf4j:slf4j-api:1.6.6
[info] | |
[info] | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:chill_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:maple:0.15.0
[info] | | +-cascading:cascading-hadoop:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-com.twitter:scalding-args_2.11:0.15.0 [S]
[info] | +-com.twitter:scalding-date_2.11:0.15.0 [S]
[info] | +-com.twitter:scalding-serialization_2.11:0.15.0 [S]
[info] | +-org.slf4j:slf4j-api:1.6.6
[info] |
[info] +-com.twitter:scalding-jdbc_2.11:0.15.0 [S]
[info] | +-cascading:cascading-jdbc-core:2.6.0
[info] | | +-com.google.guava:guava:15.0
[info] | |
[info] | +-cascading:cascading-jdbc-mysql:2.6.0
[info] | | +-cascading:cascading-jdbc-core:2.6.0
[info] | | | +-com.google.guava:guava:15.0
[info] | | |
[info] | | +-com.google.guava:guava:15.0
[info] | | +-mysql:mysql-connector-java:5.1.25
[info] | |
[info] | +-com.twitter:scalding-core_2.11:0.15.0 [S]
[info] | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-cascading:cascading-hadoop:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-cascading:cascading-local:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | | +-org.codehaus.janino:janino:2.7.5
[info] | | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | | |
[info] | | | +-riffle:riffle:0.1-dev
[info] | | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | | |
[info] | | +-com.google.guava:guava:14.0.1 (evicted by: 15.0)
[info] | | +-com.google.guava:guava:15.0
[info] | | +-org.slf4j:slf4j-api:1.6.6
[info] | | +-org.slf4j:slf4j-api:1.7.2 (evicted by: 1.6.6)
[info] | |
[info] | +-com.twitter:algebird-core_2.11:0.10.1 [S]
[info] | | +-com.googlecode.javaewah:JavaEWAH:0.6.6
[info] | |
[info] | +-com.twitter:bijection-core_2.11:0.8.0 [S]
[info] | +-com.twitter:chill-algebird_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:algebird-core_2.11:0.10.0 (evicted by: 0.10.1)
[info] | | +-com.twitter:algebird-core_2.11:0.10.1 [S]
[info] | | | +-com.googlecode.javaewah:JavaEWAH:0.6.6
[info] | | |
[info] | | +-com.twitter:chill_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:chill-hadoop:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-org.slf4j:slf4j-api:1.6.6
[info] | |
[info] | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:chill_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:maple:0.15.0
[info] | | +-cascading:cascading-hadoop:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-com.twitter:scalding-args_2.11:0.15.0 [S]
[info] | +-com.twitter:scalding-date_2.11:0.15.0 [S]
[info] | +-com.twitter:scalding-serialization_2.11:0.15.0 [S]
[info] | +-org.slf4j:slf4j-api:1.6.6
[info] |
[info] +-com.twitter:scalding-json_2.11:0.15.0 [S]
[info] +-com.fasterxml.jackson.module:jackson-module-scala_2.11:2.4.2 [S]
[info] | +-com.fasterxml.jackson.core:jackson-annotations:2.4.2
[info] | +-com.fasterxml.jackson.core:jackson-core:2.4.2
[info] | +-com.fasterxml.jackson.core:jackson-databind:2.4.2
[info] | | +-com.fasterxml.jackson.core:jackson-annotations:2.4.0 (evicted by: 2.4.2)
[info] | | +-com.fasterxml.jackson.core:jackson-annotations:2.4.2
[info] | | +-com.fasterxml.jackson.core:jackson-core:2.4.2
[info] | |
[info] | +-com.google.code.findbugs:jsr305:2.0.1
[info] | +-com.google.guava:guava:15.0
[info] | +-com.thoughtworks.paranamer:paranamer:2.6
[info] | +-org.scala-lang:scala-reflect:2.11.2 [S]
[info] |
[info] +-com.twitter:scalding-core_2.11:0.15.0 [S]
[info] | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-cascading:cascading-hadoop:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-cascading:cascading-local:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | | +-org.codehaus.janino:janino:2.7.5
[info] | | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | | |
[info] | | | +-riffle:riffle:0.1-dev
[info] | | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | | |
[info] | | +-com.google.guava:guava:14.0.1 (evicted by: 15.0)
[info] | | +-com.google.guava:guava:15.0
[info] | | +-org.slf4j:slf4j-api:1.6.6
[info] | | +-org.slf4j:slf4j-api:1.7.2 (evicted by: 1.6.6)
[info] | |
[info] | +-com.twitter:algebird-core_2.11:0.10.1 [S]
[info] | | +-com.googlecode.javaewah:JavaEWAH:0.6.6
[info] | |
[info] | +-com.twitter:bijection-core_2.11:0.8.0 [S]
[info] | +-com.twitter:chill-algebird_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:algebird-core_2.11:0.10.0 (evicted by: 0.10.1)
[info] | | +-com.twitter:algebird-core_2.11:0.10.1 [S]
[info] | | | +-com.googlecode.javaewah:JavaEWAH:0.6.6
[info] | | |
[info] | | +-com.twitter:chill_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:chill-hadoop:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-org.slf4j:slf4j-api:1.6.6
[info] | |
[info] | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:chill_2.11:0.6.0 [S]
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | | +-org.ow2.asm:asm:4.0
[info] | | | |
[info] | | | +-org.objenesis:objenesis:1.2
[info] | | |
[info] | | +-com.twitter:chill-java:0.6.0
[info] | | +-com.esotericsoftware.kryo:kryo:2.21
[info] | | +-com.esotericsoftware.minlog:minlog:1.2
[info] | | +-com.esotericsoftware.reflectasm:reflectasm:1.07
[info] | | | +-org.ow2.asm:asm:4.0
[info] | | |
[info] | | +-org.objenesis:objenesis:1.2
[info] | |
[info] | +-com.twitter:maple:0.15.0
[info] | | +-cascading:cascading-hadoop:2.6.1
[info] | | +-cascading:cascading-core:2.6.1
[info] | | +-org.codehaus.janino:janino:2.7.5
[info] | | | +-org.codehaus.janino:commons-compiler:2.7.5
[info] | | |
[info] | | +-riffle:riffle:0.1-dev
[info] | | +-thirdparty:jgrapht-jdk1.6:0.8.1
[info] | |
[info] | +-com.twitter:scalding-args_2.11:0.15.0 [S]
[info] | +-com.twitter:scalding-date_2.11:0.15.0 [S]
[info] | +-com.twitter:scalding-serialization_2.11:0.15.0 [S]
[info] | +-org.slf4j:slf4j-api:1.6.6
[info] |
[info] +-org.json4s:json4s-native_2.11:3.2.11 [S]
[info] +-org.json4s:json4s-core_2.11:3.2.11 [S]
[info] +-com.thoughtworks.paranamer:paranamer:2.6
[info] +-org.json4s:json4s-ast_2.11:3.2.11 [S]
[info] +-org.scala-lang:scalap:2.11.0
[info] +-org.scala-lang:scala-compiler:2.11.1 [S]
[info] +-org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1 [S]
[info] +-org.scala-lang.modules:scala-xml_2.11:1.0.2 [S]
[info] +-org.scala-lang:scala-reflect:2.11.1 (evicted by: 2.11.2)
[info] +-org.scala-lang:scala-reflect:2.11.2 [S]
[info]
[success] Total time: 12 s, completed Jun 28, 2015 11:44:54 AM
Further info as requested:
I build the fat jar using 'sbt assembly', and currently I'm using the AWS console with a "Custom JAR" step to test this out before automating the process.
JAR location: s3://path/to/jar/data-aggregator-0.1.jar
Arguments: com.abc.aggregation.job.DataAggregation --hdfs --input s3n://path/to/input/data/file.json --output s3n://path/to/input/data/file.txt
UPDATE:
I was able to get past the above error by providing the HADOOP_CLASSPATH pointing to the scala 2.11.1 jars, while excluding the same from the sbt assembly step. This was passed in using hadoop-user-env.sh and seemed to work for the master node. However once it got to the mapper step it once again failed with another Scala error. Now I am stuck on this step.
Assuming this is because the mappers and reducers aren't seeing the HADOOP_CLASSPATH update, I tried including the -libjars argument pointing to the scala jar files on hadoop master itself. But this (below) doesn't seem to be working.
JAR location: s3://path/to/jar/data-aggregator-0.1.jar
Arguments: com.abc.aggregation.job.DataAggregation -libjars /usr/share/scala/lib/scala-library.jar,/usr/share/scala/lib/scala-reflect.jar --hdfs --input s3n://path/to/input/data/file.json --output s3n://path/to/input/data/file.txt
Fixed. So it does happen that there were multiple scala jars in the EMR instances, and they weren't coming from my application jar.
The 2.10 jar was hiding in /usr/share/aws/emr/emrfs/lib apart from the installed location for the 2.11 binaries under /usr/share/scala. So I got rid of the 2.10 jar in all instances of the cluster, and my job completed successfully. Now I will create a bootstrap action for this.
$ sudo find / -name "scala-library-2.10.*.jar" -exec rm -rf {} \;
FYI, these are the paths it was present under:
[ec2-user#ip-172-31-72-130 ~]$ sudo find / -name "scala-library-2.11.*.jar"
/home/hadoop/.versions/hbase-0.94.18/lib/scala-library-2.11.0.jar
/usr/share/doc/scala/api/jars/scala-library-2.11.1-javadoc.jar
[ec2-user#ip-172-31-72-130 ~]$ sudo find / -name "scala-library-2.10.*.jar"
/usr/share/aws/emr/emrfs/lib/scala-library-2.10.5.jar
After struggling with a similar issue..... which is clearly a version mismatch between jar dependencies. I fixed it by first logging into the EMR master, then opening spark-shell reveals the exact scala version that is being used. Now take that to configure your own dependencies in the pom file and it should work.
SBT seems to be ignoring dependencies defined in pom.xml for multi-project builds:
object ApplicationBuild extends Build {
lazy val project = Project("root", file(".")).dependsOn(RootProject(riakJavaClient))
lazy val riakJavaClient = uri("git://github.com/basho/riak-java-client")
}
Output from dependency-graph:
[info] +-------------------+
[info] |my-project_2.10 [S]|
[info] | my-project |
[info] | 1.0 |
[info] +-------------------+
[info] | || |
[info] ----------------------------- || --------------------------------------
[info] | |--------------- |
[info] | ---------------| |
[info] v || |
[info] +---------------------------+ || |
[info] |unfiltered-scalate_2.10 [S]| || |
[info] | net.databinder | || |
[info] | 0.6.8 | || |
[info] +---------------------------+ || |
[info] | | | || |
[info] | | ---------------------------- || |
[info] | ----------------- | || |
[info] v | | || |
[info] +----------------------+ | | || |
[info] | scalate-core_2.10 | | | || |
[info] |org.fusesource.scalate| | | || |
[info] | 1.6.1 | | | || |
[info] +----------------------+ | | || |
[info] | | | | | || |
[info] | | ------ | | || |
[info] | --------- | | | || |
[info] v | | | v || v
[info] +------------------+ | | | +-------------------+ || +-----------------+
[info] |scala-compiler [S]| | | | |unfiltered_2.10 [S]| || |commons-validator|
[info] | org.scala-lang | | | | | net.databinder | || |commons-validator|
[info] | 2.10.0 | | | | | 0.6.8 | || | 1.4.0 |
[info] +------------------+ | | | +-------------------+ || +-----------------+
[info] | | ------------ | | | | | || | | |
[info] | | | | | | | --------- || ------------ | ------------
[info] | | | | | | ------------ | || | | |
[info] v | | v | v | | || v | |
[info] +-----------------+ | | +----------------------+ | +------------------------+ | | || +-----------------+ | |
[info] |scala-reflect [S]| | | |scalate-util_2.10 [S] | | |unfiltered-util_2.10 [S]| | | || |commons-beanutils| | |
[info] | org.scala-lang | | | |org.fusesource.scalate| | | net.databinder | | | || |commons-beanutils| | |
[info] | 2.10.0 | | | | 1.6.1 | | | 0.6.8 | | | || | 1.8.3 | | |
[info] +-----------------+ | | +----------------------+ | +------------------------+ | | || +-----------------+ | |
[info] | ----------- ---- | | | | | | || | | |
[info] | | | | | | | | | || ---------- | |
[info] | | ------------------ | | | | | || | | |
[info] | | | | ------------- | | | | || | | |
[info] | | | | | ------------- | | | || | | |
[info] | | | | | | ------------------------ | | || | | |
[info] | | | | | | | ---------------------------------- | || | | |
[info] | | | | | | | | -------------------------------|--| | | |
[info] | | | | | | | | | -------------------- | | | |
[info] | | | | | | | | | | | | | |
[info] v v v v v v v v v v v v v v
[info] +------------------+ +---------+ +------------------+ +-------------+ +-------------------------+ +---------------+ +----------------+
[info] | scala-library | |slf4j-api| | scala-library | |commons-codec| |riak-java-client_2.10 [S]| |commons-logging| |commons-digester|
[info] | org.scala-lang | |org.slf4j| | org.scala-lang | |commons-codec| | default | |commons-logging| |commons-digester|
[info] | 2.10.0 | | 1.6.1 | | 2.10.1 | | 1.4 | | 0.1-SNAPSHOT | | 1.1.1 | | 1.8 |
[info] |evicted by: 2.10.2| +---------+ |evicted by: 2.10.2| +-------------+ +-------------------------+ +---------------+ +----------------+
[info] +------------------+ +------------------+
[info] Note: The old tree layout is still available by using `dependency-tree`
The riak-java-client project should import all the libraries defined in its pom.xml, but is importing nothing.
RootProject and ProjectRef (just ProjectReference's in general) are to reference SBT projects so they fully resolvable and their dependencies handled properly (via appropriate Resolvers for file, svn, git and hg). It won't however work with non-SBT projects - under Maven, Ant, Gradle or similar. Just SBT ones.
You may want to give externalPom a try. I didn't, so can't comment on its use.