So I used this to install a sample Flink project.
https://github.com/tillrohrmann/flink-project.g8
I am trying to use this template that lets me just start writing a Flink ingestion application and not have to worry about dependencies but it's backfiring. It turns out I can't find Flink when I try to sync with sbt (not going to lie but this part is even fuzzy for me). Was wondering if anyone knew how to make my project find Flink. Very excited to use the technology.
Error while importing sbt project:
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=384M; support was removed in 8.0
[info] Loading project definition from /Users/Sam/IdeaProjects/cryptoingestion/project
[info] Set current project to cryptoingestion (in build file:/Users/Sam/IdeaProjects/cryptoingestion/)
>
[info] Defining */*:sbtStructureOptions, */*:sbtStructureOutputFile, root/*:shellPrompt
[info] The new values will be used by no settings or tasks.
[info] Reapplying settings...
[info] Set current project to cryptoingestion (in build file:/Users/Sam/IdeaProjects/cryptoingestion/)
[info] Applying State transformations org.jetbrains.sbt.CreateTasks from /Users/Sam/Library/Application Support/IdeaIC2017.3/Scala/launcher/sbt-structure-0.13.jar
[info] Reapplying settings...
[info] Set current project to cryptoingestion (in build file:/Users/Sam/IdeaProjects/cryptoingestion/)
[info] Updating {file:/Users/Sam/IdeaProjects/cryptoingestion/}root...
[info] Resolving org.scala-lang#scala-library;2.12.2 ...
[info] Resolving org.apache.flink#flink-scala_2.12;1.3.2 ...
[info] Resolving org.apache.flink#flink-scala_2.12;1.3.2 ...
[warn] module not found: org.apache.flink#flink-scala_2.12;1.3.2
[warn] ==== local: tried
[warn] /Users/Sam/.ivy2/local/org.apache.flink/flink-scala_2.12/1.3.2/ivys/ivy.xml
[warn] ==== public: tried
[warn] https://repo1.maven.org/maven2/org/apache/flink/flink-scala_2.12/1.3.2/flink-scala_2.12-1.3.2.pom
[warn] ==== local-preloaded-ivy: tried
[warn] /Users/Sam/.sbt/preloaded/org.apache.flink/flink-scala_2.12/1.3.2/ivys/ivy.xml
[warn] ==== local-preloaded: tried
[warn] file:////Users/Sam/.sbt/preloaded/org/apache/flink/flink-scala_2.12/1.3.2/flink-scala_2.12-1.3.2.pom
[warn] ==== Apache Development Snapshot Repository: tried
[warn] https://repository.apache.org/content/repositories/snapshots/org/apache/flink/flink-scala_2.12/1.3.2/flink-scala_2.12-1.3.2.pom
[warn] ==== Maven2 Local: tried
[warn] file:/Users/Sam/.m2/repository/org/apache/flink/flink-scala_2.12/1.3.2/flink-scala_2.12-1.3.2.pom
[info] Resolving org.apache.flink#flink-streaming-scala_2.12;1.3.2 ...
[info] Resolving org.apache.flink#flink-streaming-scala_2.12;1.3.2 ...
[warn] module not found: org.apache.flink#flink-streaming-scala_2.12;1.3.2
[warn] ==== local: tried
[warn] /Users/Sam/.ivy2/local/org.apache.flink/flink-streaming-scala_2.12/1.3.2/ivys/ivy.xml
[warn] ==== public: tried
[warn] https://repo1.maven.org/maven2/org/apache/flink/flink-streaming-scala_2.12/1.3.2/flink-streaming-scala_2.12-1.3.2.pom
[warn] ==== local-preloaded-ivy: tried
[warn] /Users/Sam/.sbt/preloaded/org.apache.flink/flink-streaming-scala_2.12/1.3.2/ivys/ivy.xml
[warn] ==== local-preloaded: tried
[warn] file:////Users/Sam/.sbt/preloaded/org/apache/flink/flink-streaming-scala_2.12/1.3.2/flink-streaming-scala_2.12-1.3.2.pom
[warn] ==== Apache Development Snapshot Repository: tried
[warn] https://repository.apache.org/content/repositories/snapshots/org/apache/flink/flink-streaming-scala_2.12/1.3.2/flink-streaming-scala_2.12-1.3.2.pom
[warn] ==== Maven2 Local: tried
[warn] file:/Users/Sam/.m2/repository/org/apache/flink/flink-streaming-scala_2.12/1.3.2/flink-streaming-scala_2.12-1.3.2.pom
[info] Resolving org.scala-lang#scala-compiler;2.12.2 ...
[info] Resolving org.scala-lang#scala-reflect;2.12.2 ...
[info] Resolving org.scala-lang.modules#scala-xml_2.12;1.0.6 ...
[info] Resolving jline#jline;2.14.3 ...
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.apache.flink#flink-scala_2.12;1.3.2: not found
[warn] :: org.apache.flink#flink-streaming-scala_2.12;1.3.2: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] org.apache.flink:flink-scala_2.12:1.3.2 (/Users/Sam/IdeaProjects/cryptoingestion/build.sbt#L22)
[warn] +- com.cryptocorp:cryptoingestion_2.12:0.1
[warn] org.apache.flink:flink-streaming-scala_2.12:1.3.2 (/Users/Sam/IdeaProjects/cryptoingestion/build.sbt#L22)
[warn] +- com.cryptocorp:cryptoingestion_2.12:0.1
[trace] Stack trace suppressed: run 'last mainRunner/*:ssExtractDependencies' for the full output.
[trace] Stack trace suppressed: run 'last root/*:ssExtractDependencies' for the full output.
[trace] Stack trace suppressed: run 'last root/*:update' for the full output.
[error] (mainRunner/*:ssExtractDependencies) sbt.ResolveException: unresolved dependency: org.apache.flink#flink-scala_2.12;1.3.2: not found
[error] unresolved dependency: org.apache.flink#flink-streaming-scala_2.12;1.3.2: not found
[error] (root/*:ssExtractDependencies) sbt.ResolveException: unresolved dependency: org.apache.flink#flink-scala_2.12;1.3.2: not found
[error] unresolved dependency: org.apache.flink#flink-streaming-scala_2.12;1.3.2: not found
[error] (root/*:update) sbt.ResolveException: unresolved dependency: org.apache.flink#flink-scala_2.12;1.3.2: not found
[error] unresolved dependency: org.apache.flink#flink-streaming-scala_2.12;1.3.2: not found
[error] Total time: 2 s, completed Dec 5, 2017 12:51:24 AM
edit: I got the project to build but I can not click around in my IDE. By that I mean when I try to move into a Flink class it can not find declarations.
Flink Scala currently only supports Scala 2.10 and 2.11, so you have to downgrade your Scala to one of those releases or use its Java interface.
Related
I was trying to use universal recommender using predictionIO. I was using the template: template-scala-parallel-universal-recommendation.
I have imported the file and while building the engine, I am getting an error:
[INFO] [Engine$] [warn] module not found:
[INFO] [Engine$] [warn] ==== local: tried
[INFO] [Engine$] [warn] /home/neron/.ivy2/local/io.prediction/core_2.10/0.12.0-incubating/ivys/ivy.xml
[INFO] [Engine$] [warn] ==== public: tried
[INFO] [Engine$] [warn] https://repo1.maven.org/maven2/io/prediction/core_2.10/0.12.0-incubating/core_2.10-0.12.0-incubating.pom
and
[INFO] [Engine$] [warn] ::::::::::::::::::::::::::::::::::::::::::::::
[INFO] [Engine$] [warn] :: UNRESOLVED DEPENDENCIES ::
[INFO] [Engine$] [warn] ::::::::::::::::::::::::::::::::::::::::::::::
[INFO] [Engine$] [warn] :: org.apache.predictionio#apache predictionio-core_2.10_2.10;0.10.0-incubating: not found
[INFO] [Engine$] [warn] ::::::::::::::::::::::::::::::::::::::::::::::
[INFO] [Engine$] [warn]
[INFO] [Engine$] [warn] Note: Unresolved dependencies path:
[INFO] [Engine$] [warn] org.apache.predictionio:apache predictionio-core_2.10_2.10:0.10.0-incubating(/home/neron/Professional/PIO_Projects/template-scala-parallel-universal-recommendation/build.sbt#L9-31)
[error] (*:update) sbt.ResolveException: unresolved dependency: org.apache.predictionio#apache-predictionio-core_2.10_2.10;0.10.0-incubating: not found
[error] Total time: 6 s, completed 8 Dec, 2017 2:35:53 PM
In my .ivy2 folder, I have folders like:
/home/name/.ivy2/local/org.apache.predictionio/apache-predictionio-core_2.10/0.10.0-incubating/ivys/ivy.xml
instead of io.prediction/core/....
I tried changing the engine.sbt file with the path that I have, but still got the same error with the path I provided.
Is this because of any other error that I had done?
Replace io.predictionio with org.apache.predictionio in your complete template.
I'm trying to build the project play-angular2-typescript but it fails to build with the error:
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.webjars.npm#esprima;[3.1.0,3.2): not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn] Note: Unresolved dependencies path:
[warn] org.webjars.npm:esprima:[3.1.0,3.2)
[warn] +- org.webjars.npm:recast:[0.11.4,0.12)
[warn] +- org.webjars.npm:unreachable-branch-transform:[0.5.0,0.6)
[warn] +- org.webjars.npm:readable-stream:[2.0.5,3)
[warn] +- org.webjars.npm:got:[5.0.0,6)
[warn] +- org.webjars.npm:package-json:[2.0.0,3)
[warn] +- org.webjars.npm:latest-version:[2.0.0,3)
[warn] +- org.webjars.npm:update-notifier:[1.0.2,2)
[warn] +- org.webjars.npm:tslint:4.4.2
[warn] +- name.de-vries:sbt-tslint:4.4.2 (scalaVersion=2.10, sbtVersion=0.13) (/home/bravegag/code/play-angular2-typescript/project/plugins.sbt#L9-10)
[warn] +- default:play-angular2-typescript-build:0.1-SNAPSHOT (scalaVersion=2.10, sbtVersion=0.13)
sbt.ResolveException: unresolved dependency: org.webjars.npm#esprima;[3.1.0,3.2): not found
I searched everywhere and could not find these esprima versions in any repo online. I was able to find up to version 2.7.2 only. Therefore, I added the following line to the build.sbt file:
dependencyOverrides += "org.webjars.npm" % "esprima" % "2.7.2"
but the sbt built still fails with the same error. Is there a way to fix this?
UPDATE the answer leads to:
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] downloading https://repo1.maven.org/maven2/org/webjars/npm/esprima/3.1.3/esprima-3.1.3.jar ...
[info] [SUCCESSFUL ] org.webjars.npm#esprima;3.1.3!esprima.jar (214ms)
[info] Done updating.
Transitive dependencies for NPM and Bower WebJars are not automatically deployed so this one was missing. I went to add it but there was a bug with license detection. I've fixed it: https://github.com/webjars/webjars/issues/1569#issuecomment-285048591
Once that change is deployed I will deploy esprima 3.1.3.
In the future you can deploy your own NPM WebJars at: http://www.webjars.org/npm
I'm trying to set jboss-interceptor-api-1.1 as a dependency via sbt, but it can't be found. I've searched on Maven Repository and this version is there, can anyone help me?
Actually, I'm trying to use sbt-assembly. Removing the plugin dependency and adding the dependency to libraryDependencies still shows that error.
Stack trace:
[info] Resolving org.jboss.interceptor#jboss-interceptor-api;1.1 ...
[info] Resolving org.jboss.interceptor#jboss-interceptor-api;1.1 ...
[warn] problem while downloading module descriptor: https://repo1.maven.org/maven2/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom: invalid sha1: expected=453b712ff6cda3a3f10f46a9ab9b9a42fc9bc021 computed=56da14e5a3e7e5656fe2ed1942d9fc0c1f3b054b (122ms)
[warn] module not found: org.jboss.interceptor#jboss-interceptor-api;1.1
[warn] ==== typesafe-ivy-releases: tried
[warn] https://repo.typesafe.com/typesafe/ivy-releases/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== sbt-plugin-releases: tried
[warn] https://repo.scala-sbt.org/scalasbt/sbt-plugin-releases/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== local: tried
[warn] /Users/vicaba/.ivy2/local/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== public: tried
[warn] https://repo1.maven.org/maven2/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom
[warn] ==== activator-launcher-local: tried
[warn] /Users/vicaba/.activator/repository/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== activator-local: tried
[warn] /Applications/activator-dist-1.3.12/repository/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== typesafe-releases: tried
[warn] http://repo.typesafe.com/typesafe/releases/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom
[warn] ==== typesafe-ivy-releasez: tried
[warn] http://repo.typesafe.com/typesafe/ivy-releases/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[info] Resolving javax.annotation#jsr250-api;1.0 ...
[info] Resolving javax.inject#javax.inject;1 ...
[info] Resolving org.eclipse.sisu#org.eclipse.sisu.inject;0.3.0 ...
[info] Resolving org.codehaus.plexus#plexus-component-annotations;1.5.5 ...
[info] Resolving org.codehaus.plexus#plexus-classworlds;2.5.2 ...
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.jboss.interceptor#jboss-interceptor-api;1.1: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[info] Resolving com.typesafe.scala-logging#scala-logging_2.11;3.4.0 ...
[info] Resolving org.scala-lang#scala-library;2.11.8 ...
[info] Resolving org.slf4j#slf4j-api;1.7.21 ...
[info] Resolving ch.qos.logback#logback-core;1.1.7 ...
[info] Resolving ch.qos.logback#logback-classic;1.1.7 ...
[info] Resolving org.scala-lang#scala-reflect;2.11.8 ...
[info] Resolving org.scala-lang.modules#scala-parser-combinators_2.11;1.0.4 ...
[info] Resolving org.scala-lang#scala-compiler;2.11.8 ...
[info] Resolving org.scala-lang.modules#scala-xml_2.11;1.0.4 ...
[info] Resolving jline#jline;2.12.1 ...
[trace] Stack trace suppressed: run 'last *:updateSbtClassifiers' for the full output.
[error] (*:updateSbtClassifiers) sbt.ResolveException: unresolved dependency: org.jboss.interceptor#jboss-interceptor-api;1.1: not found
[error] Total time: 5 s, completed Feb 1, 2017 9:51:26 AM
LCartwright is correct that this is due to the SHA-1 hash file differring from the hash of the POM on maven central.
To get around this you can add the JBoss maven repository, where the hash matches, to your resolvers in the global sbt config ~/.sbt/0.13/global.sbt
resolvers += "JBoss" at "https://repository.jboss.org/"
I have the same issue in IntelliJ. When opening a project, it fails on jboss-interceptor-api. This is part of the log:
[info] Resolving org.apache.maven#maven-artifact;3.2.2 ...
[info] Resolving org.apache.maven#maven-plugin-api;3.2.2 ...
[info] Resolving org.eclipse.sisu#org.eclipse.sisu.plexus;0.0.0.M5 ...
[info] Resolving javax.enterprise#cdi-api;1.0 ...
[info] Resolving org.jboss.interceptor#jboss-interceptor-api;1.1 ...
[info] Resolving org.jboss.interceptor#jboss-interceptor-api;1.1 ...
[warn] problem while downloading module descriptor: https://repo1.maven.org/maven2/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom: invalid sha1: expected=453b712ff6cda3a3f10f46a9ab9b9a42fc9bc021 computed=56da14e5a3e7e5656fe2ed1942d9fc0c1f3b054b (108ms)
[warn] module not found: org.jboss.interceptor#jboss-interceptor-api;1.1
[warn] ==== typesafe-ivy-releases: tried
[warn] https://repo.typesafe.com/typesafe/ivy-releases/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== sbt-plugin-releases: tried
[warn] https://repo.scala-sbt.org/scalasbt/sbt-plugin-releases/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== local: tried
[warn] /Users/jessedobbelaere/.ivy2/local/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
[warn] ==== public: tried
[warn] https://repo1.maven.org/maven2/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom
[warn] ==== Typesafe repository: tried
[warn] http://repo.typesafe.com/typesafe/releases/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom
[warn] ==== bintray-kamon-io-sbt-plugins: tried
[warn] https://dl.bintray.com/kamon-io/sbt-plugins/org.jboss.interceptor/jboss-interceptor-api/1.1/ivys/ivy.xml
I noticed that when unchecking "Download Sources for SBT and plugins" in IntelliJ, everything works perfectly fine
Seems like the culprit is this line
[warn] problem while downloading module descriptor: https://repo1.maven.org/maven2/org/jboss/interceptor/jboss-interceptor-api/1.1/jboss-interceptor-api-1.1.pom: invalid sha1: expected=453b712ff6cda3a3f10f46a9ab9b9a42fc9bc021 computed=56da14e5a3e7e5656fe2ed1942d9fc0c1f3b054b (108ms)
reporting an incorrect SHA-1 for the pom file.
pom: jboss-interceptor-api-1.1.pom
pom SHA-1: jboss-interceptor-api-1.1.pom.sha1
The SHA-1 for the pom is 56da14e5a3e7e5656fe2ed1942d9fc0c1f3b054b however the accompanying pom.sha1 file is 453b712ff6cda3a3f10f46a9ab9b9a42fc9bc021
As suggested above, unchecking "Download Sources for SBT and plugins" will solve your issue for now. Not sure who to contact to update the pom.sha1
I met the same problems today and the plugin I used is sbt-native-packager. It also worked when I disable the option.
And later I go to the sbt github site and update my sbt plugin version from 1.0.0-RC1 to 1.2.0-M8 without disabling that option, I also worked. The plugin I used is
addSbtPlugin("com.typesafe.sbt" % "sbt-native-packager" % "1.2.0-M8")
Maybe you can go to https://github.com/sbt to search the lastest version.
After getting code from git using clone https://github.com/twitter/scalding.git and doing ./sbt update I get:
::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
And later:
sbt.ResolveException: unresolved dependency: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:213)
at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:122)
at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:121)
at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:116)
I have removed ~/.sbt directory, installed latest Scala and cloned repository anew. The problem remains.
My configuration:
[dk#localhost scalding]$ scala -version
Scala code runner version 2.10.3 -- Copyright 2002-2013, LAMP/EPFL
[dk#localhost scalding]$ uname -a
Linux localhost.localdomain 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
CentOS 6.5 (Final)
What can be possibly wrong with ./sbt update? Should I install the dependency hadoop-lzo separately and set CLASSPATH to install Scalding? Any other solutions?
Here is the complete installation log:
[dk#localhost wks]$ cd scalding
[dk#localhost scalding]$ ./sbt update
Downloading sbt launcher for 0.13.0:
From http://typesafe.artifactoryonline.com/typesafe/ivy-releases/org.scala-sbt/sbt-launch/0.13.0/sbt-launch.jar
To /home/dk/.sbt/launchers/0.13.0/sbt-launch.jar
Getting org.scala-sbt sbt 0.13.0 ...
:: retrieving :: org.scala-sbt#boot-app
confs: [default]
43 artifacts copied, 0 already retrieved (12440kB/229ms)
Getting Scala 2.10.2 (for sbt)...
:: retrieving :: org.scala-sbt#boot-scala
confs: [default]
5 artifacts copied, 0 already retrieved (24390kB/150ms)
[info] Loading project definition from /home/dk/wks/scalding/project
[info] Updating {file:/home/dk/wks/scalding/project/}scalding-build...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Compiling 3 Scala sources to /home/dk/wks/scalding/project/target/scala-2.10/sbt-0.13/classes...
[warn] there were 10 deprecation warning(s); re-run with -deprecation for details
[warn] there were 2 feature warning(s); re-run with -feature for details
[warn] two warnings found
[info] Set current project to scalding (in build file:/home/dk/wks/scalding/)
[info] Updating {file:/home/dk/wks/scalding/}scalding-args...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding-date...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}maple...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding-core...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding-json...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding-parquet...
[info] Resolving com.hadoop.gplcompression#hadoop-lzo;0.4.16 ...
[warn] module not found: com.hadoop.gplcompression#hadoop-lzo;0.4.16
[warn] ==== local: tried
[warn] /home/dk/.ivy2/local/com.hadoop.gplcompression/hadoop-lzo/0.4.16/ivys/ivy.xml
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== snapshots: tried
[warn] http://oss.sonatype.org/content/repositories/snapshots/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== releases: tried
[warn] http://oss.sonatype.org/content/repositories/releases/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== Concurrent Maven Repo: tried
[warn] http://conjars.org/repo/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== Clojars Repository: tried
[warn] http://clojars.org/repo/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== Twitter Maven: tried
[warn] http://maven.twttr.com/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[info] Updating {file:/home/dk/wks/scalding/}scalding-jdbc...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding-avro...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Updating {file:/home/dk/wks/scalding/}scalding-commons...
[info] Resolving com.hadoop.gplcompression#hadoop-lzo;0.4.16 ...
[warn] module not found: com.hadoop.gplcompression#hadoop-lzo;0.4.16
[warn] ==== local: tried
[warn] /home/dk/.ivy2/local/com.hadoop.gplcompression/hadoop-lzo/0.4.16/ivys/ivy.xml
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== snapshots: tried
[warn] http://oss.sonatype.org/content/repositories/snapshots/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== releases: tried
[warn] http://oss.sonatype.org/content/repositories/releases/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== Concurrent Maven Repo: tried
[warn] http://conjars.org/repo/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== Clojars Repository: tried
[warn] http://clojars.org/repo/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[warn] ==== Twitter Maven: tried
[warn] http://maven.twttr.com/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[info] Updating {file:/home/dk/wks/scalding/}scalding-repl...
[info] Resolving org.codehaus.jackson#jackson-core-asl;1.8.8 ...
[info] Done updating.
sbt.ResolveException: unresolved dependency: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:213)
at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:122)
at sbt.IvyActions$$anonfun$update$1.apply(IvyActions.scala:121)
at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:116)
at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:116)
at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:104)
at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:51)
at sbt.IvySbt$$anon$3.call(Ivy.scala:60)
at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:98)
at
....
.... many lines of exception stack-trace are skipped ...
....
[error] (scalding-commons/*:update) sbt.ResolveException: unresolved dependency: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
[error] (scalding-parquet/*:update) sbt.ResolveException: unresolved dependency: com.hadoop.gplcompression#hadoop-lzo;0.4.16: not found
[error] Total time: 53 s, completed Feb 14, 2014 4:51:51 PM
[dk#localhost scalding]$ ./sbt update^C
[dk#localhost scalding]$ uname -a
Linux localhost.localdomain 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
[dk#localhost scalding]$ scala -version
Scala code runner version 2.10.3 -- Copyright
SBT is unable to fetch com.hadoop.gplcompression#hadoop-lzo;0.4.16
from resolvers defined in your build.sbt
Adding maven.twttr.com:
"Twitter Maven Repo" at "http://maven.twttr.com"
should work.
I don't think that would work anymore, use: "https://maven.twttr.com" instead.
(Notice the https)
They changed it in Jan 2018
Hope it helps
Today I got a similar error but in lein.
I come through a lot of articles and Jira issue.
All recommend put https in URL and tag twitter repository directly.
But this does not help.
Does someone know another way?
list of checked sources.
https://stackoverflow.com/questions/21781028/unresolved-dependency-com-hadoop-gplcompressionhadoop-lzo0-4-16-when-sbt-upd
https://issues.apache.org/jira/browse/PARQUET-1556
I am trying to create a new Akka project in Eclipse. I followed the steps here
But I am receiving errors about Akka dependencies not being found.
Would appreciate your help. This is the output.
C:\Users\*\workspace\akka-project-in-scala>sbt
[info] Loading global plugins from C:\Users\*\.sbt\plugins
[info] Loading project definition from C:\Users\*\workspace\akka-project-in-scala\project
[info] Set current project to Akka Project In Scala (in build file:/C:/Users/*/workspace/akka-project-in-scala/)
> scala-version
[info] 2.10.1
> eclipse
[info] About to create Eclipse project files for your project(s).
Getting Scala 2.10.1 ...
downloading http://repo1.maven.org/maven2/org/scala-lang/scala-compiler/2.10.1/scala-compiler-2.10.1.jar ...
[SUCCESSFUL ] org.scala-lang#scala-compiler;2.10.1!scala-compiler.jar (45634ms)
downloading http://repo1.maven.org/maven2/org/scala-lang/scala-library/2.10.1/scala-library-2.10.1.jar ...
[SUCCESSFUL ] org.scala-lang#scala-library;2.10.1!scala-library.jar (21811ms)
downloading http://repo1.maven.org/maven2/org/scala-lang/scala-reflect/2.10.1/scala-reflect-2.10.1.jar ...
[SUCCESSFUL ] org.scala-lang#scala-reflect;2.10.1!scala-reflect.jar (10590ms)
downloading http://repo1.maven.org/maven2/org/scala-lang/jline/2.10.1/jline-2.10.1.jar ...
[SUCCESSFUL ] org.scala-lang#jline;2.10.1!jline.jar (1691ms)
:: retrieving :: org.scala-sbt#boot-scala
confs: [default]
5 artifacts copied, 0 already retrieved (24386kB/71ms)
[info] Updating {file:/C:/Users/*/workspace/akka-project-in-scala/}akka-project-in-scala...
[info] Resolving org.scala-lang#scala-library;2.10.1 ...
[info] Resolving com.typesafe.akka#akka-actor;2.1.2 ...
[warn] module not found: com.typesafe.akka#akka-actor;2.1.2
[warn] ==== local: tried
[warn] C:\Users\*\.ivy2\local\com.typesafe.akka\akka-actor\2.1.2\ivys\ivy.xml
[warn] ==== Typesafe Releases: tried
[warn] http://repo.typesafe.com/typesafe/releases/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.typesafe.akka#akka-actor;2.1.2: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[trace] Stack trace suppressed: run last *:update for the full output.
[error] (*:update) sbt.ResolveException: unresolved dependency: com.typesafe.akka#akka-actor;2.1.2: not found
[info] Updating {file:/C:/Users/*/workspace/akka-project-in-scala/}akka-project-in-scala...
[info] Resolving org.scala-lang#scala-library;2.10.1 ...
[info] Resolving com.typesafe.akka#akka-actor;2.1.2 ...
[warn] module not found: com.typesafe.akka#akka-actor;2.1.2
[warn] ==== local: tried
[warn] C:\Users\*\.ivy2\local\com.typesafe.akka\akka-actor\2.1.2\ivys\ivy.xml
[warn] ==== Typesafe Releases: tried
[warn] http://repo.typesafe.com/typesafe/releases/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.typesafe.akka#akka-actor;2.1.2: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[trace] Stack trace suppressed: run last *:update for the full output.
[error] (*:update) sbt.ResolveException: unresolved dependency: com.typesafe.akka#akka-actor;2.1.2: not found
[info] Updating {file:/C:/Users/*/workspace/akka-project-in-scala/}akka-project-in-scala...
[info] Resolving org.scala-lang#scala-library;2.10.1 ...
[info] Resolving com.typesafe.akka#akka-actor;2.1.2 ...
[warn] module not found: com.typesafe.akka#akka-actor;2.1.2
[warn] ==== local: tried
[warn] C:\Users\*\.ivy2\local\com.typesafe.akka\akka-actor\2.1.2\ivys\ivy.xml
[warn] ==== Typesafe Releases: tried
[warn] http://repo.typesafe.com/typesafe/releases/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.typesafe.akka#akka-actor;2.1.2: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[trace] Stack trace suppressed: run last *:update for the full output.
[error] (*:update) sbt.ResolveException: unresolved dependency: com.typesafe.akka#akka-actor;2.1.2: not found
[info] Updating {file:/C:/Users/*/workspace/akka-project-in-scala/}akka-project-in-scala...
[info] Resolving org.scala-lang#scala-library;2.10.1 ...
[info] Resolving com.typesafe.akka#akka-actor;2.1.2 ...
[warn] module not found: com.typesafe.akka#akka-actor;2.1.2
[warn] ==== local: tried
[warn] C:\Users\*\.ivy2\local\com.typesafe.akka\akka-actor\2.1.2\ivys\ivy.xml
[warn] ==== Typesafe Releases: tried
[warn] http://repo.typesafe.com/typesafe/releases/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.typesafe.akka#akka-actor;2.1.2: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[trace] Stack trace suppressed: run last *:update for the full output.
[error] (*:update) sbt.ResolveException: unresolved dependency: com.typesafe.akka#akka-actor;2.1.2: not found
[error] Could not create Eclipse project files:
[error] Error evaluating task 'external-dependency-classpath': error
[error] Error evaluating task 'update': error
[error] Error evaluating task 'external-dependency-classpath': error
[error] Error evaluating task 'update': error
>
So this does not work (404): http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.1.2/akka-actor-2.1.2.pom
But this does work: http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor_2.10/2.1.2/akka-actor_2.10-2.1.2.pom
Looking at the g8 template (line 16):
"com.typesafe.akka" % "akka-actor" % "$akka_version$",
I am guessing you need to edit your project/Build.scala so that it says:
"com.typesafe.akka" % "akka-actor_2.10" % "2.1.2",
Let me know if that works.