My objective is to use Eclipse for coding Sparkling Water on Mac.
I have been able to install Java, Scala, Spark 2.2 with Brew install, Sparkling water as binaries and have been actively coding on Jupyter notebook. I have also been able to successfully install Eclipse, PyDev and configure it with Anaconda's Python interpreter.
What I have not been able to do is to configure Eclipse for either Spark or Sparkling water. The issue is two fold:
Brew install does not have .zip or .egg file that can be used as Python interpreter.
Brew does not create env variables in /Users//bash_profile folder. I suppose this can be solved by manually adding the env variable.
I am following directions from https://enahwe.wordpress.com/2015/11/25/how-to-configure-eclipse-for-developing-with-python-and-spark-on-hadoop/
Can someone please provide directions for configuring eclipse with brew installs?
Related
What is the most clean Eclpse distro to use for python development?
All distro comes with Java plugin and other stuffs.
I just want a clean Eclipse distro + pydev.
For a pre-configured environment, see http://www.liclipse.com (note it's commercial -- and has other niceties).
Aside from it, the option is getting the Platform Runtime Binary and follow the instructions from http://pydev.org/download.html and http://pydev.org/manual_101_root.html to install PyDev.
Newbie to scala.
Reading some descriptions of how to install a scala ecosystem has me confused. I will be installing on a apt-based linux system. My choice of editor/ide will be emacs ( though I might play with Eclipse and IntelliJ ).
Not a java programmer. I also like to do projects as different users for different purposes.
From what I understand the steps are:
Install sbt from the linux distro repo as root.
Install the newest sbt from the installed sbt as root.
Install the newest scala from sbt as root.
Install ensime from sbt as root.
( or do I install it from melpa? )
Also I heard of something called Scala Worksheet which might be useful. The version I heard of is a Eclipse plusin. Is there a version that can be used with emacs?
You can install ensime as normal user from MELPA without problems. Just read carefully the instructions in their web page. It is important to install the ensime SBT plugin in the user directory instead of the project plugin directory.
The ensime integration works way better that Eclipse's Scala IDE.
About the worskheet, it would be nice to have it in emacs but it is not really needed . You can work quite fine just with sbt.
I downloaded some notebook but when I try to ru it it prints messages about some libraries not being available, like pandas, pylab etc.
How to install those libraries? And what version of those libraries needs to be installed? I installed it manually, but it still not works, because it seems like it requires different versions.
Is there any automated way to install the proper dependencies for the notebook, with the right versions?
How to setup MySqlDb with PyDev (eclipse plug-in). I tried finding but no success.
Can anyone provide any tutorial kind of links for the same.
Using Ubuntu
My suggested approach would be
Create virtualenv where you install all packages for your project
Install MySQLdb in this virtual environment (or even better, use PyMySQL drop in replacement which has better installation instructions and no native dependencies making it easier to install)
In Eclipse project settings, point it to use Python interpreter and PYTHONPATH from virtualenv
In particular, I am trying to install kdev-control-flow-graph
I have managed to clone the source from git, cmake the source to build a kdevcontrolflowgraphview.so installed to /usr/local/lib, but when I restart kdevelop, I can find no sign of the plugin!
Under the Loaded Plugins window, it doesn't show up, and I can't seem to find a way to tell it about the existence of the new plug-in.
I am running KDevelop Version 4.2.3 using KDE Development Platform 4.7.2 on Ubuntu 11.10 64-bit.
Any help or suggestions would be greatly appreciated.
Make sure that "/usr/local/lib" is in your KDEDIRS var, and run "kbuildsyscocoa4 --noincremental"
If that doesn't work, perhaps the plugin's .desktop file needs to have its version modified.
Also note that you aren't running KDE Development Platform 4.7.2 because that doesn't exist (you probably mean KDE 4.7.2), you should be running KDevplatform 1.2.3.