PDI MongoDB Input and Output steps - mongodb

I recently installed PDI 8.2 CE - doesn't look like it comes with the Mongo input and output steps...
I found it here https://github.com/pentaho/pentaho-mongodb-plugin I unzipped that and put the entire folder in to the ../data-integration/plugins directory and restarted PDI but still no mongo input/output.
What am I doing wrong?

you do not need to add any additional plugins because it's under big data section you will find both input and output for mongodb.

Figured this out and it appears that PDI is very picky when it comes to which versions of JDK/JRE your running on your machine regardless of what you have set as the PENTAHO_JAVA_HOME.
Had to uninstall all of them, and then ensure that only OpenJDK 1.8 was installed.

Related

Windows MongoDB - Installed Compass but can't find Compass within system

I ran the MongoDB Community Version Download Setup with the GUI for Mongo -
Compass checked. No problems with the installation and the setup was successfully completed.
However after the setup I couldn't find Compass installed anywhere in my system.
Even the C:\Program Files\MongoDB\Server\3.6\bin didn't have a executable file or dll for compass.
What happened to Compass?
For some reason in Windows 10 it is installed into the hidden AppData directory. At least I found first a shortcut 'MongoDB Compass' here:
C:\Users\<username>\AppData\Roaming\Microsoft\Windows\Start Menu\Programs\MongoDB Inc
and then in the properties of it the actual location seems to be
C:\Users\<username>\AppData\Local\MongoDBCompass\MongoDBCompass.exe
I wound up downloading and installing Compass separately. It's available from the Download Center. You can select the version and OS there: Compass Download Options.
The installer lets you choose the destination directory. You can also add a Desktop shortcut in Windows.
Hope that helps!
Dave
I had an issue where MongoDB installer wouldn't work at all so I had to choose customize instead of the easy install. The location of the file for Compass should be in:
C:\Users\User_Name\AppData\Local\MongoDBCompassCommunity
as #Jonez said, mine is for the Community edition. Make sure you have your hidden files view enabled. On a side note, I encountered less problems when I used administrative capabilities.
I was having the same problem
Step 1: Make hidden folder visible
step 2: C:\Users\shankar\AppData\Local\MongoDBCompassCommunity
Step 3: Click on MongoDBCompassComunity edition
You will have compass gui open
Enjoy your Compass Community Edition
For me, the compass was not installing at all, but I was getting successful message like you.
I figured that there is InstallCompass.ps1 powershell script in the bin folder.
I opened powershell and got into bin folder and launched it
cd C:\Program Files\MongoDB\Server\4.4\bin
.\InstallCompass.ps1
...and voila! it downloaded and installed the compass appropriately using command line
I found exe in following paths:
C:\ProgramData\<your user id>\MongoDBCompass\MongoDBCompass.exe
C:\ProgramData\<your user id>\MongoDBCompass\app-1.11.1\MongoDBCompass.exe
After installing the Mongo DB Compass .msi Setup installer.
Go to C:\Program Files (x86)\MongoDB Compass Installer and run that setup.
Connect your DB.
I'm on windows 10 and can confirm compass even after checking install compass option during installation did not install. That wasn't surprising considering compass is 158 MB and mongo db download was very quick.
Actually, I got the same problem in windows 7 when I downloaded MongoDB Compass Zip file from https://www.mongodb.com/try/download/compass and run 'MongoDBCompass.exe'
Then I downloaded the .msi file instead of zip, installed the .msi file and 'MongoDB Compass' icon added in the start menu.
Click on the 'platform' option and select MSI.
I was having the same problem with the msi installer, I tried with the exe and it worked.
I also had the same issue. And I have found that, it occurred when try to install the mongo db more than one time.

QT: driver not loaded, but driver is present

EDIT #2
It works, the first time I installed postgres 64bit, while Qt uses MinGW 32 bit.
EDIT
Following the answer linked by zapredelom, I installed postgres 9 and added to PATH the bin and lib directories. To be sure, I also restarted the machine, but nothing changed. QT_DEBUG_PLUGINS=1 gives me no additional debug infos.
I get this error at runtime:
QSqlDatabase: QPSQL driver not loaded
QSqlDatabase: available drivers: QSQLITE QMYSQL QMYSQL3 QODBC QODBC3 QPSQL QPSQL7
As the error itself displays, postgres driver is already present. Indeed there's a qsqlpsql.dll and qsqlpsqld.dll under C:\Qt\5.8\mingw53_32\plugins\sqldrivers.
I have not built it and I have no Postgres installation on this machine (I test on my Linux OS and deploy on Windows 8.1 VM), the driver was already present after installing QT.
What's the problem?
The driver does not work because it does not find the dependency (it should be depends on libpq.dll), and when you run it, the plugin can not find the required dll. If you are using windows, just try to check using dependencywalker of the qsqlpsql.dll.
You can directly put your libpq.dll to your application exe folder.

pgadmin4 : postgresql application server could not be contacted.

I have installed PostgreSQL 9.6.2 on my Windows 8.1. But the pgadmin4 is not able to contact the local server. I have tried several solutions suggested here in stackoverflow, tried to uninstall and reinstall PostgreSQL 9.6.2 , tried to modify the config.py, config_distro.py, and delete the files in Roaming folder,i tried standalone pgadmin4 installation, but no success.However, in my local machine i am able to access the server using psql.exe and log as as superuser (postgres user). Can you please suggest any possible solutions to starting/running pgadmin4 ? Thank you.
I found the same issue when upgrading to pgAdmin 4 (v1.6). On Windows I found that clearing out the content inside C:\Users\%USERNAME%\AppData\Roaming\pgAdmin\sessions folder fixed the issue for me. I believe it was attempting to use the sessions from the prior version and was failing. I know the question was marked as answered, but downgrading may not always be an option.
Note: AppData\Roaming\pgAdmin is a hidden folder.
Start pgAdmin 4 as administrator.
Do the following steps:
Right click pgAdmin 4 icon
Select "Run As Administrator"
I had the same issue on Windows 10, with a new installation of PostgreSQL 10.
I solved it by including the path C:\PostgreSQL\10\bin ({your path to postgresql}\bin) to system environment variables.
To access environment variables: Control Panel > System and security > System or right click on PC, then > Advance system settings > Environment variables > System variables > Path > Edit.
I've been dealing with this for awhile (frustrating). So much that I have instructions on my desktop consolidating all of these ideas. Here is my magic combination to the solution:
Delete from App Data C:\Users\%USERNAME%\AppData\Roaming\pgAdmin
Add to Path Variables C:\Program Files\PostgreSQL\9.6\bin (I actually added it to both user and system)
Right click and start as admin.
You don't have to do this every time but when it gets out of wack try these steps.
What finally worked was downgrading to pgadminIII-v.1.22:
It seems in most of the cases Postgres trying to use information from previous sessions to find/connect the server and failing. Clearing out the previous session info helped me, it is a combination of 2 already mentioned answers above:
Navigate to Postgres session's folder
C:\Users\YourUsernameOrAdmin\AppData\Roaming\pgAdmin\sessions
Delete all the data from this folder.
Start PgAdmin in administrator mode.
Cheers!
if you are using Mac OS X here is a fix:
Open terminal and run this command
pg_ctl -D /usr/local/var/postgres -l /usr/local/var/postgres/server.log restart
and for other OS just restart your Postgresql server, it will solve
Then start pgAdmin4, it will start as normal
Share or comment if saved someone
Deleting the contents of C:\Users\%USERNAME%\AppData\Roaming\pgAdmin directory worked for me!
I had same issue on windows. I had v1.6 installed as well as v2.0. Uninstalling v1.6 allowed me to login.
I had the same problem, but running it as an admin worked.
Have you recently installed a new version of pgAdmin ?
This issue (and the misleading message) is simply due to the fact that old versions of pgAdmin are unable to read the settings saved by a newer version of pgAdmin !
Make sure you're starting the right version of pgAdmin (your shortcuts are likely to point to the old version !) and/or uninstall the old version: the upgrade wizard doesn't do it for you !
Deleting contents of folder C:\Users\User_Name\AppData\Roaming\pgAdmin\sessions helped me, I was able to start and load the pgAdmin server
I had the same issue on the macosx and I renamed .pgadmin (in /users/costa) to .pgadminx and I was able to start pgAdmin4.
In Windows Just go to this path and clear it
,that works !!
C:\Users\%USERNAME%\AppData\Roaming\pgAdmin
I was able to solve the problem by changing the pgAdmin web interface port.
I believe this problem occurred on my computer because I have several other services consuming webs ports like qBittorrent, IDEJetbrains, etc.
Right-clicking on the pgAdmin logo near the clock is possible to configure it.
I Fixed it in windows 10 just running pgAdmin 4 as Run as Administrator .
If you use older postgresql version like 9.x and its services is running,PgAdmin 4 confused which server is base database.
So stop the service older version or new one.Run PgAdmin 4 as Administrator
Its worked for me
This is often a firewall problem. The firewall log then shows dropped packets between 127.0.0.1: and 127.0.0.1:, where the latter is the port shown in the Browser to get no connection with. This means, that the connection between pgAdmin client (high_port_1) and pgAdmin server (high_port_2) is blocked. Check your firewall log and if you find dropped packets like described, adapt your firewall settings accordingly.
If none of the methods help try checking your system and user environments PATH and PYTHONPATH variables.
I was getting this error due to my PATH variable was pointing to different Python installation (which comes from ArcGIS Desktop).
After removing path to my Python installation from PATH variable and completely removing PYTHONPATH variable, I got it working!
Keep in mind that python command will not be available from command line if you remove it from PATH.
I use the cmd prompt on Windows 10 with psql postgres postgres.
Then I launch pgAdmin4 and it works.
I had this problem with pgadmin4 v2.1 on linux fedora 27
Solved by installing a missing dependency:
python3-flask-babelex
Just click on that pgadmin 4 icon and run as administrator. Allow the access permissions. It will start locally.
I need to add this here because I've had several issues with this message. If you have recently upgraded to High Sierra you will find the latest (pgadmin 4.20) will keep appearing with the message "Application Server Could Not be Contacted". What this actually means on Macs is that python was unable to configure your environment in ~/.pgadmin
This directory stores all the things you setup and configure and even logs of what was ran on your user copy usage of pgadmin.
The way to fix this issue on High Sierra is down to sqlite3. If you look in that directory you'll see everything is stored in sqlite3 files.
When version 4.20 of pgadmin was released it was shipped with a version later than sqlite3.19 and the problem arises because High Sierra is shipped with sqlite3.19, so to fix this issue, you need to replace the old version of sqlite3 with the latest on your packager.
Now be aware, MacosX+ all use sqlite to store details for the majority of apps on your mac, so you'll need to make sure you do not just wipe the old version but you'll have to have both versions co-existing together in harmony to avoid anything major occurring on your mac.
1) download brew https://brew.sh/
2) update brew and upgrade brew to make sure it's up-to-date
3) brew install sqlite3
4) mv /usr/bin/sqlite3 /usr/bin/sqlite3.os
5) ln -s /usr/local/Cellar/sqlite/3.21.0/bin/sqlite3 /usr/bin/sqlite3
6) /usr/bin/sqlite3 -version (check version is later than 3.19)
You can now proceed to open up pgadmin as normal
Got this issue after I upgraded PostgreSQL 9.4 to 9.6. The 9.4 binary package had PgAdmin 3 while 9.6 came with PgAdmin 4. I resolved it after a clean installation (I completely uninstalled and reinstalled) of PostgreSQL.
However, under different circumstances, you could try running the pgAdmin 4 application as an Administrator. This should fix the error.
downloaded pgadmin 4 v2.0 and install it no problem atm on force installation. try it. that was solution for me.
For my case in Windows 10 for postgresql 10 version, it worked by changing SERVER_MODE to False in config_distro.py placed in web folder, as per these configuration settings: https://www.pgadmin.org/docs/pgadmin4/dev/desktop_deployment.html.
There are other settings mentioned in this answer (https://superuser.com/a/1131964) regarding python but I just changed SERVER_MODE and it worked.
Kill it in Windows Task Manager and then try again. It seems that there is some sort of a problem when accessing the server from different applications.
As for me on windows 2012r2 it's start to work only after I reinstall pgAdmin 4 to folder c:\pgAdmin4. With out spaces and any special chars.
And all so I give full permission to this folder in NTFS.
It worked for me after installing python2.7 for pgAdmin 4 v2
Happens mostly when you have multiple versions of pgadmin installed or while trying to upgrade. Even I tried everything from killing the "running PID on port 5432" to "changing the server mode". In my case I uninstall postgres and re-install it again on different port(5433).
Later, I opened it through cmd(right click on cmd and select "run cmd as an Administrator").

Sitecore Package installation not working

I am trying to install Sitecore PowerShell Extensions-3.0 Package for Sitecore 8
in my sitecore 8 instance (Windows 8.1 machine).
I used Sitecore's Development Tools -> Installation Wizard & Package Manager and choosing the above mentioned package. It shows Install a Package sitecore dialog with Installing gif and stays there for over an hour and nothing happens. No error nothing it just spins.
First I tried other Packages and it was the same, even with lower versions of Powershell Packages and it still doesn't install.
Can someone shed some lights on what I am missing?
When installing Sitecore packages entries are written to the Sitecore Log. In Sitecore 8 the Logs are stored in MongoDB, so if you don't have Mongo running installing packages appears to hang.
Although disabling Mongo Analytics allowed you to install the package it is not a suitable method moving forward. Instead you should install MongoDB and then get the Sitecore DBs running by executing a .bat file.
To do that open Notepad paste the text as it below, modifying the path to the MongoDB.exe and folder containing the Sitecore Mongo databases if required, then Save As SitecoreDbs.bat
"C:\Program Files\MongoDB 2.6 Standard\bin\mongod.exe" -dbpath "C:\inetpub\wwwroot\Sitecore8\Databases"
Essentially the path to your MongoDB executable location and the Path to your Site's databases.
By disabling Mongo Analytic did the trick.

eclipse remote project with sftp - dltk indexing results in 'no more sessions' error

I am running a virtualbox with debian installed as local webserver. I am working with eclipse directly on that virtual box with a remote project (RSE plugin). I am having the problem that eclipse starts the DLTK-indexer as soon as I open the project. On the debian machine, instantly my /var/log/auth.log is filling up with a endless list of:
sshd[4271]: error: no more sessions
In eclipse, the error log is filling up with (although using JRE 6):
org.eclipse.core.runtime.CoreException: Operation failed. File system input or output error: rse://xxx.xxx.xxx.xxx/path/to/file/being/indexed
org.eclipse.rse.services.files.RemoteFileIOException: Operation failed. File system input or output error
While indexing is done, I am not able to save any file I am working on, as all ssh-sessions are already used on the server.
It seems that the indexing process tries to open a new connection for every file it´s indexing.
When indexing is finished, everything works normal again, I can save files etc.
I would appreciate the indexer to complete its work, but as code completion does not work afterwards, eclipse was not able to do the indexing.
One solution would be to disable the indexing, but this is not the purpose of an IDE, code completion is one of the few reasons for me to still use an IDE (at least for large projects).
Any ideas on how to make indexing work and get rid of the ssh-errors would be great!
Futher system information:
Host-System: Windows 7 Prof. 64bit
Guest-System (virtualbox): Debian Lenny with sftp subsystem enabled
Eclipse: Indigo with Zend PDT and RSE (already running with Java 6 JRE 1.6.0_45)
Thanks for your help!
David
I was able to fix this issue by doing two things:
set up ssh to use multiplexing (see http://en.wikibooks.org/wiki/OpenSSH/Cookbook/Multiplexing) in the virtual machine
Upgrade eclipse to Kepler 64Bit release (much faster and more stable in Windows 7) with manual installation of PDT feature (using Zend PDT is a waste of time)
This also works with Java7!
Now I have completely indexed projects and can use code-completion!