I want to start existing and ongoing replication from source MongoDB to destination RDS Postgres.
All the security network is done and successful.
RDS VPC and DMS VPC are connected using VPC peering, target endpoint test connection status is successful
DMS VPC IP is whitelisted in another AWS account MongoDB server, source endpoint test connection status is successful
In the Endpoint schemas section both database schemas are visible.
Created a DMS migration task to start the migration of one document of MongoDB to Postgres Database.
Premigration assessments were successful.
Empty scheme with the MongoDB schema name got created in PostgresDB.
The table awsdms_apply_execution is also empty in Postgres DB.
But the task shows running with error and error, and cloud watch logs also show no error.
Related
I have a Node JS application that has come into my situation. The app has a Postgres database that is currently hosted on Heroku that needs to be migrated to RDS. I have created a Postgres Aurora database cluster and have performed a restore using pg_restore. I am now trying to connect the Node JS application to the RDS database cluster and am having some trouble how to connect the app to the database in RDS.
Note, the RDS database cluster is private. The only access to the database is within the VPC. If there are any guides available to achieve this connectivity, that would greatly be appreciated.
Overall I'm trying to create a Datastream Connection to a Postgres database in Cloud SQL.
As I'm trying to configure it all through Terraform, I'm stuck on how I should create a Replication Slot. This guide explains how to do it through the Postgres Client and running SQL commands, but I thought there might be a way to do it in the Terraform configuration directly.
Example SQL that I would like to replicate in Terraform:
ALTER USER [CURRENT_USER] WITH REPLICATION;
CREATE PUBLICATION [PUBLICATION_NAME] FOR ALL TABLES;
SELECT PG_CREATE_LOGICAL_REPLICATION_SLOT('[REPLICATION_SLOT_NAME]', 'pgoutput');
If not, does anyone know how to run the Postgres SQL commands against the Cloud SQL database through Terraform?
I have setup the Datastream and Postgres connection for all other parts. I'm expecting that there is a Terraform setting I'm missing or a way to run Postgres commands against the Google Cloud SQL Postgres database.
Unfortunately, there is no terraform resource for specifying a replication slot on a google_sql_database_instance.
I have created a AWS RDS Postgresql db instance in one VPC and I need to "move" it to another VPC.
I created a snapshot of the original db instance.
Re-created it in a new VPC (using terraform).
How can I retrieve one particular database from my initial db instance snapshot into the new DB Instance?
When you restore snapshot all databases are restored.
If you want to copy particular database, AWS service Database Migration Service can be used if postgres version is higher than 9.4.
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.PostgreSQL.html
If postgres version is lower, then only manual export/import of database can be used. Another instance where export files will be stored is needed.
I have created an Redshift endpoint in AWS DMS service.
When I run the test connection I get the following error message:
Error Details: [errType=CALL_SERVER_ERROR, status=0, errMessage=Failed executing command on Replication Server, errDetails=]
Both the DMS replication instance and Redshift cluster are at the same region and in the same VPC.
Have created a follower database for a Heroku Postgres DB. I am able to connect to the follower DB by using pgAdmin, no problem.
When I try to connect with Tableau 8.2 Postgres connector using the same credentials, I get "no pg_hba.conf entry for host xxx.xxx.xxx.xxx, user yyyyyyyy, database zzzzzzzz, SSL Off".
As an alternative I tried the Amazon Redshift connector with the same credentials and it works, except for full drill through to underlying data errors out ("Syntax error at or near 7500") or some other line number.
Does anyone know a way to connect to Heroku Follower database with Tableau 8.2 that enables drill through (view underlying data)?
Have you been able to get the Postgres connector to work?
Is there a way to get the Amazon Redshift (or other) connector to work with drill through capabilities?