Want to implement Transparent Data Encryption(TDE) in PostgreSQL? I got some steps to implement TDE on tablespace but the parameters like keystore_location and tablespace_encryption_algorithm don't exist in postgresql.conf, when I tried to add those parameters it gave an error.
link from where I got the steps:-
https://arctype.com/blog/transparent-data-encryption/#:~:text=Transparent%20Data%20Encryption%2C%20or%20TDE,the%20first%20line%20of%20defense.
If this doesn't work then how to implement TDE with pgcrypto.
Related
I was looking into this
https://postgres.ai/docs/database-lab/masking
and was searching how to mask (dynamically) my data using Amazon RDS PostgreSQL, but couldn't find any real solution.
Is there any one out there that solved that without recurring to server/backend masking?
If you want to retrieve readonly masked data I'd say to use views from the PostgreSQL. One way to achieve that would be:
Create a new schema, for example: "masked"
Create a new view inside the masked schema, with the same name as the table you want to mask your data dynamically. You'll set your masked rules on this said view.
Create a new user role which will retrieve the masked data and change its search_path to look first for the masked schema SET search_path TO '$user', masked, public
This way, if you make a query to select from the said table, it'll first look for the masked schema and if it has a view with the same name as the table you are doing your query, it'll retrieve the masked data from the rules applied to the view.
I am trying to find out how to do dynamic creation of tables in MySQL using Talend.
In other ETL tools such as Pentaho they have a specific component called "metadata" to do this.
So my use case is the following:
1) Create database manually in MySQL
2) Use Talend to read CSV Header info, and use this as the fields of a table to be created in MySQL using Talend.
I have searched and could not find anything for this specific feature online.
[Note : using Talend Open Studio for Big Data Version: 6.4.1]
UPDATE:
I have made progress on this, but running into issues trying to generate a primary key on the MySQL output using the NumericSequence function.
My data does not have natively a primary key, but wish to include one:
I have a screenshot of the tMap attached here:
Also I am getting a compile/build error. It seems it does not like the primary key generation it seems.
See attached image.
And here also is the tMySQLOutput settings for Primary Key:
More Work Done:
I have changed the name of the Primary Key in the tMySQL component to match the name of the tMap output area component, i get the same compile error.
I will attach this error here:
To create dynamically MySQL tables in Talend, you can use one of the "Action on table" options in tMysqlOutput components (in your case, "Create table...").
https://help.talend.com/reader/4I8tDQGtrOPDl5MXAS3Q~w/aDNKleHXlevILu9pnbCoNg
Don't forget to define correctly PK fields for further inserts, updates, deletes...
Then, if necessary, through your favorite Database Tool (MySQL Workbench, DBeaver or other), you can retrieve the DDL (and DML) script(s).
I hope this answers to your problem/question.
I'm using access as a frontend to a postgresql db, I've inherited it.
I've added a new column to a table in postgresql, but I can't access it in access. Do I need to add the same column in access and define the link or would it do this automatically. Any help is welcomed.
I'm using linked tables, to get the new column to show up I needed to refresh the linked connection.
I have a database with about 50 something tables. I would like to run the report "Data Dictionary" on each table.
Ideally, I would like them all to be in one report, for example, in PGAdminIII, if I right click select "Tables" I will get a report of all the 'objects' and under each one a data dictionary report.
Is there an automatic way of doing this, or an plugin that I can install to postgres? Or is there something analogous to this?
If I understand correctly, you're referring to the ability to right mouse click on a table in PgAdminIII and select Reports > Data Dictionary report?
I'm not aware of any way to do that from PgAdminIII. You could look into using a different tool such as SchemaSpy. Another option (as alluded to by #kgrittn) is to use psql \d with the \H flag to generate html output. My solution (since SchemaSpy didn't do what I needed, and I needed the same output for both Postgres and Oracle) was to roll my own using perl, DBD::Pg and Template::Toolkit.
Update: Added GitHub link.
I wrote a fairly simple Postgres data dictionary generator in Python that spans all schemas and tables within a specified database. If it doesn't have exactly what you want it would be fairly easy to modify.
https://github.com/kylejmcintyre/pypostgreports
In PgAdmin, is it possible to search for a value in ALL tables? In phpmyadmin this is possible and quite convenient. You search for an ID value and find all the tables in which it occurs. I can't seem to find this function in PgAdmin.
Does it exist?
It currently doesn't exist in PgAdmin.
There's custom function for this. You can use it from Query tool. See [How to search a specific value in all tables (PostgreSQL)?
](as of today, there are two modifications in answers there that include column name, progress reporting)