Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 4 months ago.
Improve this question
People, I'm developing a DW for a set of internal information datamarts that i'm turning into a DWH.
In this moment, i'm using postgresql for this, but i'm open to try another tools/databases, like spark (STS), dremio, hive, etc.
What is my constraint here ?
The dataset and dashboard need to access the data stored in the database that is not in Azure and Azure for database, in this moment (for financial decisions), is not possible.
I've tried to access data with PowerBI Desktop on the PostgreSQL (hosted on another cloud provider), and that worked, but when i've published that, it required encryption that's available only in Azure PostgreSQL or i would need to use a gateway server to update the dataset in the PowerBI.
There is anyway to update the dataset without using a gateway on-premises server or Azure hosted services (SQL Database, Data Warehouse or Spark on Azure HDInsight) ?
The objective is to keep the actual cloud provider (as our applications and databases resides on that) and power the dashboards with good information.
There is anyway to update the dataset without using a gateway on-premises server or Azure hosted services
Not really. That's what the Power BI Gateway is for.
If you can't run a Gateway VM or a Database in Azure, you could push the data to Azure Storage and load into PowerBI from there.
Related
I have a prospective customer from Canada who wants to use my application deployed on Heroku. They have strict requirement that all the data must be stored inside the Canada region. I know Heroku does not offer any data center in Canada but is there any work around or any option to host the PostgreSQL Database in Canada?
My application already deployed on Heroku region(US). Any help would be appreciated.
Heroku Ticket: https://help.heroku.com/sharing/c6d20548-5670-4b2c-81bd-5def14c30be9
is there any work around or any option to host the PostgreSQL Database in Canada?
Sure: just use a hosted database service in Canada. But Heroku won't manage it for you.
Amazon RDS is currently available in Canada Central. Azure Database for PostgreSQL is currently available in Canada Central and Canada East. I'm sure there are other options. Provision your own database on a service hosted in Canada and point your application to it, e.g. by setting an environment variable.
But be careful with this:
They have strict requirement that all the data must be stored inside the Canada region
How "strict" is this requirement, and how is it defined? If your application is running on Heroku, their data will be in memory in the USA. And depending how your application is built there may be other concerns, e.g. with data in queues or caches etc...
Plus, both Amazon and Microsoft are American countries, potentially subject to American data access laws.
I suggest having an open conversation with your client to ensure that you are able to meet their needs. We're not your client so it's impossible to know whether hosting your database in Canada is sufficient.
I´m using the Power BI Service (https://app.powerbi.com) to present important KPI´s. Now I move to a new System which is fully based on Azure. The main database is a PostgreSQL Instance (DbaaS - https://azure.microsoft.com/en-us/services/postgresql/).
Connecting to the database from my local Power BI Desktop Version and querying data works perfect. But as soon as I deploy the Report on Power BI Service, I´m unable to automate data refresh cause it seems that the Power BI Service can only connect to the PostgreSQL instance on Azure using a local Data Gateway.
In fact it doesn´t make much sense to use an on-prem connector to bring data from one cloud application to another.
Does anybody know how I and if I can connect Power BI Service and PostgreSQL Database on Azure directly?
Thanks a lot in advance & best,
Michael
It seems that you need to configure a gateway to make it working https://blogs.msdn.microsoft.com/chmitch/2018/06/04/complete-guide-to-setting-up-power-bi-connecting-to-postgres-w-refresh-enabled/
Hope it helps.
I did not go so far myself. My expectation was to connect Postgres to Power BI in a few clicks and get a dashboard online. I was very surprised that it needs dancing with ssl certificates, configuring gateway o_O.
I have created bucket in ibm cloud object storage and successfully able to upload file posting there. Now, I want to refine those files using ibm data connect. I am trying to create a connection in data connect and selected bluemix object storage.
Dont understand what details are asked under details. Am I selecting wrong connection type or what exactly details should i look for, in my cloud object storage.
Data Connect was deprecated in December 2017 and reached end-of-life 3/30/2018. Data Refinery is the successor, and does connect to IBM Cloud Object Storage natively. Information about migrating from Data Connect can be found here.
Is there a way to get the server info of my VSO account and access using SQL Server?
I've tried logging in using the URL
{account}.visualstudio.com
But I got a sever not found error
No, the back-end databases are SQL Azure instances, different from the TFS on-premise databases. I cannot see MS ever giving you access to the database - maybe the data, but not the database.
You can only use the API (old and new REST) and Power BI tools to perform queries.
If you have a specific problem you are trying to solve, post it as a new question because it may be possible without database access.
Does the IBM DataWorks Data Load API support integration between Object Storage and dashDB?
This is not currently supported. If you have an actual SoftLayer account then you can connect but connectivity to BlueMix Object Storage is not supported at this time and is considered for future releases.
Note: This question was answered on dw Answers by user Glen Walters. Here is the link to the post.