Is it possible to create Power BI plots and data visualisations from data sets programmatically? I am wanting to use a csv file and create a chart on the fly. I couldn't really find much information online about doing this.
Thanks!
Power BI supports R integration for data science and prediction. You may create a data frame and use csv data to do your analysis.
https://powerbi.microsoft.com/en-us/documentation/powerbi-desktop-r-scripts/
http://www.r-tutor.com/r-introduction/data-frame/data-import
Yes you can, Microsoft has provided very good documentation for Custom Visuals.
Along side, to be specific to your question, you can use d3 library to work around with your csv file.
Note: Microsoft has deprecated the Power BI playground feature so you need to go through the documentation provided to create custom visual via CLI. Also a lot of online tutorials are based on Power BI playground, so make sure your read the documentation.
https://github.com/Microsoft/PowerBI-Visuals/
Related
Am need of your suggestion for scenario below :
one of our clients has 8 postgres DB servers used as OLTP and now wants to generate MIS reports/dashboards integrating all the data in the servers.
- There are around 100 reports to be generated
- There would be around 50k rows added to each of these databases
- the reports are to be generated for once every month
- they are running all there setup in baremetals
- they don't want to use hadoop/spark , since they think the maintainabilty will be higher
- they want to use opensource tech to accomplish this task
with all said above, one approach would be to write scripts to bring aggregated data into one server
and then manually code the reports with frontend javascript.
is there any better approach using ETL tools like Talend,Pentaho etc.
which ETL tool would be best suited for this ?
community editions of any ETL tool would suffice the above requirement..?
I know for the fact that the commercial offering of any of the ETL tools will not be in the budget.
could you please let me know your views on this.
Thanks in Advance
Deepak
Sure Yes. I did similar things successfully a dozen time in my life.
My suggestion is to use Pentaho-Data-Integrator (or Talend) to collect the data in one place and then filter, aggregate and format the data. The data volume is not an issue as long as you have a decent server.
For the reports, I suggest to produce them with Pentaho-Report-Designer so that they can be send by mail (with Pentaho-DI) or distributed with a Pentaho-BI-server.
You can also make javascript front end with Pentaho-CDE.
All of these tools are mature, robust, easy to use, have a community edition and well supported by the community.
I have few projects lined up wherein visuals in Tableau needs to be converted to power BI, Is there any tools available to do so.
please share your suggestions
Unfortunately, there is no tool that converts Tableau worksheet to PowerBI.
You cannot convert Tableau dashboards to PowerBi. However, you can try to replicate a visualization in Tableau in PowerBi. The degree of similarity will highly depend on the tools and features used in the Tableau dasboard which are proprietary to Tableau. If , say, a Tableau chart used is not present in PowerBi, then you are out of luck, unless you are good at programming! Then you can create a custom visual in PowerBi to be used in your dashboard.
And look at Powerbi Improvements suggestion ,They have this suggestion,Hoping to see it soon in the future.
How can I run visual analytics on historical IoT data on #Bluemix?
There are services like Real-time Insights and Streaming analytics for real-time data analytics, but is there a service for historical data analytics and visualization?
There are a few different options depending on your use case, experience and data source. For example:
You can use Jupyter notebooks or RStudio on Data science experience. You can use R, python or scala to analyse data and create re-runnable reports. You can also use spark which is great if your data volumes are large or you want to use spark's vast number of connectors to different data sources. This approach is ideal for data scientists with coding experience.
You can use Watson Analytics if you want to do analysis without data science or coding skills. This environment is more for ah-hoc analysis rather than reporting.
If you are looking to do reporting Cognos has excellent visualization capabilities and reports can be created by users who don't have coding skills.
There are a number of other options, but in my experience the above three tend to be the most common.
how to integrate kdb/q with BI tools like cognos to create visualizations and graphs.
I have some historical data in KDB database and i want to plot trends using cognos BI tools?
You should be able to use the JDBC driver with Cognos BI tools. Simply:
Download the driver http://code.kx.com/q/interfaces/jdbc-client-for-kdb/
Configure the driver in Cognos.
Almost any BI tools that allow a jdbc will in fact work. If you are looking for charting that works out of the box with kdb try qStudio/sqlDashboards http://www.timestored.com/sqldashboards/ .
DISCLAIMER - I work for the company that produces the software. You can download a free version that allows charting kdb results etc.
There's no out-of-the box way of doing this as you won't be able to use the normal database connectors that come with these types of BI tools (they would have ODBC, etc). A very hairy option is simply to batch up a copy of the data in KDB to an SQL database that Cognos understands. Obvious disadvantages there.
I don't really know much about Cognos, but there seems to be some plugin development in the applications - maybe you can use the c# or c++ api to kdb to pass data along to the BI application.
EDIT
panopticon.com have some really funky data visualisations, if that's all you want.. Saw a demo once, very cool.
EDIT 2
I really should read questions more thoroughly :) Re trends, why not simply use R or the very many graphing applications for which you can have C# plugins? With R trending etc becomes an easy process. If you prefer Excel, you can interface with KDB directly (http://code.kx.com/q/interfaces/excel-client-for-q/)
I am trying to write a custom FoxPro XBase database driver for Unix via Perl. I am currently able to perform CRUD on my .dbf and .cdx indices. The point of sale software my store uses has a FoxPro based file system. The master plan behind the idea is to have a proxy between the POS and my Magento web store. Allowing real time updates between the brick and mortar store and the ecommerce solution.
My question is fairly simple and straight forward. Whats the best way to dump my .cdx file contents so i can quickly look at the indices on the .dbf file. I am currently using XBases indexdump, but this is a slow and tedious process. The dump can be platform independent and can be purchasable software if needed. I am trying to accomplish this picture from MSDN
This from MSDN might help - it's not really a documented or discussed thing though, as someone is doing what you're doing there is no need to ever delve into the CDX structure.