Scheduled export of data from Dynamics CRM - scheduled-tasks

I hope someone can help me. I would like to find a way to do a scheduled export of select data from Microsoft Dynamics CRM (Online)
Preferably to a CSV file and have the export automated at a recurring time (at least once a day) so it does the export to a specified location without any user interaction.
I'm aware of Scribe for example but that is very expensive and I need a cheaper solution. Any ideas for scheduled and unattended exporting from Dynamics?

As #Guido Preite mentioned, your best bet is to get the CRM SDK. Since cost is an issue with turn-key third-party software, the SDK is a good alternative if you have a little time to get familiarized with it. There are a lot of good examples straight from MSDN and the SDK documentation to get you up and running quickly, start here. Basically what you could do is create a simple console app that queries the data you need, then save it off to a file. This could then be scheduled via Task Scheduler.

Scribe is a good solution, but isn't cheap as you say.
I've used KingswaySoft to do scheduled data imports and exports with CRM. See http://www.kingswaysoft.com/products/ssis-integration-toolkit-for-microsoft-dynamics-crm.
It's a good product and is cheaper than Scribe. No coding is required, although you'll need some experience of SQL Server Integration Services (SSIS).

Flatly lets you auto-export data from Microsoft Dynamics Online to CSV (placed in cloud storage) every 10 minutes, hourly or daily. It takes 5 minutes to setup. flatly.io
Disclosure: I work at Flatly.

Related

Anylogic: Behavioural Experiment using Anylogic

I would like to do an online experiment with human participants backed up by simulation. In the experiment, participants need to change the parameters and run simulations based on their changed parameters. Their changes need to be saved for data analysis.
I wonder if it is feasible to do this using anyLogic or anyLogic cloud. The essential features are:
The model needs to be shared with participants; ideally, they do not have to download anyLogic to complete the experiment.
The changes that participants made need to be saved and downloaded.
Have anyone had the experience of doing similar things?
Many thanks,
I reached out to the salespeople of AnyLogic. They believed that this is feasible but hadn't seen anyone had done this before...
I did this... but in order to do this, you need either the anylogic professional version or the anylogic cloud subscription, or the AnyLogic private cloud (best option)
This is not possible using PLE/public cloud, because to do this you need to either be able to export the executable file (which requires professional version) and/or you need to export the data to a centralized database (which requires the anylogic cloud subscription as a minimum to have access to this feature)
Option with Professional version using exported executable
You export your model and send to all of them a link to download it
You use a centralized database to save every action the user makes to it
Con of this option: i would say 30% of the users will have issues with their JAVA version, computer issues, and other issues and you will have to do troubleshooting with them on an individual basis. If you have 1000 users, then this will be virtually impossible to manage
Option with AnyLogic cloud subscription
You export your model to AnyLogic cloud
you use a centralized database (using Zapier or your own SQL database) that will save the data every time a user changes anything
Con of this option: you will need all users to have a cloud subscription, OR you will need all users to use the same user/password to have access to the model. I am not sure with 1000 users what would happen if you have so many people using the same user/password.. According to AnyLogic, what they told me is that there's no limitation there.
Option with AnyLogic Private Cloud
With this option you have absolute freedom to do what you want. I haven't done it here, but it's also the most expensive option.

Generating MIS reports and dashboards using opensource technologies

Am need of your suggestion for scenario below :
one of our clients has 8 postgres DB servers used as OLTP and now wants to generate MIS reports/dashboards integrating all the data in the servers.
- There are around 100 reports to be generated
- There would be around 50k rows added to each of these databases
- the reports are to be generated for once every month
- they are running all there setup in baremetals
- they don't want to use hadoop/spark , since they think the maintainabilty will be higher
- they want to use opensource tech to accomplish this task
with all said above, one approach would be to write scripts to bring aggregated data into one server
and then manually code the reports with frontend javascript.
is there any better approach using ETL tools like Talend,Pentaho etc.
which ETL tool would be best suited for this ?
community editions of any ETL tool would suffice the above requirement..?
I know for the fact that the commercial offering of any of the ETL tools will not be in the budget.
could you please let me know your views on this.
Thanks in Advance
Deepak
Sure Yes. I did similar things successfully a dozen time in my life.
My suggestion is to use Pentaho-Data-Integrator (or Talend) to collect the data in one place and then filter, aggregate and format the data. The data volume is not an issue as long as you have a decent server.
For the reports, I suggest to produce them with Pentaho-Report-Designer so that they can be send by mail (with Pentaho-DI) or distributed with a Pentaho-BI-server.
You can also make javascript front end with Pentaho-CDE.
All of these tools are mature, robust, easy to use, have a community edition and well supported by the community.

How to save Lync conversation history when Corp has blocked this feature?

I am using Lync 2010 (4.0.7577.4356), which we use on my small development team for IM'ing. Lots of technical Q&A are handled through this program and lots of other items that need to be documented. Unfortunately, our parent company has a policy that turns off "Converation History", so once the window is closed, it's gone.
I've done a fair bit of research and I haven't found a way to save this data since the settings have been made at our parent Corporation's level (through Active Directory, or whatever). This is information that we need and even my boss has tried finding a way to save this information (everything short of copy-pasting everything before closing the window or computer).
How can I accomplish this task? Are there any programs out there (freeware or otherwise) that can save these conversations? Does anyone know of a way that I can hook up Lync (the instant messaging module) to another instant messenger (GTalk, Jabber, ICQ, Yahoo, or whatever) -- then record each message from there? I'm a software developer, so if anyone knows of a means of communicating with Lync, and is able to access the messages, that would help too!
Anything at this point would help... thanks in advance!!!
-Panuvin
Try this https://github.com/bujocek/LyncIMLocalHistory. I've used the Tom Morgans answer and created own local lync (Skype for Business) conversation history tracker.
You can build it from source or just unpack and run latest release here: https://github.com/bujocek/LyncIMLocalHistory/releases
There's a client-side Lync SDK, which is pretty easy to use if you're already a .NET developer.
It's easier to do something like this and have it running on every member of your small dev team's machine alongside Lync - easier than trying to re-invent a central conversation store.
I recently blogged about recording the length and status of Conversations, and also about identifying different sorts of Call within the Conversation (you'd be looking for Instant Message Call type).
After that, you'd need to subscribe to the Flow and catch every message to and fro, and log them to a database or whatever. There's a really good book which could help you with this: Unified Communications with Microsoft Lync. If you're serious about doing Lync development, this is definitely the book for you!
With Lync 2013, CTRL+S will save the current tab to your Outlook/Exchange Conversation History folder. I'm not certain if this works with 2010.
You may try this: https://github.com/PhilippeRaemy/LyncLog.
This tool saves the conversations in text files, using a file naming convention that makes it easy to identify the time and participants.

Moodle 2.x task automation for create / copy course

is there a good clean way in moodle to programmatically create new courses and copy old courses? At the moment I try to figure out whats possible with moodles webservices, since the cli scripts are lousy. But it seems that with webservices only the creation of courses is possible. Copying one is not a possible task.
Thanks
For a site administrator, automated course backups are more expensive in terms of time, CPU usage and storage. The recovery time to have a site running again takes longer than a site backup. However, teachers and site administrators might find a course backups as a way to create a "fresh" copy of a course that can be re-used.
Use Default Moodle Functionality Backup & Restore, it's easy for you, and for create course you can also use web service.

Event-based analytics package that won't break the bank with high volume

I'm using an application that is very interactive and is now at the point of requiring a real analytics solution. We generate roughly 2.5-3 million events per month (and growing), and would like to build reports to analyze cohorts of users, funneling, etc. The reports are standard enough that it would seem feasible to use an existing service.
However, given the volume of data I am worried that the costs of using a hosted analytics solution like MixPanel will become very expensive very quickly. I've also looked into building a traditional star-schema data warehouse with offline background processes (I know very little about data warehousing).
This is a Ruby application with a PostgreSQL backend.
What are my options, both build and buy, to answer such questions?
Why not building your own?
Check this open source project as an exemple:
http://www.warefeed.com
It is very basic and you will have to built datamart feature you will need in your case