Is there an easy way to re-run failed external data sets? - azure-data-factory

I've got roughly 60 files that didn't turn up when they should have done and therefore data factory has missed their arrival and marked them as failed validation.
To rerun, the only method I know of is to either click each individually and then "re-run" in the azure portal or use powershell.
Is there any way to bulk rerun in the azure portal or is there any way to re-run external sources in the monitor and manage application?

In the portal, click "Monitor & Manage", this will open in a new tab.
Filter the activity list to show the ones you are interested in (filter pipeline, status etc); then select multiple rows with shift+click or ctrl+click. THen click the "Rerun" option in that window....all rows selected will be rerun

Related

Using pac portal to deploy portal between environments. Want to exclude certain records

Using pac portal to push changes between environments. Following the instructions mentioned here. https://learn.microsoft.com/en-us/power-apps/maker/portals/power-apps-cli
Have a specific to exclude certain adx weblinks records from getting pushed. Is there a way to do so? Other than downloading the portal data and deleting the records first?
We use Azure devops to perform the operations. If that helps.
Really appreciate your help and time.
Thanks!
Not sure how to remove the weblinks, but could you solve your problem by changing the weblink 'Publishing Status' from 'Published' to 'Draft' instead? Resulting in the weblinks becoming hidden from public after deployment? This can be done in a deployment profile for your target environment (tutorial here)
Look up the GUID for the 'Draft' 'Publishing State' (in Portal Management App go to 'Websites', select your website, then pick 'Related' tab and 'Publishing States', click on 'Draft' and pull the Id from the URL e.g &id=14ea80af-db7f-ec11-8d21-00224815aec9)
Then in your dev.deployment.yml file you can add something like:
adx_weblink:
- adx_weblinkid: 95f37310-3489-ec11-9390-002248154727
adx_publishingstateid: 14ea80af-db7f-ec11-8d21-00224815aec9
- adx_weblinkid: 349175f7-3389-ea11-93b0-002248154627
adx_publishingstateid: 14ea80af-db7f-ec11-8d21-00224815aec9
Where adx_weblinkid is the GUID of a weblink you want to hide and adx_publishingstateId is the GUID for the 'Draft' Publishing State. Then when you do your 'pac paportal upload' dont forget to include the '--deploymentProfile dev' flag so the dev.deployment.yml file gets used.
You can use Deployment profiles to set and override environment-specific settings when you deploy. That way, you don't need to manually make changes every time you deploy.
I hope this helps?!

Manage versions with Azure DevOps

I currently use these tools :
Azure DevOps - Only for Git repositories
Jira - To manage tasks / bugs / versions / customer requests / ...
TeamCity - Continuous integration (build and deploy versions )
I would like to replace Jira with Azure Devops (but continue to use TeamCity for builds for now.)
I already created some teams / areas / user stories / bugs.
But I would like a simple way to handle versions. For example, I fix some bugs and release a new version using TeamCity (ex. : v3.1.1.1234 ). How can I update my user stories / bugs to say that it is fix in this version ? There is no "Fix version" field like in Jira...
Should I use "Iterations" or just "tags" ?
If I want to generate release notes for the new version (for internal use), do I have to use Azure DevOps queries ?
You can create a customized field (ie.Fix version) for User Stories in azure devops. You can follow below steps:
1, Create an inherited process. (only an inherited process is allowed to create custom field)
Organization Setting--> Process under Boards--> Select the Process--> Click 3dots(...)-->Click Create inherit process.
2, Create customized Field for the inherited processs which created above
Choose your inherited process, and then choose the Work Item Type (ie, User Story)you want to customize.
Click New field, type in the new field's name (ie. Fix Version) in the Definition section. (you can decide where the new field should locate in Layout section or keep the default layout).
3, Change your project process to above inherited process.
Choose the process that contains you project. Click Projects-->Choose your Project-->Click the 3dots-->Click Change Process
You can check the document here for more information.
After you finish above steps, you will see the new field Fix Version in User Stories edit page.
If you find above steps complicated, you can just use tags.
#Levi Lu-MSFT, This only lets you create field in one workitem type if you want same field in Bugs, Features, Stories it wouldn't allow, it'll throw 'Field already exists" error.

SAPUI5 chart not visible...when running from within the portal

I have a really bizarre one here...I have developed and deployed to my back end system a launchpad application that currently works OK. Part of this application is a report that, based on certain filters, returns a table and a chart (see snapshot below).
After finishing deployment next step is configuring the app so it runs from the launchpad within the SAP portal. Not familiar with the portal, another colleague undertook the task, application is now running from within the portal as well. With one exception - the chart above is not visible (see 2nd snapshot below).
Noticing the "No Data" message and NO exception in the Chrome debugger, thought as a good idea to debug the OData methods in the back end. To my big surprise, found out that while filters pass to the method just fine both for table and chart (two different entities but almost identical and accepting exactly the same parameters) when running outside portal, when running from within (the portal) parameters "get lost" on their way to the chart entity - no parameters for the chart method. See snapshots below and pay attention to the IT_FILTER_SELECT_OPTIONS at the bottom right.
Outside portal (parameter table filled)
Within Portal (parameter table empty)
Furthermore, the filter table passed to both OData tables is common, you can see the code underneath - just two lines: one for table and one for chart binding.
Closing with a clarification. Mentioned above that there are no errors in the debugger when calling the back end methods. There are actually a couple of them but they take place during the initialization of the app and do not seem to affect anything else in the app, which aside a set of reports has a lot of data operations (dialogs, tables etc), everything else works fine. These errors can be seen below.
Does this situation ring any bells to anyone?
Thanks in advance
Issue solved, it was a deployment issue...

How to customize workflow in Azure DevOps Service (VSTS online)?

I've read all the MSDN docs, but cannot find a way to edit the work item transitions in Azure DevOps Service (VSTS online).
I'm trying to:
Add a custom Reason to a State of a work item. (e.g. "resolved", "won't fix")
See/edit all the existing rules about how states transition.
This is possible if you are on the Hosted XML Process model in VSTS.
Hosted XML process model concept - VSTS
When are you on the Hosted XML Process model you ask??
Well after lots of reading I found the following note on the page explaining Hosted XML customization which states
Feature availability: Import process supports the Hosted XML process model which allows you to manage customizations through updating select XML definition files of a process template. This feature is only available for accounts that have been migrated to VSTS using the TFS Database Import Service.
But since I didn't import my VSTS I'm on the Inheritance Process model.
Which does NOT currently support this feature as confirmed here in comments
#RohanDaniel #ehofman#MSFT #DevMarTechOps You are correct. Advanced workflow management, which includes restricting transitions and customizing the reasons of a transition is not yet possible in the Inheritance model. It is on our backlog to add though.
Also, if you indeed used a high fidelity migration tool and you have a Hosted XML process model, you are stuck on it. You cannot move to the inheritance model as seen in this link.
In summary then. On the Inheritance Process model in VSTS this is not a feature that is available currently but is on the backlog as confirmed by MS. However it is not planned for delivery in the next few months and a year or more from now is more likely.
In my case I also had to add addition fields and a new state on the BUG WIT (Work Item Type). This was accomplished on VSTS by customizing a process which is done by inheriting from one of the standard processes ( Agile, CMMI, Scrum ) which you can then customize.
You can add customized rules to a WIT and you can base a rule on changes to the state.... however the rules seems too limited to restrict transitions and the options to set fields doesn't have the "Reason" field available.
In fact, I came up with a solution! Which I admit is not clean as I would like, but it works.
I created three new fields: "Rules error" (Text single line), "Rules broken" (Text single line) and "Rules activated" (Boolean).
"Rules error" I put it on the main tab so I can see the error and the two others I created a tab named "Useless" in which I put them.
Now, add a rule making the reset:
Name: Reset rules
Condition: The value of equals ==> "Rules activated" ==> true
Action: Clear the value ==> "Rules error"
And then one rule per not wanted transition of states:
Name: State change - Approved to Deployed QA
Condition: A work item state changes from ==> Approved ==> Deployed QA
Action: Make required ==> "Rules broken"
Action: Set the value of ==> "Rules activated" ==> true
Action: Set the value of ==> "Rules error" ==> "Can't change from Approved to Deployed QA"
I know, entering something in the field "Rules broken" breaks this enforcement, but as this functionality doesn't exist, it is the only way I came up with when you don't have access to Hosted XML.
Neither of those things appear to be possible at the moment.
The VSTS process customisation is very different to TFS and is still evolving. #1 seems like something that might be added in a future update. But #2 doesn't seem like it would appear, as Microsoft have relaxed most of the transition rules on all the templates on VSTS by default.
This is currently not possible when using inheritance process.
You can vote for this feature request in the community: Allow specifying state transitions when using inheritance process
It's possible by creating our own custom extensions and creating some rules that disable state changes from one state to another state
I have implemented this for my org but haven't published it online..will do it soon
Here is a workaround for denying any users who are not a member of group "HighLevelManagement" to change state from Approved to Committed for PBI:
Create a new Field Called "Unlocked".
create a new rule to "Hide the Field" when the user is not part of "HighLevelManagement" as below
Create a new rule with action "Make Read Only" set to "State" when
Unlocked is False and workitem change from Approved to Commited as
below:
Now whenever a user from HighLevelManagement wants to change state from Approved to Committed he simply tick Unlocked change state and then tick back Unlocked, that way anyone from outside HighLevelManagement will be restricted to change state from Approved to Committed.

Eclipse RCP fireSelectionChanged from Non-SWT client

I have the following problem:
I have a framework in which arbitrary clients can run. Imagine you have a non-swt/non-swing client and you want to invoke a fireselectionchanged event to the Workbench. Is that possible somehow.
Once again. I am not able to get the edior/viewer or something else in my plugin!
Thank you very much
At any given time there can be only one selection provider per workbench window/page and it's the one provided by active workbench part. Hence, it's only possible to provide selection and notify selection change from a view or an editor.
While it is possible to access the selection provider of current active part and set selection to it...
workbenchWindow.getActivePage().getActivePart().getSite().
getSelectionProvider().setSelection(ISelection);
...it's not guaranteed that (1) there is an active part at the time and that (2) the selection provider of the active part supports the type of selection that you want to provide.