Is there a way to publish ADF pipeline run events with status to App Insights?
Per my knowledge, you could use Web Activity in the ADF to invoke the Application Insights REST API after execution of your main activities(Or using Execute Pipeline Activity to execute your root pipeline and get the status or output of it).Then send it to App Insights REST API.
More details,please refer to this document:https://www.ben-morris.com/using-azure-data-factory-with-the-application-insights-rest-api/
Related
Looking through the Azure Devops APIs it appears like it isn't possible to get the runtime of individual steps in a pipeline run?
Pipeline steps
I'm looking to scrap the runtime of each step in a pipeline run across all runs of a pipeline.
I've looked at the Azure Devops APIs, and while I see how to get pipeline run details here, it doesn't appear like the API includes step level information.
You can use Timeline - Get REST API to achieve the runtime of individual steps in a pipeline run. Please refer to doc:Timeline-GET-REST APT
For example:
URL
GET https://dev.azure.com/{organization}/{project}/_apis/build/builds/{buildId}/timeline/{timelineId}?api-version=5.1
Test in postman:
The response body returns a list of build details that include job/step/task type and name and startTime and finishTime according timeline.
What I want to do is to generate Azure monitor alerts for Azure DevOps pipeline failures.
We think we may achieve this without having to modify our DevOps YAML pipelines. So we focused on using Azure DevOps Service Hooks to do this by sending the pipeline log data to the log analytics http data API.
I can send the data with Powershell. However I got a forbidden failure when testing the service webhook in Azure DevOps.
So I wonder if there is any missing operations?
enter image description here
I need to extract information from a finished pipeline build in Azure DevOps. I can get the tree of steps in the executed plan for that build and the attached logs. The final piece of information that I'm looking for is the name of the build agent that was used to execute a certain step. How can I query the agent? The web frontend clearly shows the info, but I don't see it exposed via the documented API.
Querying the agent a build step was run on from Azure DevOps via REST API
First, there are Use predefined variables, which provide a list of predefined variables. You could use the Agent.Name to get the name of the build agent.
If you want to use REST API to get the name of it, you could use the REST API Builds - Get Build Log:
GET https://dev.azure.com/{organization}/{project}/_apis/build/builds/{buildId}/logs/{logId}?api-version=6.0
Then we need to parse the log to get the name of the agent:
I'm wondering if it is possible to trigger an Azure Data Factory pipeline from a Microsoft Power App, and if so, how would one go about configuring this?
I was unable to find a PowerApp connector trigger in Azure Data Factory
I was unable to find a PowerApp connector trigger in Azure Logic Apps
I have experience with Azure, but no experience in PowerApps
If you have any ideas or information for me that would be great.
Thanks!
You can trigger an Azure Data Factory pipeline using the REST API like this:
The following sample command shows you how to run your pipeline by using the REST API manually:
POST
https://management.azure.com/subscriptions/mySubId/resourceGroups/myResourceGroup/providers/Microsoft.DataFactory/factories/myDataFactory/pipelines/copyPipeline/createRun?api-version=2017-03-01-preview
More information: Pipeline execution and triggers in Azure Data Factory → Manual execution (on-demand) → REST API
There is now a PowerApps connecter you can use to create a pipeline run: https://learn.microsoft.com/en-us/connectors/azuredatafactory/#create-a-pipeline-run
We would need to store the deployment logs for all customers for a period of one year and was wondering if there is a way of pushing the Azure Devops release logs into Log Analytics or Azure monitor?
It seems there is not a direct way to push Azure Devops release logs into Log Analytics. But since there is Api to get release logs and for Log Analytics, you can consider using the api to implement your requirement.