Azure pipeline expression does not work in template - azure-devops

I have some templates and i'd like to check if variables are set or not.
So i tried this:
Template that gets included:
- ${{if not(variables.assemblyVersion)}}:
- task: PowerShell#2
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
But even if set assemblyVersion to something (e.g. 1.2.3.4) that task is being ran.
What am i doing wrong?
Edit: tried the answer from Krzysztof Madej, and i got false-positives:
Output:
2020-11-19T09:36:30.7383677Z ##[section]Starting: PowerShell
2020-11-19T09:36:30.7500976Z ==============================================================================
2020-11-19T09:36:30.7501272Z Task : PowerShell
2020-11-19T09:36:30.7501523Z Description : Run a PowerShell script on Linux, macOS, or Windows
2020-11-19T09:36:30.7501778Z Version : 2.170.1
2020-11-19T09:36:30.7501984Z Author : Microsoft Corporation
2020-11-19T09:36:30.7502296Z Help : https://learn.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
2020-11-19T09:36:30.7502761Z ==============================================================================
2020-11-19T09:36:31.9944831Z Generating script.
2020-11-19T09:36:32.1228113Z ========================== Starting Command Output ===========================
2020-11-19T09:36:32.1504771Z ##[command]"C:\windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'D:\a\_temp\2af656c2-be5b-4a73-8812-17185fff83cc.ps1'"
2020-11-19T09:36:32.4080866Z 1.2.3.4
2020-11-19T09:36:32.7066175Z assemblyVersion was not set
2020-11-19T09:36:32.7066649Z At D:\a\_temp\2af656c2-be5b-4a73-8812-17185fff83cc.ps1:4 char:1
2020-11-19T09:36:32.7067329Z + throw "assemblyVersion was not set"
2020-11-19T09:36:32.7068304Z + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2020-11-19T09:36:32.7069103Z + CategoryInfo : OperationStopped: (assemblyVersion was not set:String) [], RuntimeException
2020-11-19T09:36:32.7069840Z + FullyQualifiedErrorId : assemblyVersion was not set
2020-11-19T09:36:32.7070536Z
2020-11-19T09:36:32.8288504Z ##[error]PowerShell exited with code '1'.
2020-11-19T09:36:32.8929792Z ##[section]Finishing: PowerShell
Main pipeline where yaml is set:
trigger:
- master
- feature/*
pool:
vmImage: 'windows-latest'
variables:
- group: HmiSulis
- name: solution
value: AllProjects.sln
- name: buildPlatform
value: x86
- name: buildConfiguration
value: Debug
- name: assemblyVersion
value: 1.2.3.4
- name: fileVersion
value: 5.6.7.8
- name: informationalVersion
value: 9.10.11.12
resources:
repositories:
- repository: BuildTemplates
type: git
name: HMI/BuildTemplates
extends:
template: netFx/Jobs/netFx.Build.yml#BuildTemplates
The job used:
jobs:
- job: Build
steps:
- template: ../../NuGet/Steps/NuGet.Restore.yml
- template: ../Steps/netFx.Build.Version.yml
- template: ../Steps/netFx.Build.yml
The steps with the checks (netFx.Build.Version.yml):
steps:
- ${{if not(variables['assemblyVersion'])}}:
- task: PowerShell#2
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
- ${{if not(variables['fileVersion'])}}:
- task: PowerShell#2
inputs:
targetType: 'inline'
script: |
throw "fileVersion was not set"
- ${{if not(variables['informationalVersion'])}}:
- task: PowerShell#2
inputs:
targetType: 'inline'
script: |
throw "informationalVersion was not set"
- task: Assembly-Info-NetFramework#2
inputs:
Path: '$(Build.SourcesDirectory)'
FileNames: |
**\AssemblyInfo.cs
**\AssemblyInfo.vb
InsertAttributes: true
FileEncoding: 'auto'
WriteBOM: false
VersionNumber: '$(assemblyVersion)'
# File version in windows explorer
FileVersionNumber: '$(fileVersion)'
# Product version in windows explorer
InformationalVersion: '$(informationalVersion)'
LogLevel: 'verbose'
FailOnWarning: false
DisableTelemetry: false

Please use correct syntax as it is shown here:
variables:
${{ if eq(variables['Build.SourceBranchName'], 'master') }}: # only works if you have a master branch
stageName: prod
pool:
vmImage: 'ubuntu-latest'
steps:
- script: echo ${{variables.stageName}}
so in your case it would be
- ${{if not(variables['assemblyVersion'])}}:
- task: PowerShell#2
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
You can use an if clause to conditionally assign the value or a variable or set inputs for tasks. Conditionals only work when using template syntax.
I simplified your case and it works:
variables:
- name: solution
value: AllProjects.sln
- name: buildPlatform
value: x86
- name: buildConfiguration
value: Debug
- name: assemblyVersion
value: ''
# value: 1.2.3.4
- name: fileVersion
value: 5.6.7.8
- name: informationalVersion
value: 9.10.11.12
pool:
vmImage: 'ubuntu-latest'
jobs:
- job: Build
variables:
- name: test
value: $[not(variables['assemblyVersion'])]
steps:
- ${{if not(variables['assemblyVersion'])}}:
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
Write-Host $(test)
So when assemblyVersion is given task is skipped. And when is not given task is ran and fail. Be aware $(assemblyVersion) it means that variable have to be available even if not set.
I made further tests moving logic to template. So this is my template:
jobs:
- job: BuildFromTemplate
dependsOn: []
variables:
- name: test
value: $[not(variables['assemblyVersion'])]
steps:
- ${{if not(variables['assemblyVersion'])}}:
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
Write-Host $(test)
and here is the pipeline:
variables:
- name: assemblyVersion
# value: ''
value: 1.2.3.4
pool:
vmImage: 'ubuntu-latest'
stages:
- stage: A
jobs:
- job: Build
variables:
- name: test
value: $[not(variables['assemblyVersion'])]
steps:
- ${{if not(variables['assemblyVersion'])}}:
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
Write-Host $(test)
- template: template.yaml
and yes job in template failed:
What seems strange, because:
The difference between runtime and compile time expression syntaxes is primarily what context is available. In a compile-time expression (${{ }}), you have access to parameters and statically defined variables. In a runtime expression ($[ ]), you have access to more variables but no parameters.
and assemblyVersion is statically defined variable.
It looks that we can use only paramaters in template expression in templates and not variables.
I created a bug on developer community for this.
IMHO if you want to use template you need to move this condition into task and just skip logic.
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
$ver = '$(assemblyVersion)'
Write-Host "Ver: $($ver)"
if (!$ver)
{
throw "assemblyVersion was not set"
}
Or use templates variable and reuse it in main file and template file:
parameters:
- name: 'variabaleTemplate'
default: 'variables.yaml'
type: string
jobs:
- job: BuildFromTemplate
dependsOn: []
variables:
- template: ${{parameters.variabaleTemplate}}
- name: test
value: $[not(variables['assemblyVersion'])]
steps:
- ${{if not(variables['assemblyVersion'])}}:
- task: PowerShell#2
continueOnError: true
inputs:
targetType: 'inline'
script: |
Write-Host $(assemblyVersion)
throw "assemblyVersion was not set"
with variables.yaml like
variables:
- name: assemblyVersion
# value: ''
value: 1.2.3.4
and main file like:
stages:
- stage: A
variables:
- template: variables.yaml
jobs:
- template: template2.yaml
So I got reply from MS
For security reasons, we only allow you to pass information into templated code via explicit parameters.
https://learn.microsoft.com/en-us/azure/devops/pipelines/process/templates?view=azure-devops
The means the author of the pipeline using your template needs to commit changes where they explicitly pass the needed info into your template code.
There are some exceptions to this, where the variable is statically defined in the same file or at pipeline compile time, but generally speaking, it’s probably better to use parameters for everything that does not involve system-defined read-only dynamic variable and custom-defined dynamic output variables.
So solution with separate variable template yaml is the best what is possible I think. Otherwise you need to pass all values via template parameters.

Related

Dependencies azure devops yaml

I can't understand why dependencies don't work. I need to fix - task: cake#2 and other commented tasks. Now they looks like jobs, but I need to convert them into tasks.
Here that task:
- task: Cake#2
displayName: Restore FE and Sitecore modules
condition: Or(eq(dependencies.check.outputs['ChangedFiles.BE'], 'true'), ne(variables['Build.Reason'], 'PullRequest'))
inputs:
script: "$(Build.Repository.LocalPath)/src/build.cake"
target: "Server :: Restore"
verbosity: "Quiet"
Version: "1.3.0"
Here's the whole code
name: test-build$(Rev:.r)
trigger:
branches:
include:
- develop
- release/*
paths:
exclude:
- "environment/**/*"
schedules:
- cron: 0 19 * * 1-5
displayName: evening-deployment
branches:
include:
- develop
always: false # whether to always run the pipeline or only if there have been source code changes since the last successful scheduled run. The default is false.
pool:
vmImage: "windows-latest"
variables:
- group: shared-variables
- name: ArtifactsLocation
value: "$(Build.Repository.LocalPath)/output"
- name: NUGET_PACKAGES
value: "$(Pipeline.Workspace)/.nuget/packages"
stages:
- stage: build
displayName: Build solution
jobs:
- job: Init
steps:
- ${{ if eq(variables['Build.Reason'],'PullRequest') }}:
- template: /environment/azure/templates/steps/validate-pr-title.yml
- task: gitversion/setup#0
displayName: Installing GitVersion tool
inputs:
versionSpec: "5.8.1"
- task: ChangedFiles#1
displayName: check
condition: eq(variables['Build.Reason'], 'PullRequest')
inputs:
rules: |
[FE]
**/*.json
**/*.ts
**/*.js
**/*.tsx
**/*.scss
**/*.html
**/*.css
[BE]
**/*.csproj
**/*.cs
**/*.yml
**/*.yaml
[SCContent]
**/*.json
**/*.yml
**/*.yaml
- task: GitVersion#5
displayName: Generate GitVersion
inputs:
versionSpec: "5.8.1"
runtime: "full"
configFilePath: "$(Build.Repository.LocalPath)/GitVersion.yml"
- script: |
echo deployInt: $(deployInt)
echo deployQa: $(deployQa)
displayName: Show variables for debug
condition: eq(variables['system.debug'], 'true')
- job: SitecoreCode
dependsOn: Init
steps:
- task: UseNode#1
displayName: Install correct Node.Js version
inputs:
version: "16.x"
- task: Cache#2
displayName: Cache cake packages
inputs:
key: 'cake | "$(Agent.OS)"'
restoreKeys: |
cake
path: "$(Build.Repository.LocalPath)/src/tools"
- task: Cache#2
displayName: Cache nuget modules
inputs:
key: 'nuget | "$(Agent.OS)" | **/packages.lock.json,!**/bin/**,!**/obj/**'
restoreKeys: |
nuget | "$(Agent.OS)"
nuget
path: "$(Build.Repository.LocalPath)/src/packages"
- task: Cache#2
displayName: Cache nuget package reference modules
inputs:
key: 'nuget_pr | "$(Agent.OS)" | $(Build.SourcesDirectory)/**/packages.lock.json'
path: "$(NUGET_PACKAGES)"
restoreKeys: |
nuget_pr | "$(Agent.OS)"
nuget_pr
- task: Cache#2
displayName: Cache node modules
inputs:
key: 'npm | "$(Agent.OS)" | $(Build.Repository.LocalPath)/src/package-lock.json'
restoreKeys: |
npm | "$(Agent.OS)"
npm
path: "$(Build.Repository.LocalPath)/src/node_modules"
- task: Cache#2
displayName: Cache client node modules
inputs:
key: 'client_npm | "$(Agent.OS)" | $(Build.Repository.LocalPath)/src/rendering/package-lock.json'
restoreKeys: |
client_npm | "$(Agent.OS)"
client_npm
path: "$(Build.Repository.LocalPath)/src/rendering/node_modules"
- task: DownloadSecureFile#1
displayName: Download license
name: licenseFile
inputs:
secureFile: "license.xml"
- task: PowerShell#2
displayName: Place license file under /src folder
inputs:
targetType: "inline"
script: |
Move-Item $(licenseFile.secureFilePath) "$(Build.Repository.LocalPath)/src/" -Force
- template: /environment/azure/templates/steps/set-assembly-version.yml
- task: Cake#2
displayName: Restore FE and Sitecore modules
condition: Or(eq(dependencies.check.outputs['ChangedFiles.BE'], 'true'), ne(variables['Build.Reason'], 'PullRequest'))
inputs:
script: "$(Build.Repository.LocalPath)/src/build.cake"
target: "Server :: Restore"
verbosity: "Quiet"
Version: "1.3.0"
# - job: Restore_BE
# displayName: Restore BE
# dependsOn: Init
# condition: Or(eq(dependencies.check.outputs['CheckChanges.FE'], 'true'),ne(variables['Build.Reason'], 'PullRequest'))
# steps:
# - task: Cake#2
# displayName: Restore FE and Sitecore modules
# inputs:
# script: "$(Build.Repository.LocalPath)/src/build.cake"
# target: "Server :: Restore"
# verbosity: "Quiet"
# Version: "1.3.0"
# - job: Restore_FE
# displayName: Restore FE
# dependsOn: Init
# condition: Or(eq(dependencies.check.outputs['CheckChanges.FE'], 'true'),ne(variables['Build.Reason'], 'PullRequest'))
# steps:
# - task: Cake#2
# displayName: Restore FE and Sitecore modules
# inputs:
# script: "$(Build.Repository.LocalPath)/src/build.cake"
# target: "Client :: Restore"
# verbosity: "Quiet"
# Version: "1.3.0"
# drop empty config to make sure that JSS app picks settings from env vars
- powershell: |
$MyJsonHashTable = #{
'sitecore' = #{
'instancePath' = ''
'apiKey' = '$(JssApiKey)'
'deploySecret' = ''
'deployUrl' = ''
'layoutServiceHost' = ''
}
}
$MyJsonVariable = $MyJsonHashTable | ConvertTo-Json
Set-Content "$(Build.Repository.LocalPath)/src/rendering/scjssconfig.json" $MyJsonVariable
Write-Host ('{0}vso[task.logissue type={1}]{2}' -F '##', 'warning', "It would be nice to make app use SITECORE_API_KEY env var instead of API KEY in this file");
displayName: Generate scjssconfig.json with default API key
# TODO: Fix application to read SITECORE_API_KEY Variable
# - job: Build_BE
# displayName: Build BE
# dependsOn: Init
# condition: Or(eq(dependencies.check.outputs['CheckChanges.BE'], 'true'),ne(variables['Build.Reason'], 'PullRequest'))
# steps:
# - task: Cake#2
# displayName: Generate and Build FE and Sitecore
# inputs:
# script: "$(Build.Repository.LocalPath)/src/build.cake"
# target: "Server :: Build"
# verbosity: "Quiet"
# arguments: '--BuildConfiguration "Release" --ScSiteUrl "dummy"'
# Version: "1.3.0"
# - job: Build_FE
# displayName: Build FE
# dependsOn: Init
# condition: Or(eq(dependencies.check.outputs['CheckChanges.FE'], 'true'),ne(variables['Build.Reason'], 'PullRequest'))
# steps:
# - task: Cake#2
# displayName: Generate and Build FE and Sitecore
# inputs:
# script: "$(Build.Repository.LocalPath)/src/build.cake"
# target: "Client :: Build"
# verbosity: "Quiet"
# arguments: '--BuildConfiguration "Release" --ScSiteUrl "dummy"'
# Version: "1.3.0"
- ${{ if eq(variables['Build.Reason'],'PullRequest') }}:
- template: /environment/azure/templates/steps/npm-audit.yml
# - job: Unit_tests_BE
# displayName: Unit tests BE
# dependsOn: Init
# condition: Or(eq(dependencies.check.outputs['CheckChanges.BE'], 'true'),ne(variables['Build.Reason'], 'PullRequest'))
# steps:
# - task: Cake#2
# displayName: Run Unit tests
# inputs:
# script: "$(Build.Repository.LocalPath)/src/build.cake"
# target: "Server :: Tests"
# verbosity: "Quiet"
# Version: "1.3.0"
# - job: Unit_tests_FE
# displayName: Unit tests FE
# dependsOn: Init
# condition: Or(eq(dependencies.check.outputs['CheckChanges.FE'], 'true'),ne(variables['Build.Reason'], 'PullRequest'))
# steps:
# - task: Cake#2
# displayName: Run Unit tests
# inputs:
# script: "$(Build.Repository.LocalPath)/src/build.cake"
# target: "Client :: Tests"
# verbosity: "Quiet"
# Version: "1.3.0"
- task: PublishTestResults#2
displayName: Publish test results
inputs:
testResultsFormat: "XUnit"
testResultsFiles: "**/*.xml"
searchFolder: "$(ArtifactsLocation)/tests"
- task: PublishCodeCoverageResults#1
displayName: Publish code coverage
inputs:
codeCoverageTool: "Cobertura"
summaryFileLocation: "$(ArtifactsLocation)/tests/coverage/**/*.xml"
- ${{ if ne(variables['Build.Reason'],'PullRequest') }}:
- task: Cake#2
displayName: Publish Sitecore code
inputs:
script: "src/build.cake"
target: "004-Publish"
verbosity: "Quiet"
arguments: '--BuildConfiguration "Release" --PublishingTargetDir "$(ArtifactsLocation)/sitecore" --ClientConfigDir "$(Build.Repository.LocalPath)/src/rendering/sitecore/config"'
Version: "1.3.0"
- task: CopyFiles#2
displayName: Copy Sitecore root files
inputs:
SourceFolder: "$(Build.Repository.LocalPath)/src/configs/Sitecore"
TargetFolder: "$(ArtifactsLocation)/sitecore"
Contents: "**"
- task: CopyFiles#2
displayName: Copy transform files to separate artifact
inputs:
SourceFolder: $(ArtifactsLocation)/sitecore/ # string. Source Folder.
Contents: '**/*.transform' # string. Required. Contents. Default: '**'.
TargetFolder: $(ArtifactsLocation)/sitecore-transforms/ # string. Required. Target Folder.
- task: ArchiveFiles#2
displayName: "Archive config file transform artifacts"
inputs:
rootFolderOrFile: "$(ArtifactsLocation)/sitecore-transforms/"
archiveFile: "$(ArtifactsLocation)/sc/$(Build.BuildNumber)-transform.zip"
verbose: $(system.debug)
includeRootFolder: false
- task: DeleteFiles#1
displayName: Perform artifacts cleanup
inputs:
SourceFolder: "$(ArtifactsLocation)/sitecore"
RemoveDotFiles: true
Contents: |
**/obj/*
**/obj
**/*.wpp.targets
**/*.transform
# this hack is needed as our jss app have different roots now.
# hope in future it would be fixed
- powershell: |
$distFolder = $(Get-Item "$(ArtifactsLocation)/sitecore/dist/").FullName;
$files = Get-ChildItem "$distFolder" -Recurse -Force;
$TestFolder = New-Item $(Join-Path $distFolder "Test") -Type Directory -Force;
$optimaFolder = New-Item $(Join-Path $distFolder "optimahealth") -Type Directory -Force;
$files | % { Copy-Item $_.FullName -Destination $_.FullName.Replace($distFolder, "$($testFolder.FullName)/") -Force };
$files | % { Copy-Item $_.FullName -Destination $_.FullName.Replace($distFolder, "$($optimaFolder.FullName)/") -Force };
$files | % { if (Test-Path $_.FullName) { Remove-Item $_.FullName -Recurse -Force -Confirm:$false } }
displayName: Manually create folders for JSS app
- task: ArchiveFiles#2
displayName: "Archive Sitecore code artiffact"
inputs:
rootFolderOrFile: "$(ArtifactsLocation)/sitecore"
archiveFile: "$(ArtifactsLocation)/sc/$(Build.BuildNumber).zip"
verbose: $(system.debug)
includeRootFolder: false
- task: CopyFiles#2
displayName: Copy Id root files
inputs:
SourceFolder: "$(Build.Repository.LocalPath)/src/configs/Id"
TargetFolder: "$(ArtifactsLocation)/id"
Contents: "**"
- task: PublishPipelineArtifact#1
displayName: Publish Sitecore
inputs:
targetPath: "$(ArtifactsLocation)/sc"
artifactName: "SitecoreCode"
- task: PublishPipelineArtifact#1
displayName: Publish ID
inputs:
targetPath: "$(ArtifactsLocation)/id"
artifactName: "SitecoreID"
- job: SitecoreContent
dependsOn: Init
condition: eq(dependencies.check.outputs['ChangedFiles.SCContent'], 'true')
steps:
- template: /environment/azure/templates/steps/dotnet-cli.yml
parameters:
workingDir: "$(Build.Repository.LocalPath)/src"
- task: DotNetCoreCLI#2
displayName: Create Sitecore itempackage
inputs:
command: "custom"
custom: "sitecore"
arguments: "ser pkg create -o $(ArtifactsLocation)/w/test.itempackage"
workingDirectory: "$(Build.Repository.LocalPath)/src"
- ${{ if ne(variables['Build.Reason'],'PullRequest') }}:
- task: CopyFiles#2
displayName: Copy dotnet tools config
inputs:
SourceFolder: $(Build.Repository.LocalPath)/src/.config/ # string. Source Folder.
Contents: '**' # string. Required. Contents. Default: '**'.
TargetFolder: $(ArtifactsLocation)/w/.config/ # string. Required. Target Folder.
- task: CopyFiles#2
displayName: Copy sitecore dotnet config
inputs:
SourceFolder: $(Build.Repository.LocalPath)/src/ # string. Source Folder.
Contents: 'sitecore.json' # string. Required. Contents. Default: '**'.
TargetFolder: $(ArtifactsLocation)/w/ # string. Required. Target Folder.
- task: PublishPipelineArtifact#1
displayName: Publish Sitecore content
inputs:
targetPath: "$(ArtifactsLocation)/w/"
artifactName: "SitecoreContent"
## Deployment stage
- ${{ if ne(variables['Build.Reason'],'PullRequest') }}:
- template: /environment/azure/templates/deployment.yml
There is error:
Reproduce the same issue with the similar YAML sample:
The cause of the issue is that we are not able to directly use dependencies expression in condition field.
To solve this issue, you need to change the following two points.
To use the variable in previous job, you can define variable to get the output variable in previous job. Then you can use the new variable to set the condition.
The format you used to get the the output variable is incorrect.
Based on your situation, here is the correct sample:dependencies.Init.outputs['ChangedFiles.FE'].
Refer to the following example:
name: test-build$(Rev:.r)
trigger:
branches:
include:
- develop
- release/*
paths:
exclude:
- "environment/**/*"
schedules:
- cron: 0 19 * * 1-5
displayName: evening-deployment
branches:
include:
- develop
always: false # whether to always run the pipeline or only if there have been source code changes since the last successful scheduled run. The default is false.
pool:
vmImage: "windows-latest"
variables:
- group: shared-variables
- name: ArtifactsLocation
value: "$(Build.Repository.LocalPath)/output"
- name: NUGET_PACKAGES
value: "$(Pipeline.Workspace)/.nuget/packages"
stages:
- stage: build
displayName: Build solution
jobs:
- job: Init
steps:
- ${{ if eq(variables['Build.Reason'],'PullRequest') }}:
- template: /environment/azure/templates/steps/validate-pr-title.yml
- task: gitversion/setup#0
displayName: Installing GitVersion tool
inputs:
versionSpec: "5.8.1"
- task: ChangedFiles#1
displayName: check
condition: eq(variables['Build.Reason'], 'PullRequest')
inputs:
rules: |
[FE]
**/*.json
**/*.ts
**/*.js
**/*.tsx
**/*.scss
**/*.html
**/*.css
[BE]
**/*.csproj
**/*.cs
**/*.yml
**/*.yaml
[SCContent]
**/*.json
**/*.yml
**/*.yaml
- task: GitVersion#5
displayName: Generate GitVersion
inputs:
versionSpec: "5.8.1"
runtime: "full"
configFilePath: "$(Build.Repository.LocalPath)/GitVersion.yml"
- script: |
echo deployInt: $(deployInt)
echo deployQa: $(deployQa)
displayName: Show variables for debug
condition: eq(variables['system.debug'], 'true')
- job: SitecoreCode
dependsOn: Init
variables:
changes: $[dependencies.Init.outputs['ChangedFiles.FE'] ]
steps:
- task: UseNode#1
displayName: Install correct Node.Js version
inputs:
version: "16.x"
- task: Cache#2
displayName: Cache cake packages
inputs:
key: 'cake | "$(Agent.OS)"'
restoreKeys: |
cake
path: "$(Build.Repository.LocalPath)/src/tools"
- task: Cache#2
displayName: Cache nuget modules
inputs:
key: 'nuget | "$(Agent.OS)" | **/packages.lock.json,!**/bin/**,!**/obj/**'
restoreKeys: |
nuget | "$(Agent.OS)"
nuget
path: "$(Build.Repository.LocalPath)/src/packages"
- task: Cache#2
displayName: Cache nuget package reference modules
inputs:
key: 'nuget_pr | "$(Agent.OS)" | $(Build.SourcesDirectory)/**/packages.lock.json'
path: "$(NUGET_PACKAGES)"
restoreKeys: |
nuget_pr | "$(Agent.OS)"
nuget_pr
- task: Cache#2
displayName: Cache node modules
inputs:
key: 'npm | "$(Agent.OS)" | $(Build.Repository.LocalPath)/src/package-lock.json'
restoreKeys: |
npm | "$(Agent.OS)"
npm
path: "$(Build.Repository.LocalPath)/src/node_modules"
- task: Cache#2
displayName: Cache client node modules
inputs:
key: 'client_npm | "$(Agent.OS)" | $(Build.Repository.LocalPath)/src/rendering/package-lock.json'
restoreKeys: |
client_npm | "$(Agent.OS)"
client_npm
path: "$(Build.Repository.LocalPath)/src/rendering/node_modules"
- task: DownloadSecureFile#1
displayName: Download license
name: licenseFile
inputs:
secureFile: "license.xml"
- task: PowerShell#2
displayName: Place license file under /src folder
inputs:
targetType: "inline"
script: |
Move-Item $(licenseFile.secureFilePath) "$(Build.Repository.LocalPath)/src/" -Force
- template: /environment/azure/templates/steps/set-assembly-version.yml
- task: Cake#2
displayName: Restore FE and Sitecore modules
condition: Or(eq(variables['changes'], 'true'), ne(variables['Build.Reason'], 'PullRequest'))
inputs:
script: "$(Build.Repository.LocalPath)/src/build.cake"
target: "Server :: Restore"
verbosity: "Quiet"
Version: "1.3.0"
Refer to the doc about Use outputs in a different job

Azure Devops YAML - Dynamic Condition Evaluation

I am attempting to use a condition to break out of a loop based on the result of a sql query. So I am assigning the query output to a variable "sqloutput" and if that value is empty string go around again. I have confirmed that the query is outputting a value however on subsequent loops the variable is still evaluating to NULL.
Also tried to explicitly declare the variable to no avail.
parameters:
- name: loop
type: object
default : ["1","2","3","4","5","6","7","8","9","10"]
stages:
- stage: WaitforProcessing
displayName: Wait For Processing
jobs:
- deployment: Deployment
pool:
vmImage: ubuntu-latest
environment:
name: 'Client_Data_Tests'
resourceType: VirtualMachine
strategy:
runOnce:
deploy:
steps:
- ${{each Looptimes in parameters.loop}}:
- task: PowerShell#2
name: checkImportProgress${{ Looptimes }}
condition: and(succeeded(), eq(variables['sqloutput'], ''))
displayName: Check if job finished
inputs:
targetType: inline
script: |
$query = "IF EXISTS (select 1 from Job where JobFinishTime is null)
BEGIN
select '' as result
END
ELSE
select '1' as result
"
$sqloutput = Invoke-Sqlcmd -query $query -ServerInstance "$(DB_SERVER)" -Database "$(DB_DATABASE)" -Username "$(DB_USERNAME)" -Password "$(DB_PASSWORD)" -QueryTimeout 36000 -Verbose
$value = $sqloutput["result"]
Write-Host $value
Write-Host "##vso[task.setvariable variable=sqloutput]$value"
- task: PowerShell#2
condition: and(succeeded(), eq(variables['sqloutput'], ''))
displayName: 'Sleep for 30 seconds'
inputs:
targetType: inline
script: |
Start-Sleep 30
The below YAML should work.
stages:
- stage: A
jobs:
- job: A
displayName: SQL generate variable
steps:
- powershell: |
$value = 'somevalue'
echo "##vso[task.setvariable variable=sqloutput;isOutput=true]$value"
name: setvarStep
- script: echo $(setvarStep.sqloutput)
name: echovar
- job: B
dependsOn: A
displayName: Use variable that SQL script output as condition
variables:
myVarFromJobA: $[ dependencies.A.outputs['setvarStep.sqloutput'] ] # map in the variable
myvar: true
condition: eq(variables['myVarFromJobA'],'somevalue')
steps:
- script: echo $(myVarFromJobA)
name: echovar
Result:

Azure Pipeline in queue?

This is my folder Structure in code.
Here is my azure-pipeline01.yml
trigger:
branches:
include:
- main
- release/*
- feature/*
- bug-fix/*
paths:
include:
- OutSideFolderEAIL/Folder01
exclude:
- OutSideFolderEAIL/Folder02
pool:
vmImage: windows-latest
variables:
mydate: $(Get-Date -Format yyyy-MM-dd__hhmmss)
jobs:
- job: firstjob
steps:
- powershell: |
New-Item -Path . -Name "$(Build.DefinitionName)__$(Build.SourceBranchName)__$(Build.BuildId)__$(mydate).dacpac" -ItemType "file" -Value "This is a text string."
dir
- job: SecondJob
steps:
- powershell: |
Write-Host "executing azure-pipeline01.yml"
Here is my azure-pipeline02.yml
trigger:
branches:
include:
- main
- release/*
- feature/*
- bug-fix/*
paths:
include:
- OutSideFolderEAIL/Folder02
exclude:
- OutSideFolderEAIL/Folder01
pool:
vmImage: windows-latest
variables:
mydate: $(Get-Date -Format yyyy-MM-dd__hhmmss)
jobs:
- job: firstjob
steps:
- powershell: |
New-Item -Path . -Name "$(Build.DefinitionName)__$(Build.SourceBranchName)__$(Build.BuildId)__$(mydate).dacpac" -ItemType "file" -Value "This is a text string."
dir
- job: SecondJob
steps:
- powershell: |
Write-Host "executing azure-pipeline02.yml"
I want to execute azure-pipeline01.yml and the azure-pipeline02.yml one by one in sequence using 3rd pipeline called as "azure-pipeline-all.yaml" ? how to achieve the same? azure-pipeline-all.yaml will be manually triggered always.
You add two stages in azure-pipeline-all.yaml:
stages:
- stage: pipeline01
displayName: Trigger azure-pipeline01
jobs:
- job: RunTests
steps:
- task: PowerShell#2
name: Dummy
displayName: 'Dummy Do Nothing'
continueOnError: false
inputs:
targetType: Inline
script: |
echo "Dummy"
- stage: pipeline02
displayName: Trigger azure-pipeline02
dependsOn:
- pipeline01
jobs:
- job: RunTests
steps:
- task: PowerShell#2
name: Dummy
displayName: 'Dummy Do Nothing'
continueOnError: false
inputs:
targetType: Inline
script: |
echo "Dummy"
Then, in Pipeline01 and Pipeline02, you add the trigger:
trigger:
- none
pool:
vmImage: ubuntu-latest
resources:
pipelines:
- pipeline: MyCIAlias
source: azure-pipeline-all
trigger:
stages:
- pipeline02 #This is Triggered when stage pipeline02 of pipeline azure-pipeline-all has finished
See https://learn.microsoft.com/en-us/azure/devops/pipelines/yaml-schema/resources-pipelines-pipeline?view=azure-pipelines
However, if you want Pipeline02 to wait for Pipeline01 to finish, it becomes more tricky: you could just skip azure-pipeline-all all together and just trigger Pipeline02 when Pipeline01 finishes, using the same concept of resources.pipelines triggers.

How to pass a value between stages in a pipeline returned by invoking a PowerShell script?

I have an Azure DevOps pipeline:
stages:
- stage: Stage1
jobs:
- job: RunScript
steps:
- task: PowerShell#2
inputs:
pwsh: true
targetType: 'filePath'
filePath: $(System.DefaultWorkingDirectory)/scripts/myscript1.ps1
- stage: Stage2
jobs:
- job: RunScript
steps:
- task: PowerShell#2
inputs:
pwsh: true
targetType: 'filePath'
filePath: $(System.DefaultWorkingDirectory)/scripts/myscript1.ps1
arguments: >
-Arg ??? # <======= HERE
Stage1 runs myscript1.ps1 which is (for simplicity):
$OutputValue = 'Hello'
$OutputValue
It is just a script which will eventually return something.
The problem
The issue is that the value produced by myscript1.ps1 in Stage1 must be consumed by myscript2.ps1 in Stage2.
How can I achieve this?
You need to use output variables as here
With the script myscript1.ps1 as this:
echo "##vso[task.setvariable variable=myOutputVar;isOutput=true]this is the value"
and pipeline:
stages:
- stage: A
jobs:
- job: A1
steps:
- task: PowerShell#2
inputs:
pwsh: true
targetType: 'filePath'
filePath: $(System.DefaultWorkingDirectory)/scripts/myscript1.ps1
name: setvarStep
- stage: B
dependsOn: A
variables:
myVarfromStageA: $[ stageDependencies.A.A1.outputs['setvarStep.myOutputVar'] ]
jobs:
- job: B1
steps:
- script: echo $(myVarfromStageA)
You can retrive value in the next stage.
It doesn't matter if you use it inside the script file. But important here is to have step named as later you will use it to reference output variable created by it.

Azure DevOps variable empty between steps

I am trying to read a text file using bash in a AZDO pipeline template, but for some reason the variable containing the name of the file is empty:
##deploy-to-env.yml
parameters:
- name: env
type: string
default: ""
- name: envLong
type: string
default: ""
stages:
- stage: "deployTo${{ parameters.envLong }}"
displayName: "Deploy to ${{ parameters.env }}"
variables:
- name: releasesFile
value: ""
jobs:
- deployment:
environment: "${{ parameters.env }}"
displayName: "Deploy to ${{ parameters.env }}"
strategy:
runOnce:
deploy:
steps:
- task: Bash#3
name: FindReleaseFile
displayName: "Find the releases.txt file"
inputs:
targetType: 'inline'
script: |
echo "##vso[task.setvariable variable=releasesFile;isOutput=true]$(find $(Build.SourcesDirectory) -name releases.txt -maxdepth 1 -type f 2>/dev/null)"
- task: Bash#3
name: DownloadUsingArtifactTool
displayName: "Download Using Artifact Tool"
inputs:
targetType: 'inline'
script: |
echo "$(FindReleaseFile.releasesFile)"
The pipeline looks like this:
trigger:
branches:
include:
- azure-pipelines
paths:
include:
- "releases.txt"
stages:
- template: deploy-to-env.yml
parameters:
env: "tst"
envLong: "Test"
How can I pass the releasesFile variable to the 2nd task in deploy-to-env.yml template?
The problem was the the repository was not cloned, adding checkout: self in the steps fixed it