Updating readme file for macOS-11 version 20220110.2

* feat: enable voiceover applescript in defaults

* refactor: reword comment

* fix: grammar in VO comment

.github/CODEOWNERS

@@ -0,0 +1 @@
+* @actions/virtual-environments-owners

.github/ISSUE_TEMPLATE/announcement.md

@@ -1,34 +0,0 @@
----
-name: Announcement
-about: Submit an announcement
-title: ''
-labels: Announcement
-assignees: ''
-
----
-
-**Breaking changes**
-<!-- Short description of the upcoming change -->
-
-**Target date**
-<!-- Date of changes propagation start -->
-
-**The motivation for the changes**
-<!-- Description of main reasons for this change -->
-
-**Possible impact**
-<!-- Description of who might be impacted by this change -->
-
-**Virtual environments affected**
-- [ ] Ubuntu 16.04
-- [ ] Ubuntu 18.04
-- [ ] Ubuntu 20.04
-- [ ] macOS 10.13
-- [ ] macOS 10.14
-- [ ] macOS 10.15
-- [ ] macOS 11.0
-- [ ] Windows Server 2016 R2
-- [ ] Windows Server 2019
-
-**Mitigation ways**
-<!-- Steps or options for impact mitigation -->

.github/ISSUE_TEMPLATE/announcement.yml

@@ -0,0 +1,48 @@
+name: Announcement
+description: Submit an announcement
+labels: [Announcement]
+body:
+  - type: textarea
+    attributes:
+      label: Breaking changes
+      placeholder: Short description of the upcoming change
+    validations:
+      required: true
+  - type: textarea
+    attributes:
+      label: Target date
+      placeholder: Date of changes propagation start
+    validations:
+      required: true
+  - type: textarea
+    attributes:
+      label: The motivation for the changes
+      placeholder: Description of main reasons for this change
+    validations:
+      required: true
+  - type: textarea
+    attributes:
+      label: Possible impact
+      placeholder: Description of who might be impacted by this change
+    validations:
+      required: true
+  - type: checkboxes
+    attributes:
+      label: Virtual environments affected
+      options:
+        - label: Ubuntu 18.04
+        - label: Ubuntu 20.04
+        - label: macOS 10.15
+        - label: macOS 11
+        - label: Windows Server 2016
+        - label: Windows Server 2019
+        - label: Windows Server 2022
+    validations:
+      required: true
+  - type: textarea
+    attributes:
+      label: Mitigation ways
+      description: Steps or options for impact mitigation
+    validations:
+      required: true
+

.github/ISSUE_TEMPLATE/bug-report.md

@@ -1,39 +0,0 @@
----
-name: Bug report
-about: Submit a bug report
-title: ''
-labels: needs triage
-assignees: ''
-
----
-
-**Description**  
-A clear and concise description of what the bug is, and why you consider it to be a bug.
-
-**Area for Triage**:  
-<!-- See https://github.com/actions/virtual-environments/tree/main/triage-rules.yml for areas -->
-
-**Question, Bug, or Feature?**:  
-<!-- Choose "Question", "Bug", or "Feature" -->
-
-**Virtual environments affected**  
-- [ ] Ubuntu 16.04
-- [ ] Ubuntu 18.04
-- [ ] Ubuntu 20.04
-- [ ] macOS 10.15
-- [ ] macOS 11.0
-- [ ] Windows Server 2016 R2
-- [ ] Windows Server 2019
-
-**Expected behavior**  
-A description of what you expected to happen.
-
-**Actual behavior**  
-A description of what is actually happening.
-
-**Repro steps**  
-A description with steps to reproduce the issue. If your have a public example or repo to share,
-please provide the link.
-
-1. Step 1
-2. Step 2

.github/ISSUE_TEMPLATE/bug-report.yml

@@ -0,0 +1,55 @@
+name: Bug Report
+description: Submit a bug report
+labels: [needs triage]
+body:
+  - type: textarea
+    attributes:
+      label: Description
+      description: A clear and concise description of what the bug is, and why you consider it to be a bug.
+    validations:
+      required: true
+  - type: checkboxes
+    attributes:
+      label: Virtual environments affected
+      options:
+        - label: Ubuntu 18.04
+        - label: Ubuntu 20.04
+        - label: macOS 10.15
+        - label: macOS 11
+        - label: Windows Server 2016
+        - label: Windows Server 2019
+        - label: Windows Server 2022
+    validations:
+      required: true
+  - type: textarea
+    attributes:
+      label: Image version and build link
+      description: |
+        Image version where you are experiencing the issue. Where to find image version in build logs:
+        1. For GitHub Actions, under "Set up job" -> "Virtual Environment" -> "Version".
+        2. For Azure DevOps, under "Initialize job" -> "Virtual Environment" -> "Version".
+        
+        If you have a public example, please, provide a link to the failed build.
+    validations:
+      required: true
+  - type: input
+    attributes:
+      label: Is it regression?
+      description: If yes, please, provide the latest image version where the issue didn't persist, and a link to the latest successful build.
+  - type: textarea
+    attributes:
+      label: Expected behavior
+      description: A description of what you expected to happen.
+  - type: textarea
+    attributes:
+      label: Actual behavior
+      description: A description of what is actually happening.
+  - type: textarea
+    attributes:
+      label: Repro steps
+      placeholder: |
+        A description with steps to reproduce the issue.
+        1. Step 1
+        2. Step 2
+    validations: 
+        required: true

.github/ISSUE_TEMPLATE/config.yml

@@ -0,0 +1 @@
+blank_issues_enabled: false

.github/ISSUE_TEMPLATE/tool-request.md

@@ -1,43 +0,0 @@
----
-name: Tool request
-about: Request a new tool or update to a tool
-title: Update/Add [tool name]
-labels: feature request, needs triage
-assignees: ''
-
----
-
-**Tool information**
-- Tool name: <!--- Name -->
-- Tool license: <!--- Type of licensing for desired tool -->
-- Add or update? <!--- Add or update? -->
-- Desired version: <!--- Let us know if you're requesting a specific version, dev/RC, whatever is latest, etc. -->
-- Approximate size: <!--- Leave blank if not known -->
-- If this is an add request:
-  - Brief description of tool: <!--- Description -->
-  - URL for tool's homepage: <!--- URL -->
-  - Provide a basic test case to validate the tool's functionality: <!-- Code sample -->
-
-**Area for Triage**:
-<!-- See https://github.com/actions/virtual-environments/tree/main/triage-rules.yml for areas -->
-
-**Question, Bug, or Feature?**:
-<!-- Choose "Question", "Bug", or "Feature" -->
-
-**Virtual environments affected**
-- [ ] Ubuntu 16.04
-- [ ] Ubuntu 18.04
-- [ ] Ubuntu 20.04
-- [ ] macOS 10.15
-- [ ] macOS 11.0
-- [ ] Windows Server 2016 R2
-- [ ] Windows Server 2019
-
-**Can this tool be installed during the build?**
-<!--- If so, please provide a description with required steps.  -->
-
-**Tool installation time in runtime**
-<!--- How long does it take to install the tool?  -->
-
-**Are you willing to submit a PR?**
-<!--- We accept contributions! -->

.github/ISSUE_TEMPLATE/tool-request.yml

@@ -0,0 +1,75 @@
+name: Tool request
+description: Request a new tool or update to a tool
+title: Update/Add [tool name]
+labels: [feature request, needs triage]
+body:
+  - type: markdown
+    attributes:
+      value: "## Tool information"
+  - type: input
+    attributes:
+      label: Tool name
+    validations:
+      required: true
+  - type: input
+    attributes:
+      label: Tool license
+      description: Type of licensing for desired tool.
+    validations:
+      required: true
+  - type: checkboxes
+    attributes:
+      label: Add or update?
+      options:
+        - label: Add
+        - label: Update
+  - type: input
+    attributes:
+      label: Desired version
+      description: Let us know if you're requesting a specific version, dev/RC, whatever is latest, etc.
+    validations:
+      required: true
+  - type: input
+    attributes:
+      label: Approximate size
+      description: Leave blank if unknown.
+  - type: markdown
+    attributes:
+      value: "## If this is an add request"
+  - type: textarea
+    attributes:
+      label: Brief description of tool
+  - type: input
+    attributes:
+      label: URL for tool's homepage
+  - type: textarea
+    attributes:
+      label: Provide a basic test case to validate the tool's functionality. 
+      description: This will be automatically formatted into code.
+      render: bash
+  - type: checkboxes
+    attributes:
+      label: Virtual environments affected
+      options:
+        - label: Ubuntu 18.04
+        - label: Ubuntu 20.04
+        - label: macOS 10.15
+        - label: macOS 11
+        - label: Windows Server 2016
+        - label: Windows Server 2019
+        - label: Windows Server 2022
+    validations:
+      required: true
+  - type: textarea
+    attributes:
+      label: Can this tool be installed during the build?
+      description: If so, please provide a description with required steps. This will be automatically formatted into code.
+      render: bash
+  - type: input
+    attributes:
+      label: Tool installation time in runtime
+      description: How long does it take to install the tool?
+  - type: input
+    attributes:
+      label: Are you willing to submit a PR?
+      description: We accept contributions!

.github/workflows/create_pull_request.yml

@@ -21,15 +21,29 @@ jobs:
         git push origin ${{ github.event.client_payload.ReleaseBranchName }}-docs
 
     - name: Create pull request for ${{ github.event.client_payload.ReleaseBranchName }}
+      id: create-pr
       uses: actions/github-script@v2
       with:
         github-token: ${{secrets.GITHUB_TOKEN}}
         script: |
-          github.pulls.create({
+          let response = await github.pulls.create({
             owner: context.repo.owner,
             repo: context.repo.repo,
             title: "${{ github.event.client_payload.PullRequestTitle }}",
             head: "${{ github.event.client_payload.ReleaseBranchName }}-docs",
             base: "${{ github.event.client_payload.PullRequestBase }}",
             body: `${{ github.event.client_payload.PullRequestBody }}`
-          });
+          });
+          return response.data.number
+
+    - name: Request reviewers
+      uses: actions/github-script@v2
+      with:
+        github-token: ${{secrets.PRAPPROVAL_SECRET}}
+        script: |
+          github.pulls.requestReviewers({
+              owner: context.repo.owner,
+              repo: context.repo.repo,
+              pull_number: ${{ steps.create-pr.outputs.result }},
+              team_reviewers: ['virtual-environments-akvelon']
+          })

.github/workflows/issue-triager.yml

@@ -1,44 +0,0 @@
-# Adapted from: https://github.com/microsoft/azure-pipelines-tasks/blob/master/.github/workflows/blank.yml
-# This action labels and assigns newly opened issues
-
-name: Issue triager
-on:
-  issues:
-    types: [opened]
-
-jobs:
-  label:
-
-    runs-on: ubuntu-latest
-
-    steps:
-    - uses: actions/checkout@v1
-
-    - uses: damccorm/tag-ur-it@master
-      with:
-        repo-token: "${{ secrets.GITHUB_TOKEN }}"
-        configuration-path: "./triage-rules.yml"
-
-    - if: always()
-      uses: actions/github-script@0.4.0
-      with:
-        github-token: ${{secrets.GITHUB_TOKEN}}
-        script: |
-          const issueLabels = await github.issues.listLabelsOnIssue({
-            issue_number: context.issue.number,
-            owner: context.repo.owner,
-            repo: context.repo.repo
-          });
-
-          const isAnnouncement = issueLabels.data && issueLabels.data
-            .map(label => label.name)
-            .includes('Announcement');
-
-          if (!isAnnouncement) {
-            github.issues.addLabels({
-              issue_number: context.issue.number,
-              owner: context.repo.owner,
-              repo: context.repo.repo,
-              labels: ['needs triage']
-            })
-          }

.github/workflows/linter.yml

@@ -5,6 +5,10 @@ name: Linter
 on:
   pull_request:
     branches: [ main ]
+    paths:
+      - '**.json'
+      - '**.md'
+      - '**.sh'
 
 jobs:
   build:
@@ -14,15 +18,18 @@ jobs:
     steps:
       - name: Checkout Code
         uses: actions/checkout@v2
+        with:
+          fetch-depth: 0
 
       - name: Lint Code Base
-        uses: github/super-linter@v3
+        uses: github/super-linter/slim@v4
         env:
           VALIDATE_ALL_CODEBASE: false
           GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
           VALIDATE_JSON: true
-          VALIDATE_MD: true
+          VALIDATE_MARKDOWN: true
           DEFAULT_BRANCH: ${{ github.base_ref }}
+          FILTER_REGEX_EXCLUDE: .*images/*/.*-Readme.md
 
       - name: Checking shebang lines in MacOS and Ubuntu releases.
         run: ./images.CI/shebang-linter.ps1

CONTRIBUTING.md

@@ -15,7 +15,7 @@ Please note that this project is released with a [Contributor Code of Conduct][c
 1. [Fork][fork] and clone the repository
 1. Create a new branch: `git checkout -b my-branch-name`
 1. Make your changes, ensure that they include steps to install, validate post-install and update software report (please see [How to add new tool](CONTRIBUTING.md#how-to-add-new-tool) for details).
-1. Test your changes by [creating VHD and deploying a VM](help/CreateImageAndAzureResources.md).
+1. Test your changes by [creating VHD and deploying a VM](docs/create-image-and-azure-resources.md).
 1. Push to your fork and [submit a pull request][pr]
 
 Here are a few things you can do that will increase the likelihood of your pull request being accepted:

LICENSE

@@ -1,6 +1,6 @@
 MIT License
 
-Copyright (c) 2020 GitHub
+Copyright (c) 2021 GitHub
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal

README.md

@@ -1,47 +1,37 @@
 # GitHub Actions Virtual Environments
-This repository contains the source used to create the [virtual environments](https://help.github.com/en/actions/reference/virtual-environments-for-github-hosted-runners) for GitHub Actions hosted runners, as well as the VM images of [Microsoft-hosted agents](https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops#use-a-microsoft-hosted-agent) used for Azure Pipelines. To file bug reports, or request that tools be added/updated, please [open an issue using the appropriate template](https://github.com/actions/virtual-environments/issues/new/choose). To build a VM machine from this repo's source, see the [instructions](./help/CreateImageAndAzureResources.md).
+This repository contains the source used to create the [virtual environments](https://help.github.com/en/actions/reference/virtual-environments-for-github-hosted-runners) for GitHub Actions hosted runners, as well as the VM images of [Microsoft-hosted agents](https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops#use-a-microsoft-hosted-agent) used for Azure Pipelines. To build a VM machine from this repo's source, see the [instructions](docs/create-image-and-azure-resources.md).
+
+How to get in touch with us:
+- To file a bug report, or request tools to be added/updated, please [open an issue using the appropriate template](https://github.com/actions/virtual-environments/issues/new/choose)
+- If you want to share your thoughts about image configuration, installed software, or bring some idea, please, create a new topic in a [discussions section](https://github.com/actions/virtual-environments/discussions) for a corresponding category. Before making a new discussion please make sure no similar topics were created earlier.
 
 For general questions about using the virtual environments or writing your Actions workflow, please open requests in the [GitHub Actions Community Forum](https://github.community/c/github-actions/41).
 
 ## Available Environments
 | Environment | YAML Label | Included Software | Latest Release & Rollout Progress |
 | --------------------|---------------------|--------------------|---------------------|
-| Ubuntu 20.04 | `ubuntu-20.04` | [ubuntu-20.04] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu20&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu20&redirect=1)
-| Ubuntu 18.04 | `ubuntu-latest` or `ubuntu-18.04` | [ubuntu-18.04] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu18&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu18&redirect=1)
-| Ubuntu 16.04 | `ubuntu-16.04` | [ubuntu-16.04] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu16&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu16&redirect=1) |
-| macOS 11.0 | `macos-11.0` | [macOS-11.0] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=macos-11.0&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=macos-11.0&redirect=1)
+| Ubuntu 20.04 | `ubuntu-latest` or `ubuntu-20.04` | [ubuntu-20.04] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu20&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu20&redirect=1)
+| Ubuntu 18.04 | `ubuntu-18.04` | [ubuntu-18.04] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu18&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=ubuntu18&redirect=1)
+| macOS 11 | `macos-11` | [macOS-11] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=macos-11&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=macos-11&redirect=1)
 | macOS 10.15 | `macos-latest` or `macos-10.15` | [macOS-10.15] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=macos-10.15&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=macos-10.15&redirect=1)
+| Windows Server 2022 | `windows-2022` | [windows-2022] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=windows-2022&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=windows-2022&redirect=1) |
 | Windows Server 2019 | `windows-latest` or `windows-2019` | [windows-2019] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=windows-2019&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=windows-2019&redirect=1)
 | Windows Server 2016 | `windows-2016` | [windows-2016] | [![](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=windows-2016&badge=1)](https://actionvirtualenvironmentsstatus.azurewebsites.net/api/status?imageName=windows-2016&redirect=1)
-```
-The Ubuntu 20.04 virtual environment is currently provided as a preview only.
-The "ubuntu-latest" YAML workflow label still uses the Ubuntu 18.04 virtual environment.
-```
-```
-The MacOS 11.0 virtual environment is currently provided as a preview only.
-The "macos-latest" YAML workflow label still uses the MacOS 10.15 virtual environment.
-```
+
+<b>Note:</b> Beta and Preview images are provided "as-is", "with all faults" and "as available" and are excluded from the service level agreement and warranty. Beta and Preview images may not be covered by customer support.
+
+***What images are available for GitHub Actions and Azure DevOps?***
+The availability of images for GitHub Actions and Azure DevOps is different. See documentation for more details:
+- [GitHub Actions](https://docs.github.com/en/free-pro-team@latest/actions/reference/specifications-for-github-hosted-runners#supported-runners-and-hardware-resources)
+- [Azure DevOps](https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops&tabs=yaml#software)
+
+***What image version is used in my build?*** Usually, image deployment takes 3-4 days, and documentation in the `main` branch is only updated when deployment is finished. To find out which image version and what software versions are used in a specific build, see `Set up job` (GitHub Actions) or `Initialize job` (Azure DevOps) step log.
 
 ***Looking for other Linux distributions?*** We do not plan to offer other Linux distributions. We recommend using Docker if you'd like to build using other distributions with the hosted virtual environments. Alternatively, you can leverage [self-hosted runners] and fully customize your environment to your needs.
 
 ***How to contribute to macOS source?*** macOS source lives in this repository and available for everyone. However, MacOS image-generation CI doesn't support external contributions yet so we are not able to accept pull-requests for now.
 We are in the process of preparing MacOS CI to accept contributions. Until then, we appreciate your patience and ask you continue to make tool requests by filing issues.
 
-## Software Guidelines
-In general, these are the guidelines we consider when deciding what to pre-install:
-
-- Tools and ecosystems that are broadly popular and widely-used will be given priority.
-- Recent versions of tools will be given priority over older versions.
-- Tools and versions that are deprecated or have reached end-of-life will not be added.
-- Tools and versions will typically be removed 6 months after they are deprecated or have reached end-of-life.
-- If a tool can be installed during the build, we will evaluate how much time is saved
- and how much space is used by having the tool pre-installed.
-- MIT, Apache, and GNU licenses are ok, anything else we'll have to check with lawyers.
-- If a tool takes much space we will evaluate space usage and provide a decision if this tool can be pre-installed.
-- If a tool requires the support of more than one version, we will consider the cost of this maintenance, how often new versions bring dangerous updates.
-
-**Note:** For new tools, please, create an issue and get an approval from us to add this tool to the image before creating the pull request.
-
 ## Updates to virtual environments
 *Cadence*
 
@@ -51,15 +41,19 @@ we pin the tool to specific version(s).
 
 *Following Along / Change Notifications*
 
-* **High Impact Changes** (ex. breaking changes, new or deprecated environments) will be posted to the GitHub Changelog on our [blog](https://github.blog/changelog/) and on [twitter](https://twitter.com/GHchangelog).  
-Low Impact changes will be pinned in this repository and marked with the [Announcement](https://github.com/actions/virtual-environments/labels/Announcement) label.
-* **Regular Weekly Rhythm** can be followed by watching [Releases](https://github.com/actions/virtual-environments/releases) to see when we generate candidate environments or deploy new ones. You can also track upcoming changes using the [awaiting-deployment](https://github.com/actions/virtual-environments/labels/awaiting-deployment) label.
+* **High Impact Changes** (ex. breaking changes, new or deprecated environments) will be posted to the GitHub Changelog on our [blog](https://github.blog/changelog/) and on [twitter](https://twitter.com/GHchangelog).
+* **Low Impact Changes** will be pinned in this repository and marked with the [Announcement](https://github.com/actions/virtual-environments/labels/Announcement) label.
+* **Regular Weekly Rhythm** can be followed by watching [Releases](https://github.com/actions/virtual-environments/releases). Pre-release is created when deployment is started. As soon as deployment is finished, it is converted to release.
+You can also track upcoming changes using the [awaiting-deployment](https://github.com/actions/virtual-environments/labels/awaiting-deployment) label.
 
-[ubuntu-20.04]: https://github.com/actions/virtual-environments/blob/main/images/linux/Ubuntu2004-README.md
-[ubuntu-18.04]: https://github.com/actions/virtual-environments/blob/main/images/linux/Ubuntu1804-README.md
-[ubuntu-16.04]: https://github.com/actions/virtual-environments/blob/main/images/linux/Ubuntu1604-README.md
-[Windows-2019]: https://github.com/actions/virtual-environments/blob/main/images/win/Windows2019-Readme.md
+[ubuntu-20.04]: https://github.com/actions/virtual-environments/blob/main/images/linux/Ubuntu2004-Readme.md
+[ubuntu-18.04]: https://github.com/actions/virtual-environments/blob/main/images/linux/Ubuntu1804-Readme.md
+[windows-2022]: https://github.com/actions/virtual-environments/blob/main/images/win/Windows2022-Readme.md
+[windows-2019]: https://github.com/actions/virtual-environments/blob/main/images/win/Windows2019-Readme.md
 [windows-2016]: https://github.com/actions/virtual-environments/blob/main/images/win/Windows2016-Readme.md
+[macOS-11]: https://github.com/actions/virtual-environments/blob/main/images/macos/macos-11-Readme.md
 [macOS-10.15]: https://github.com/actions/virtual-environments/blob/main/images/macos/macos-10.15-Readme.md
-[macOS-11.0]: https://github.com/actions/virtual-environments/blob/main/images/macos/macos-11.0-Readme.md
 [self-hosted runners]: https://help.github.com/en/actions/hosting-your-own-runners
+
+## Software and image guidelines
+To learn more about tools and images support policy, see the [guidelines](./docs/software-and-images-guidelines.md).

_config.yml

@@ -1 +0,0 @@
-theme: jekyll-theme-slate

docs/create-image-and-azure-resources.md

@@ -1,5 +1,5 @@
 # Virtual-Environments
-The virtual-environments project uses [Packer](https://www.packer.io/) to generate disk images for the following platforms: Windows 2016/2019, Ubuntu 16.04/18.04/20.04. 
+The virtual-environments project uses [Packer](https://www.packer.io/) to generate disk images for the following platforms: Windows 2016/2019/2022, Ubuntu 18.04/20.04. 
 Each image is configured through a JSON template that Packer understands and which specifies where to build the image (Azure in this case), and what scripts to run to install software and prepare the disk.
 The Packer process initializes a connection to Azure subscription via Azure CLI, and automatically creates the temporary Azure resources required to build the source VM(temporary resource group, network interfaces, and VM from the "clean" image specified in the template). 
 If the VM deployment succeeds, the build agent connects to the VM and starts to execute installation steps from the JSON template.
@@ -11,12 +11,11 @@ After successful image generation, a snapshot of the temporary VM will be conver
 - `OS` - Windows/Linux
 - `packer` - Can be downloaded from https://www.packer.io/downloads
 - `PowerShell 5.0 or higher` or `PSCore` for linux distributes.
-- `Azure CLI ` - https://docs.microsoft.com/en-us/cli/azure/install-azure-cli?view=azure-cli-latest
-- `Azure Powershell module` - https://docs.microsoft.com/en-us/powershell/azure/install-az-ps?view=azps-4.6.1
+- `Azure CLI ` - https://docs.microsoft.com/en-us/cli/azure/install-azure-cli
+- `Azure Az Powershell module` - https://docs.microsoft.com/en-us/powershell/azure/install-az-ps
 - `Git for Windows` - https://gitforwindows.org/
 
-### Azure DevOps self-hosted pool requirements
-To connect to a temporary VM packer use WinRM or SSH connections on public IP interfaces.
+> To connect to a temporary VM packer uses WinRM or SSH connections on public IP interfaces.
 If you use a build agent located in an Azure subscription, please make sure that HTTPS/SSH ports are allowed for incoming/outgoing connections.
 In case of firewall restrictions, prohibiting connections from public addresses, private virtual network resources can be deployed and passed as arguments to the packer. This approach allows virtual machines to use private connections inside VLAN.
 
@@ -33,6 +32,11 @@ Download `packer` from https://www.packer.io/downloads, or install it via Chocol
 choco install packer
 ```
 
+Install the Azure Az PowerShell module - https://docs.microsoft.com/en-us/powershell/azure/install-az-ps.
+```
+Install-Module -Name Az -Repository PSGallery -Force
+```
+
 Install Azure CLI - https://docs.microsoft.com/en-us/cli/azure/install-azure-cli-windows?view=azure-cli-latest&tabs=azure-cli.
 ```
 Invoke-WebRequest -Uri https://aka.ms/installazurecliwindows -OutFile .\AzureCLI.msi; Start-Process msiexec.exe -Wait -ArgumentList '/I AzureCLI.msi /quiet'; rm .\AzureCLI.msi
@@ -51,13 +55,13 @@ Set-Location C:\virtual-environments
 
 Import-Module .\helpers\GenerateResourcesAndImage.ps1
 
-GenerateResourcesAndImage -SubscriptionId {YourSubscriptionId} -ResourceGroupName "myTestResourceGroup" -ImageGenerationRepositoryRoot "$pwd" -ImageType Ubuntu1604 -AzureLocation "East US"
+GenerateResourcesAndImage -SubscriptionId {YourSubscriptionId} -ResourceGroupName "myTestResourceGroup" -ImageGenerationRepositoryRoot "$pwd" -ImageType Ubuntu1804 -AzureLocation "East US"
 ```
 Where:
 - `SubscriptionId` - The Azure subscription Id where resources will be created.
 - `ResourceGroupName` - The Azure resource group name where the Azure resources will be created.
 - `ImageGenerationRepositoryRoot` - The root path of the image generation repository source.
-- `ImageType` - The type of the image being generated. Valid options are: "Windows2016", "Windows2019", "Ubuntu1604", "Ubuntu1804", "Ubuntu2004".
+- `ImageType` - The type of the image being generated. Valid options are: "Windows2016", "Windows2019", "Windows2022", "Ubuntu1804", "Ubuntu2004".
 - `AzureLocation` - The location of the resources being created in Azure. For example "East US".
 
 The function automatically creates all required Azure resources and kicks off packer image generation for the selected image type.
@@ -105,7 +109,6 @@ The Packer template includes `variables` section containing user variables used
 - `virtual_network_resource_group_name` - If `virtual_network_name` is set, this value may also be set. If `virtual_network_name` is set, and this value is not set the builder attempts to determine the resource group containing the virtual network. If the resource group cannot be found, or it cannot be disambiguated, this value should be set.
 - `virtual_network_subnet_name` - If `virtual_network_name` is set, this value may also be set. If `virtual_network_name` is set, and this value is not set the builder attempts to determine the subnet to use with the virtual network. If the subnet cannot be found, or it cannot be disambiguated, this value should be set.
 - `capture_name_prefix` - VHD prefix. The final artifacts will be named PREFIX-osDisk.UUID and PREFIX-vmTemplate.UUID.
-- `github_feed_token` - Github PAT. Required for NPM toolcache installation. Will be depricated soon.
 
 ### Builder variables
 The `builders` section contains variables for the `azure-arm` builder used in the project. Most of the builder variables are inherited from the `user variables` section, however, the variables can be overwritten to adjust image-generation performance.
@@ -123,4 +126,45 @@ Generated tool versions and details can be found in related projects:
 - [Python](https://github.com/actions/python-versions/)
 - [Go](https://github.com/actions/go-versions)
 - [Node](https://github.com/actions/node-versions)
-- [Boost](https://github.com/actions/boost-versions)
+
+### Post-generation scripts
+
+> :warning: These scripts are intended to run on a VM deployed in Azure
+
+The user, created during the image generation, does not exist in the result VHD hence some configuration files related to the user's home directory need to be changed as well as the file permissions for some directories. Scripts for that are located in the `post-generation` folder in the repository:
+- Windows: https://github.com/actions/virtual-environments/tree/main/images/win/post-generation
+- Linux: https://github.com/actions/virtual-environments/tree/main/images/linux/post-generation
+
+**Note:** The default user for Linux should have `sudo privileges`.
+
+The scripts are copied to the VHD during the image generation process to the following paths:
+- Windows: `C:\post-generation`
+- Linux:  `/opt/post-generation` 
+
+#### Running scripts
+
+##### Ubuntu
+
+        sudo su -c "find /opt/post-generation -mindepth 1 -maxdepth 1 -type f -name '*.sh' -exec bash {} \;"
+
+##### Windows
+
+        Get-ChildItem C:\post-generation -Filter *.ps1 | ForEach-Object { & $_.FullName }
+
+#### Script details
+
+##### Ubuntu
+
+- **cleanup-logs.sh** - removes all build process logs from the machine
+- **environment-variables.sh** - replaces `$HOME` with the default user's home directory for environmental variables related to the default user home directory
+- **homebrew-permissions.sh** - Resets homebrew repository directory by running `git reset --hard` to make the working tree clean after chmoding /home and changes the repository directory owner to the current user
+- **rust-permissions.sh** - fixes permissions for the Rust folder. Detailed issue explanation is provided in [virtual-environments/issues/572](https://github.com/actions/virtual-environments/issues/572).
+
+##### Windows
+
+- **Choco.ps1** - contains dummy command to cleanup orphaned packages to avoid initial delay for future choco commands
+- **Dotnet.ps1** - adds `$env:USERPROFILE\.dotnet\tools` directory to the PATH
+- **InternetExplorerConfiguration** - turns off the Internet Explorer Enhanced Security feature
+- **Msys2FirstLaunch.ps1** - initializes bash user profile in MSYS2
+- **RustJunction.ps1** - creates Rust junction points to cargo and rustup folders
+- **VSConfiguration.ps1** - performs initial Visual Studio configuration

docs/debugging-failed-builds.md

@@ -1,27 +1,27 @@
-# Debugging Failed Packer Builds
-
-## Step 1: Run packer build `-on-error=ask`
-When you run the `packer build` command, give it the `-on-error=ask` flag.
-By default, `packer build` will delete the resource group as soon as the build fails.
-`-on-error=ask` will pause it and wait for your input so you have time to remote in to the VM and diagnose the failure.
-
-When the build fails, you will see this:
-
-![Ask on error screenshot](/help/resources/askOnError.png "Ask on error screenshot")
-
-## Step 2: Find the resource group name in the build log
-At the beginning of the build log (written to console), find the resource group name for the VM:
-
-![Resource group from log screenshot](/help/resources/resourceGroupName.png "Resource group from log screenshot")
-
-Log into the Azure Portal.  Find that resource group under `Resource groups`.  You should see the resources for the Packer build:
-
-![Packer resource group in Azure screenshot](/help/resources/packerResourceGroup.png "Packer resource group in Azure screenshot")
-
-## Step 3: Connect to the VM
-Select the VM in the resource group.  Click `Connect:`
-
-This will download an RDP file.  Open that and enter the credentials found in the JSON file you pass to `packer build`:
-
-![VM credentials screenshot](/help/resources/vmCredentials.png "VM credentials screenshot")
-
+# Debugging Failed Packer Builds
+
+## Step 1: Run packer build `-on-error=ask`
+When you run the `packer build` command, give it the `-on-error=ask` flag.
+By default, `packer build` will delete the resource group as soon as the build fails.
+`-on-error=ask` will pause it and wait for your input so you have time to remote in to the VM and diagnose the failure.
+
+When the build fails, you will see this:
+
+![Ask on error screenshot](/docs/resources/askOnError.png "Ask on error screenshot")
+
+## Step 2: Find the resource group name in the build log
+At the beginning of the build log (written to console), find the resource group name for the VM:
+
+![Resource group from log screenshot](/docs/resources/resourceGroupName.png "Resource group from log screenshot")
+
+Log into the Azure Portal.  Find that resource group under `Resource groups`.  You should see the resources for the Packer build:
+
+![Packer resource group in Azure screenshot](/docs/resources/packerResourceGroup.png "Packer resource group in Azure screenshot")
+
+## Step 3: Connect to the VM
+Select the VM in the resource group.  Click `Connect:`
+
+This will download an RDP file.  Open that and enter the credentials found in the JSON file you pass to `packer build`:
+
+![VM credentials screenshot](/docs/resources/vmCredentials.png "VM credentials screenshot")
+

docs/software-and-images-guidelines.md

@@ -0,0 +1,38 @@
+# Software and image guidelines
+
+## Software preinstallation policy
+In general, these are the guidelines we consider when deciding what to pre-install:
+
+- Tools and ecosystems that are broadly popular and widely-used will be given priority.
+- Recent versions of tools will be given priority over older versions.
+- Tools and versions that are deprecated or have reached end-of-life will not be added.
+- If a tool can be installed during the build, we will evaluate how much time is saved
+ and how much space is used by having the tool pre-installed.
+- MIT, Apache, and GNU licenses are ok, anything else we'll have to check with lawyers.
+- If a tool takes much space we will evaluate space usage and provide a decision if this tool can be pre-installed.
+- If a tool requires the support of more than one version, we will consider the cost of this maintenance, how often new versions bring dangerous updates.
+
+**Note:** For new tools, please, create an issue and get an approval from us to add this tool to the image before creating the pull request.
+
+## Software and images support policy
+These are the guidelines we follow in software and images supporting routine:
+- Tools and versions will typically be removed 6 months after they are deprecated or have reached end-of-life.
+- We support at least 2 latest OS versions (LTS only for Ubuntu) and initiate deprecation process for the oldest one when image usage drops below 5%.
+- The images generally contain the latest versions of packages installed except for Ubuntu LTS where we rely on the Canonical-provided repositories mostly.
+- Popular tools can have several versions installed side-by-side with the following strategy:
+
+| Tool name | Installation strategy |
+|-----------|-----------------------|
+| Docker images | not more than 3 latest LTS OS\tool versions. New images or new versions of current images are added using the standard tool request process |
+| Java      | all LTS versions |
+| Node.js   | 3 latest LTS versions |
+| Go        | 3 latest minor versions |
+| Python <br/> Ruby | 5 most popular `major.minor` versions |
+| PyPy      | 3 most popular `major.minor` versions |
+| .NET Core | 2 latest LTS versions and 1 latest version. For each feature version only latest patch is installed |
+| GCC <br/> GNU Fortran <br/> Clang <br/> GNU C++ | 3 latest major versions |
+| Android NDK | 1 latest non-LTS, 2 latest LTS versions |
+| Xcode     | - all OS compatible versions side-by-side <br/> - for beta, GM versions - latest beta only <br/> - old patch versions are deprecated in 3 months |
+
+## Software default versions update policy for tools with multiple versions installed
+In general, once a new version is installed on the image, we announce the default version update 2 weeks prior to deploying it to give time to adapt to upcoming changes. For potentially dangerous updates, we can extend the timeline up to 1 month between the announcement and deployment.

helpers/CreateAzureVMFromPackerTemplate.ps1

@@ -48,21 +48,22 @@ Function CreateAzureVMFromPackerTemplate {
     )
 
     $vmSize = "Standard_DS2_v2"
-    $vnetName = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper()
-    $subnetName = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper()
-    $nicName = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper()
-    $publicIpName = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper()
+    $guid = [System.GUID]::NewGuid().ToString().ToUpper()
+    $vnetName = $env:UserName + "vnet-" + $guid
+    $subnetName = $env:UserName + "subnet-" + $guid
+    $nicName = $env:UserName + "nic-" + $guid
+    $publicIpName = $env:UserName + "pip-" +  $guid
 
     Write-Host "Creating a virtual network and subnet"
-    ($vnet = az network vnet create -g $ResourceGroupName -l $AzureLocation -n $vnetName --address-prefixes 10.0.0.0/16 --subnet-name $subnetName --subnet-prefixes 10.0.1.0/24 --subscription $subscriptionId)
+    ($vnet = az network vnet create -g $ResourceGroupName -l $AzureLocation -n $vnetName --address-prefixes 10.0.0.0/16 --subnet-name $subnetName --subnet-prefixes 10.0.1.0/24 --subscription $subscriptionId -o json)
     $subnetId = ($vnet | ConvertFrom-Json).newVNet.subnets[0].id
 
     Write-Host "`nCreating a network interface controller (NIC)"
-    ($nic = az network nic create -g $ResourceGroupName -l $AzureLocation -n $nicName --subnet $subnetId --subscription $subscriptionId)
+    ($nic = az network nic create -g $ResourceGroupName -l $AzureLocation -n $nicName --subnet $subnetId --subscription $subscriptionId -o json)
     $networkId = ($nic | ConvertFrom-Json).NewNIC.id
 
     Write-Host "`nCreating a public IP address"
-    ($publicIp = az network public-ip create -g $ResourceGroupName -l $AzureLocation -n $publicIpName --allocation-method Static --sku Standard --version IPv4 --subscription $subscriptionId)
+    ($publicIp = az network public-ip create -g $ResourceGroupName -l $AzureLocation -n $publicIpName --allocation-method Static --sku Standard --version IPv4 --subscription $subscriptionId -o json)
     $publicIpId = ($publicIp | ConvertFrom-Json).publicIp.id
 
     Write-Host "`nAdding the public IP to the NIC"
@@ -70,4 +71,6 @@ Function CreateAzureVMFromPackerTemplate {
 
     Write-Host "`nCreating the VM"
     az group deployment create -g $ResourceGroupName -n $VirtualMachineName --subscription $subscriptionId --template-file $templateFilePath --parameters vmSize=$vmSize vmName=$VirtualMachineName adminUserName=$AdminUsername adminPassword=$AdminPassword networkInterfaceId=$networkId
+    
+    Write-Host "`nCreated in $(ResourceGroupName):`n  vnet $(vnetName)`n  subnet $(subnetName)`n  nic $(nicName)`n  publicip $(publicIpName)`n  vm $(VirtualMachineName)"
 }

helpers/GenerateResourcesAndImage.ps1

@@ -3,7 +3,7 @@ $ErrorActionPreference = 'Stop'
 enum ImageType {
     Windows2016 = 0
     Windows2019 = 1
-    Ubuntu1604 = 2
+    Windows2022 = 2
     Ubuntu1804 = 3
     Ubuntu2004 = 4
 }
@@ -23,8 +23,8 @@ Function Get-PackerTemplatePath {
         ([ImageType]::Windows2019) {
             $relativeTemplatePath = Join-Path "win" "windows2019.json"
         }
-        ([ImageType]::Ubuntu1604) {
-            $relativeTemplatePath = Join-Path "linux" "ubuntu1604.json"
+        ([ImageType]::Windows2022) {
+            $relativeTemplatePath = Join-Path "win" "windows2022.json"
         }
         ([ImageType]::Ubuntu1804) {
             $relativeTemplatePath = Join-Path "linux" "ubuntu1804.json"
@@ -72,7 +72,7 @@ Function GenerateResourcesAndImage {
             The root path of the image generation repository source.
 
         .PARAMETER ImageType
-            The type of the image being generated. Valid options are: {"Windows2016", "Windows2019", "Ubuntu1604", "Ubuntu1804"}.
+            The type of the image being generated. Valid options are: {"Windows2016", "Windows2019", "Windows2022", "Ubuntu1804", "Ubuntu2004"}.
 
         .PARAMETER AzureLocation
             The location of the resources being created in Azure. For example "East US".
@@ -80,11 +80,24 @@ Function GenerateResourcesAndImage {
         .PARAMETER Force
             Delete the resource group if it exists without user confirmation.
 
-        .PARAMETER GithubFeedToken
-            GitHub PAT to download tool packages from GitHub Package Registry
+        .PARAMETER AzureClientId
+            Client id needs to be provided for optional authentication via service principal. Example: "11111111-1111-1111-1111-111111111111"
+
+        .PARAMETER AzureClientSecret
+            Client secret needs to be provided for optional authentication via service principal. Example: "11111111-1111-1111-1111-111111111111"
+
+        .PARAMETER AzureTenantId
+            Tenant needs to be provided for optional authentication via service principal. Example: "11111111-1111-1111-1111-111111111111"
+
+        .PARAMETER RestrictToAgentIpAddress
+            If set, access to the VM used by packer to generate the image is restricted to the public IP address this script is run from. 
+            This parameter cannot be used in combination with the virtual_network_name packer parameter.
+        
+        .PARAMETER AllowBlobPublicAccess
+            The Azure storage account will be created with this option.
 
         .EXAMPLE
-            GenerateResourcesAndImage -SubscriptionId {YourSubscriptionId} -ResourceGroupName "shsamytest1" -ImageGenerationRepositoryRoot "C:\virtual-environments" -ImageType Ubuntu1604 -AzureLocation "East US"
+            GenerateResourcesAndImage -SubscriptionId {YourSubscriptionId} -ResourceGroupName "shsamytest1" -ImageGenerationRepositoryRoot "C:\virtual-environments" -ImageType Ubuntu1804 -AzureLocation "East US"
     #>
     param (
         [Parameter(Mandatory = $True)]
@@ -100,22 +113,33 @@ Function GenerateResourcesAndImage {
         [Parameter(Mandatory = $False)]
         [int] $SecondsToWaitForServicePrincipalSetup = 30,
         [Parameter(Mandatory = $False)]
-        [string] $GithubFeedToken,
+        [string] $AzureClientId,
         [Parameter(Mandatory = $False)]
-        [Switch] $Force
+        [string] $AzureClientSecret,
+        [Parameter(Mandatory = $False)]
+        [string] $AzureTenantId,
+        [Parameter(Mandatory = $False)]
+        [Switch] $RestrictToAgentIpAddress,
+        [Parameter(Mandatory = $False)]
+        [Switch] $Force,
+        [Parameter(Mandatory = $False)]
+        [bool] $AllowBlobPublicAccess = $False,
+        [Parameter(Mandatory = $False)]
+        [bool] $EnableHttpsTrafficOnly = $False
     )
 
-    if (([string]::IsNullOrEmpty($GithubFeedToken)))
-    {
-        Write-Error "'-GithubFeedToken' parameter is not specified. You have to specify valid GitHub PAT to download tool packages from GitHub Package Registry"
-        exit 1
-    }
-
     $builderScriptPath = Get-PackerTemplatePath -RepositoryRoot $ImageGenerationRepositoryRoot -ImageType $ImageType
-    $ServicePrincipalClientSecret = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper();
-    $InstallPassword = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper();
+    $ServicePrincipalClientSecret = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper()
+    $InstallPassword = $env:UserName + [System.GUID]::NewGuid().ToString().ToUpper()
 
-    Connect-AzAccount
+    if ([string]::IsNullOrEmpty($AzureClientId))
+    {
+        Connect-AzAccount
+    } else {
+        $AzSecureSecret = ConvertTo-SecureString $AzureClientSecret -AsPlainText -Force
+        $AzureAppCred = New-Object System.Management.Automation.PSCredential($AzureClientId, $AzSecureSecret)
+        Connect-AzAccount -ServicePrincipal -Credential $AzureAppCred -Tenant $AzureTenantId
+    }
     Set-AzContext -SubscriptionId $SubscriptionId
 
     $alreadyExists = $true;
@@ -169,23 +193,57 @@ Function GenerateResourcesAndImage {
     $storageAccountName = $storageAccountName.Replace("-", "").Replace("_", "").Replace("(", "").Replace(")", "").ToLower()
     $storageAccountName += "001"
 
-    New-AzStorageAccount -ResourceGroupName $ResourceGroupName -AccountName $storageAccountName -Location $AzureLocation -SkuName "Standard_LRS"
+    New-AzStorageAccount -ResourceGroupName $ResourceGroupName -AccountName $storageAccountName -Location $AzureLocation -SkuName "Standard_LRS" -AllowBlobPublicAccess $AllowBlobPublicAccess -EnableHttpsTrafficOnly $EnableHttpsTrafficOnly
 
-    $spDisplayName = [System.GUID]::NewGuid().ToString().ToUpper()
-    $credentialProperties = @{ StartDate=Get-Date; EndDate=Get-Date -Year 2024; Password=$ServicePrincipalClientSecret }
-    $credentials = New-Object -TypeName Microsoft.Azure.Commands.ActiveDirectory.PSADPasswordCredential -Property $credentialProperties
-    $sp = New-AzADServicePrincipal -DisplayName $spDisplayName -PasswordCredential $credentials
+    if ([string]::IsNullOrEmpty($AzureClientId)) {
+        # Interactive authentication: A service principal is created during runtime.
+        $spDisplayName = [System.GUID]::NewGuid().ToString().ToUpper()
+        $startDate = Get-Date
+        $endDate = $startDate.AddYears(1)
 
-    $spAppId = $sp.ApplicationId
-    $spClientId = $sp.ApplicationId
-    $spObjectId = $sp.Id
-    Start-Sleep -Seconds $SecondsToWaitForServicePrincipalSetup
+        if ('Microsoft.Azure.Commands.ActiveDirectory.PSADPasswordCredential' -as [type]) {
+            $credentials = [Microsoft.Azure.Commands.ActiveDirectory.PSADPasswordCredential]@{
+                StartDate = $startDate
+                EndDate = $endDate
+                Password = $ServicePrincipalClientSecret
+            }
+            $sp = New-AzADServicePrincipal -DisplayName $spDisplayName -PasswordCredential $credentials
+            $spClientId = $sp.ApplicationId
+            $azRoleParam = @{
+                RoleDefinitionName = "Contributor"
+                ServicePrincipalName = $spClientId
+            }
+        }
 
-    New-AzRoleAssignment -RoleDefinitionName Contributor -ServicePrincipalName $spAppId
-    Start-Sleep -Seconds $SecondsToWaitForServicePrincipalSetup
-    $sub = Get-AzSubscription -SubscriptionId $SubscriptionId
-    $tenantId = $sub.TenantId
-    # "", "Note this variable-setting script for running Packer with these Azure resources in the future:", "==============================================================================================", "`$spClientId = `"$spClientId`"", "`$ServicePrincipalClientSecret = `"$ServicePrincipalClientSecret`"", "`$SubscriptionId = `"$SubscriptionId`"", "`$tenantId = `"$tenantId`"", "`$spObjectId = `"$spObjectId`"", "`$AzureLocation = `"$AzureLocation`"", "`$ResourceGroupName = `"$ResourceGroupName`"", "`$storageAccountName = `"$storageAccountName`"", "`$install_password = `"$install_password`"", ""
+        if ('Microsoft.Azure.PowerShell.Cmdlets.Resources.MSGraph.Models.ApiV10.MicrosoftGraphPasswordCredential' -as [type]) {
+            $credentials = [Microsoft.Azure.PowerShell.Cmdlets.Resources.MSGraph.Models.ApiV10.MicrosoftGraphPasswordCredential]@{
+                StartDateTime = $startDate
+                EndDateTime = $endDate
+            }
+            $sp = New-AzADServicePrincipal -DisplayName $spDisplayName
+            $appCred = New-AzADAppCredential -ApplicationId $sp.AppId -PasswordCredentials $credentials
+            $spClientId = $sp.AppId
+            $azRoleParam = @{
+                RoleDefinitionName = "Contributor"
+                PrincipalId = $sp.Id
+            }
+            $ServicePrincipalClientSecret = $appCred.SecretText
+        }
+
+        Start-Sleep -Seconds $SecondsToWaitForServicePrincipalSetup
+        New-AzRoleAssignment @azRoleParam
+        Start-Sleep -Seconds $SecondsToWaitForServicePrincipalSetup
+        $sub = Get-AzSubscription -SubscriptionId $SubscriptionId
+        $tenantId = $sub.TenantId
+        # "", "Note this variable-setting script for running Packer with these Azure resources in the future:", "==============================================================================================", "`$spClientId = `"$spClientId`"", "`$ServicePrincipalClientSecret = `"$ServicePrincipalClientSecret`"", "`$SubscriptionId = `"$SubscriptionId`"", "`$tenantId = `"$tenantId`"", "`$spObjectId = `"$spObjectId`"", "`$AzureLocation = `"$AzureLocation`"", "`$ResourceGroupName = `"$ResourceGroupName`"", "`$storageAccountName = `"$storageAccountName`"", "`$install_password = `"$install_password`"", ""
+    } else {
+        # Parametrized Authentication via given service principal: The service principal with the data provided via the command line
+        # is used for all authentication purposes.
+        $spClientId = $AzureClientId
+        $credentials = $AzureAppCred
+        $ServicePrincipalClientSecret = $AzureClientSecret
+        $tenantId = $AzureTenantId
+    }
 
     Get-LatestCommit -ErrorAction SilentlyContinue
 
@@ -194,16 +252,20 @@ Function GenerateResourcesAndImage {
         throw "'packer' binary is not found on PATH"
     }
 
+    if($RestrictToAgentIpAddress -eq $true) {
+        $AgentIp = (Invoke-RestMethod http://ipinfo.io/json).ip
+        Write-Host "Restricting access to packer generated VM to agent IP Address: $AgentIp"
+    }
+
     & $packerBinary build -on-error=ask `
         -var "client_id=$($spClientId)" `
         -var "client_secret=$($ServicePrincipalClientSecret)" `
         -var "subscription_id=$($SubscriptionId)" `
         -var "tenant_id=$($tenantId)" `
-        -var "object_id=$($spObjectId)" `
         -var "location=$($AzureLocation)" `
         -var "resource_group=$($ResourceGroupName)" `
         -var "storage_account=$($storageAccountName)" `
         -var "install_password=$($InstallPassword)" `
-        -var "github_feed_token=$($GithubFeedToken)" `
+        -var "allowed_inbound_ip_addresses=$($AgentIp)" `
         $builderScriptPath
-}
+}

images.CI/linux-and-win/azure-pipelines/image-generation.yml

@@ -22,7 +22,7 @@ jobs:
       filePath: ./images.CI/download-repo.ps1
       arguments: -RepoUrl $(CUSTOM_REPOSITORY_URL) `
                  -RepoBranch $(CUSTOM_REPOSITORY_BRANCH)
-    
+
   - task: PowerShell@2
     displayName: 'Set image template variables'
     inputs:
@@ -51,8 +51,8 @@ jobs:
                         -Location $(AZURE_LOCATION) `
                         -VirtualNetworkName $(BUILD_AGENT_VNET_NAME) `
                         -VirtualNetworkRG $(BUILD_AGENT_VNET_RESOURCE_GROUP) `
-                        -VirtualNetworkSubnet $(BUILD_AGENT_SUBNET_NAME) `
-                        -GitHubFeedToken $(GITHUB_TOKEN)
+                        -VirtualNetworkSubnet $(BUILD_AGENT_SUBNET_NAME)
+
     env:
       PACKER_LOG: 1
       PACKER_LOG_PATH: $(Build.ArtifactStagingDirectory)/packer-log.txt
@@ -92,8 +92,9 @@ jobs:
       targetType: filePath
       filePath: ./images.CI/linux-and-win/cleanup.ps1
       arguments: -ResourcesNamePrefix $(Build.BuildId) `
+                     -Image ${{ parameters.image_type }} `
+                     -StorageAccount $(AZURE_STORAGE_ACCOUNT) `
+                     -SubscriptionId $(AZURE_SUBSCRIPTION) `
                      -ClientId $(CLIENT_ID) `
                      -ClientSecret $(CLIENT_SECRET) `
-                     -Image ${{ parameters.image_type }} `
-                     -SubscriptionId $(AZURE_SUBSCRIPTION) `
                      -TenantId $(AZURE_TENANT)

images.CI/linux-and-win/azure-pipelines/ubuntu1804.yml

@@ -17,4 +17,4 @@ jobs:
 - template: image-generation.yml
   parameters:
     image_type: ubuntu1804
-    image_readme_name: Ubuntu1804-README.md
+    image_readme_name: Ubuntu1804-Readme.md

images.CI/linux-and-win/azure-pipelines/ubuntu2004.yml

@@ -17,4 +17,4 @@ jobs:
 - template: image-generation.yml
   parameters:
     image_type: ubuntu2004
-    image_readme_name: Ubuntu2004-README.md
+    image_readme_name: Ubuntu2004-Readme.md

images.CI/linux-and-win/azure-pipelines/windows2022.yml

@@ -16,5 +16,5 @@ pr:
 jobs:
 - template: image-generation.yml
   parameters:
-    image_type: ubuntu1604
-    image_readme_name: Ubuntu1604-README.md
+    image_type: windows2022
+    image_readme_name: Windows2022-Readme.md

images.CI/linux-and-win/build-image.ps1

@@ -2,7 +2,6 @@ param(
     [String] [Parameter (Mandatory=$true)] $TemplatePath,
     [String] [Parameter (Mandatory=$true)] $ClientId,
     [String] [Parameter (Mandatory=$true)] $ClientSecret,
-    [String] [Parameter (Mandatory=$true)] $GitHubFeedToken,
     [String] [Parameter (Mandatory=$true)] $ResourcesNamePrefix,
     [String] [Parameter (Mandatory=$true)] $Location,
     [String] [Parameter (Mandatory=$true)] $ResourceGroup,
@@ -44,7 +43,6 @@ packer build    -var "capture_name_prefix=$ResourcesNamePrefix" `
                 -var "client_id=$ClientId" `
                 -var "client_secret=$ClientSecret" `
                 -var "install_password=$InstallPassword" `
-                -var "github_feed_token=$GitHubFeedToken" `
                 -var "location=$Location" `
                 -var "resource_group=$ResourceGroup" `
                 -var "storage_account=$StorageAccount" `

images.CI/linux-and-win/cleanup.ps1

@@ -1,6 +1,7 @@
 param(
     [String] [Parameter (Mandatory=$true)] $Image,
     [String] [Parameter (Mandatory=$true)] $ResourcesNamePrefix,
+    [String] [Parameter (Mandatory=$true)] $StorageAccount,
     [String] [Parameter (Mandatory=$true)] $ClientId,
     [String] [Parameter (Mandatory=$true)] $ClientSecret,
     [String] [Parameter (Mandatory=$true)] $SubscriptionId,
@@ -13,9 +14,13 @@ $TempResourceGroupName = "${ResourcesNamePrefix}_${Image}"
 
 $groupExist = az group exists --name $TempResourceGroupName --subscription $SubscriptionId
 if ($groupExist -eq "true") {
+    $osDiskName = az group deployment list --resource-group $TempResourceGroupName --query "[].properties.parameters.osDiskName.value" -o tsv
     Write-Host "Found a match, deleting temporary files"
     az group delete --name $TempResourceGroupName --subscription $SubscriptionId --yes | Out-Null
-    Write-Host "Temporary group was deleted succesfully" -ForegroundColor Green
+    Write-Host "Temporary group was deleted succesfully"
+    Write-Host "Deleting OS disk"
+    az storage remove --account-name $StorageAccount -c "images" -n "$osDiskName.vhd" --only-show-errors | Out-Null
+    Write-Host "OS disk deleted"
 } else {
     Write-Host "No temporary groups found"
 }

images.CI/macos/anka/Anka.Helpers.psm1

@@ -0,0 +1,227 @@
+function Push-AnkaTemplateToRegistry {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $RegistryUrl,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $TagName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $TemplateName
+    )
+
+    # if registry uuid doesn't match than delete an image in registry
+    $images = anka --machine-readable registry --registry-path $RegistryUrl list | ConvertFrom-Json | ForEach-Object body
+    $images | Where-Object name -eq $TemplateName | ForEach-Object {
+        $id = $_.id
+        Show-StringWithFormat "Deleting '$TemplateName[$id]' VM and '$TagName' tag"
+        $uri = '{0}/registry/vm?id={1}' -f $RegistryUrl, $id
+        Invoke-WebRequest -Uri $uri -Method Delete | Out-Null
+    }
+
+    $command = "anka registry --registry-path $RegistryUrl push --force --tag $TagName $TemplateName"
+    Invoke-AnkaCommand -Command $command
+}
+
+function Get-AnkaVM {
+    param(
+        [string] $VMName
+    )
+
+    $command = "anka --machine-readable list"
+    if (-not [string]::IsNullOrEmpty($VMName)) {
+        $command = "anka --machine-readable show $VMName"
+    }
+    Invoke-AnkaCommand -Command $command | ConvertFrom-Json | Foreach-Object body
+}
+
+function Get-AnkaVMStatus {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName
+    )
+
+    $command = "anka --machine-readable list $VMName"
+    Invoke-AnkaCommand -Command $command | ConvertFrom-Json | Foreach-Object { $_.body.status }
+}
+
+function Get-AnkaVMIPAddress {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName
+    )
+
+    Get-AnkaVM -VMName $VMName | Foreach-Object ip
+}
+
+function Invoke-AnkaCommand {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $Command
+    )
+
+    $result = bash -c "$Command 2>&1" | Out-String
+    if ($LASTEXITCODE -ne 0) {
+        Write-Error "There is an error during command execution:`n$result"
+        exit 1
+    }
+    $result
+}
+
+function New-AnkaVMTemplate {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $InstallerPath,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $TemplateName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $TemplateUsername,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $TemplatePassword,
+
+        [Parameter(Mandatory)]
+        [int] $CPUCount,
+
+        [Parameter(Mandatory)]
+        [int] $RamSizeGb,
+
+        [Parameter(Mandatory)]
+        [int] $DiskSizeGb
+    )
+
+    $env:ANKA_DEFAULT_USER = $TemplateUsername
+    $env:ANKA_DEFAULT_PASSWD = $TemplatePassword
+    $env:ANKA_CREATE_SUSPEND = 0
+    $command = "anka create --cpu-count '$CPUCount' --ram-size '${RamSizeGb}G' --disk-size '${DiskSizeGb}G' --app '$InstallerPath' $TemplateName"
+    Invoke-AnkaCommand -Command $command
+}
+
+function Remove-AnkaVM {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName
+    )
+
+    $command = "anka delete $VMName --yes"
+    $isTemplateExists = Get-AnkaVM | Where-Object name -eq $VMName
+    if ($isTemplateExists) {
+        $null = Invoke-AnkaCommand -Command $command
+    }
+}
+
+function Set-AnkaVMVideoController {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $ShortMacOSVersion,
+
+        [ValidateSet("fbuf", "pg")]
+        [string] $Controller = "pg"
+    )
+
+    $command = "anka modify $VMName set display -c $Controller"
+    # Apple Metal is available starting from Big Sur
+    if (-not $ShortMacOSVersion.StartsWith("10.")) {
+        $null = Invoke-AnkaCommand -Command $command
+    }
+}
+
+function Set-AnkaVMDisplayResolution {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $DisplayResolution
+    )
+
+    $command = "anka modify $VMName set display -r $DisplayResolution"
+    $null = Invoke-AnkaCommand -Command $command
+}
+
+function Start-AnkaVM {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName
+    )
+
+    $command = "anka start $VMName"
+    $vmStatus = Get-AnkaVMStatus -VMName $VMName
+    if ($vmStatus -eq "stopped") {
+        $null = Invoke-AnkaCommand -Command $command
+    }
+}
+
+function Stop-AnkaVM {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName
+    )
+
+    $command = "anka stop $VMName"
+    $vmStatus = Get-AnkaVMStatus -VMName $VMName
+    if ($vmStatus -eq "running") {
+       $null = Invoke-AnkaCommand -Command $command
+    }
+}
+
+function Wait-AnkaVMIPAddress {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName,
+
+        [int] $RetryCount = 20,
+        [int] $Seconds = 60
+    )
+
+    $condition = { Get-AnkaVMIPAddress -VMName $VMName }
+    $null = Invoke-WithRetry -BreakCondition $condition -RetryCount $RetryCount -Seconds $Seconds
+}
+
+function Wait-AnkaVMSSHService {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName,
+
+        [int] $RetryCount = 20,
+        [int] $Seconds = 60
+    )
+
+    Start-Sleep -Seconds $Seconds
+    Write-Host "`t[*] Waiting for '$VMName' VM to get an IP address"
+    Wait-AnkaVMIPAddress -VMName $VMName -RetryCount $RetryCount -Seconds $Seconds
+
+    $ipAddress = Get-AnkaVMIPAddress -VMName $VMName
+    Write-Host "`t[*] The '$ipAddress' IP address for '$VMName' VM"
+
+    Write-Host "`t[*] Checking if SSH on a port is open"
+    $isSSHPortOpen = Test-SSHPort -IPAddress $ipAddress
+    if (-not $isSSHPortOpen) {
+        Write-Host "`t[x] SSH port is closed"
+        exit 1
+    }
+}

images.CI/macos/anka/CreateCleanAnkaTemplate.ps1

@@ -0,0 +1,184 @@
+[CmdletBinding()]
+param(
+    [Parameter(Mandatory)]
+    [ValidateNotNullOrEmpty()]
+    [version] $MacOSVersion,
+
+    [ValidateNotNullOrEmpty()]
+    [string] $TemplateUsername,
+
+    [Parameter(Mandatory)]
+    [ValidateNotNullOrEmpty()]
+    [string] $TemplatePassword,
+
+    [Parameter(Mandatory)]
+    [ValidateNotNullOrEmpty()]
+    [string] $RegistryUrl,
+
+    [ValidateNotNullOrEmpty()]
+    [string] $TemplateName,
+
+    [bool] $DownloadLatestVersion = $true,
+    [bool] $BetaSearch = $false,
+    [bool] $InstallSoftwareUpdate = $true,
+    [bool] $EnableAutoLogon = $true,
+    [int] $CPUCount = 6,
+    [int] $RamSizeGb = 7,
+    [int] $DiskSizeGb = 300,
+    [string] $DisplayResolution = "1920x1080",
+    [string] $TagName = [DateTimeOffset]::Now.ToUnixTimeSeconds()
+)
+
+$ErrorActionPreference = "Stop"
+$WarningPreference = "SilentlyContinue"
+
+# Import helper modules
+Import-Module "$PSScriptRoot/Anka.Helpers.psm1"
+Import-Module "$PSScriptRoot/Service.Helpers.psm1"
+
+# Helper functions
+function Invoke-EnableAutoLogon {
+    if (-not $EnableAutoLogon) {
+        Write-Host "`t[*] Skip configuring AutoLogon"
+        return
+    }
+
+    $ipAddress = Get-AnkaVMIPAddress -VMName $TemplateName
+
+    Write-Host "`t[*] Enable AutoLogon"
+    Enable-AutoLogon -HostName $ipAddress -UserName $TemplateUsername -Password $TemplatePassword
+
+    Write-Host "`t[*] Reboot '$TemplateName' VM to enable AutoLogon"
+    Restart-VMSSH -HostName $ipAddress | Show-StringWithFormat
+
+    Wait-AnkaVMSSHService -VMName $TemplateName -Seconds 30
+
+    Write-Host "`t[*] Checking if AutoLogon is enabled"
+    Test-AutoLogon -VMName $TemplateName -UserName $TemplateUsername
+}
+
+function Invoke-SoftwareUpdate {
+    if (-not $InstallSoftwareUpdate) {
+        Write-Host "`t[*] Skip installing software updates"
+        return
+    }
+
+    $ipAddress = Get-AnkaVMIPAddress -VMName $TemplateName
+
+    # Unenroll Seed
+    Write-Host "`t[*] Reseting the seed before requesting stable versions"
+    Remove-CurrentBetaSeed -HostName $ipAddress | Show-StringWithFormat
+
+    # Install Software Updates
+    # Security updates may not be able to install(hang, freeze) when AutoLogon is turned off
+    Write-Host "`t[*] Finding available software"
+    $newUpdates = Get-SoftwareUpdate -HostName $ipAddress
+
+    if (-not $newUpdates) {
+        Write-Host "`t[*] No Updates Available"
+        return
+    }
+
+    Write-Host "`t[*] Fetching Software Updates ready to install on '$TemplateName' VM:"
+    Show-StringWithFormat $newUpdates
+    Write-Host "`t[*] Installing Software Updates on '$TemplateName' VM:"
+    Install-SoftwareUpdate -HostName $ipAddress | Show-StringWithFormat
+
+    # Check if Action: restart
+    if ($newUpdates.Contains("Action: restart")) {
+        Write-Host "`t[*] Sleep 60 seconds before the software updates have been installed"
+        Start-Sleep -Seconds 60
+
+        Write-Host "`t[*] Waiting for loginwindow process"
+        Wait-LoginWindow -HostName $ipAddress | Show-StringWithFormat
+
+        # Re-enable AutoLogon after installing a new security software update
+        Invoke-EnableAutoLogon
+
+        # Check software updates have been installed
+        $updates = Get-SoftwareUpdate -HostName $ipAddress
+        if ($updates.Contains("Action: restart")) {
+            Write-Host "`t[x] Software updates failed to install: $updates"
+            Show-StringWithFormat $updates
+            exit 1
+        }
+    }
+
+    Write-Host "`t[*] Show the install history:"
+    $hUpdates = Get-SoftwareUpdateHistory -HostName $ipAddress
+    Show-StringWithFormat $hUpdates
+}
+
+function Invoke-UpdateSettings {
+    $isConfRequired = $InstallSoftwareUpdate -or $EnableAutoLogon
+    if (-not $isConfRequired) {
+        Write-Host "`t[*] Skip additional configuration"
+        return
+    }
+
+    Write-Host "`t[*] Starting '$TemplateName' VM"
+    Start-AnkaVM -VMName $TemplateName
+
+    Write-Host "`t[*] Waiting for SSH service on '$TemplateName' VM"
+    Wait-AnkaVMSSHService -VMName $TemplateName -Seconds 30
+
+    # Configure AutoLogon
+    Invoke-EnableAutoLogon
+
+    # Install software updates
+    Invoke-SoftwareUpdate
+
+    Write-Host "`t[*] Stopping '$TemplateName' VM"
+    Stop-AnkaVM -VMName $TemplateName
+}
+
+function Test-VMStopped {
+    $vmStatus = Get-AnkaVMStatus -VMName $TemplateName
+    if ($vmStatus -ne "stopped") {
+        Write-Host "`t[x] VM '$TemplateName' state is not stopped. The current state is '$vmStatus'"
+        exit 1
+    }
+}
+
+# Password is passed as env-var "SSHPASS"
+$env:SSHUSER = $TemplateUsername
+$env:SSHPASS = $TemplatePassword
+
+Write-Host "`n[#1] Download macOS application installer:"
+$macOSInstaller = Get-MacOSInstaller -MacOSVersion $MacOSVersion -DownloadLatestVersion $DownloadLatestVersion -BetaSearch $BetaSearch
+$shortMacOSVersion = Get-ShortMacOSVersion -MacOSVersion $MacOSVersion
+if ([string]::IsNullOrEmpty($TemplateName)) {
+    $TemplateName = "clean_macos_${shortMacOSVersion}_${DiskSizeGb}gb"
+}
+
+Write-Host "`n[#2] Create a VM template:"
+Write-Host "`t[*] Deleting existed template with name '$TemplateName' before creating a new one"
+Remove-AnkaVM -VMName $TemplateName
+
+Write-Host "`t[*] Creating Anka VM template with name '$TemplateName' and '$TemplateUsername' user"
+Write-Host "`t[*] CPU Count: $CPUCount, RamSize: ${RamSizeGb}G, DiskSizeGb: ${DiskSizeGb}G, InstallerPath: $macOSInstaller, TemplateName: $TemplateName"
+New-AnkaVMTemplate -InstallerPath $macOSInstaller `
+                   -TemplateName $TemplateName `
+                   -TemplateUsername $TemplateUsername `
+                   -TemplatePassword $TemplatePassword `
+                   -CPUCount $CPUCount `
+                   -RamSizeGb $RamSizeGb `
+                   -DiskSizeGb $DiskSizeGb | Show-StringWithFormat
+
+Write-Host "`n[#3] Configure AutoLogon and/or install software updates:"
+Invoke-UpdateSettings
+
+Write-Host "`n[#4] Finalization '$TemplateName' configuration and push to the registry:"
+Write-Host "`t[*] The '$TemplateName' VM status is stopped"
+Test-VMStopped
+
+# Configure graphics settings
+Write-Host "`t[*] Enabling Graphics Acceleration with Apple Metal for '$TemplateName' VM"
+Set-AnkaVMVideoController -VMName $TemplateName -ShortMacOSVersion $ShortMacOSVersion
+
+Write-Host "`t[*] Setting screen resolution to $DisplayResolution for $TemplateName"
+Set-AnkaVMDisplayResolution -VMName $TemplateName -DisplayResolution $DisplayResolution
+
+# Push a VM template (and tag) to the Cloud
+Write-Host "`t[*] Pushing '$TemplateName' image with '$TagName' tag to the '$RegistryUrl' registry..."
+Push-AnkaTemplateToRegistry -RegistryUrl $registryUrl -TagName $TagName -TemplateName $TemplateName

images.CI/macos/anka/Service.Helpers.psm1

@@ -0,0 +1,339 @@
+function Enable-AutoLogon {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $UserName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $Password
+    )
+
+    $url = "https://raw.githubusercontent.com/actions/virtual-environments/main/images/macos/provision/bootstrap-provisioner/kcpassword.py"
+    $script = Invoke-RestMethod -Uri $url
+    $base64 = [Convert]::ToBase64String($script.ToCharArray())
+    $kcpassword = "echo $base64 | base64 --decode > ~/kcpassword;sudo python ./kcpassword '${Password}';rm ./kcpassword"
+    $loginwindow = "sudo /usr/bin/defaults write /Library/Preferences/com.apple.loginwindow autoLoginUser '${UserName}';sudo /usr/bin/defaults write /Library/Preferences/com.apple.loginwindow autoLoginUserScreenLocked -bool false"
+    $command = "${kcpassword};$loginwindow"
+    Invoke-SSHPassCommand -HostName $HostName -Command $command
+}
+
+function Get-AvailableVersions {
+    param (
+        [bool] $IsBeta = $false
+    )
+
+    if ($IsBeta) {
+        $searchPostfix = " beta"
+    }
+
+    $command = { /usr/sbin/softwareupdate --list-full-installers | grep "macOS" }
+    $condition = { $LASTEXITCODE -eq 0 }
+    $softwareUpdates = Invoke-WithRetry -Command $command -BreakCondition $condition | Where-Object { $_.Contains("Title: macOS") -and $_ -match $searchPostfix }
+    $allVersions = $softwareUpdates -replace "(\* )?(Title|Version|Size):" | ConvertFrom-Csv -Header OSName, OSVersion | Select-Object OSName, OSVersion -Unique
+
+    $allVersions
+}
+
+function Get-MacOSInstaller {
+    param (
+        [Parameter(Mandatory)]
+        [version] $MacOSVersion,
+
+        [bool] $DownloadLatestVersion = $false,
+        [bool] $BetaSearch = $false
+    )
+
+    # Enroll machine to DeveloperSeed if we need beta and unenroll otherwise
+    $seedutil = "/System/Library/PrivateFrameworks/Seeding.framework/Versions/Current/Resources/seedutil"
+    if ($BetaSearch) {
+        Write-Host "`t[*] Beta Version requested. Enrolling machine to DeveloperSeed"
+        sudo $seedutil enroll DeveloperSeed | Out-Null
+    } else {
+        Write-Host "`t[*] Reseting the seed before requesting stable versions"
+        sudo $seedutil unenroll | Out-Null
+    }
+
+    # Validate there is no softwareupdate at the moment
+    Test-SoftwareUpdate
+
+    # Validate availability OSVersion
+    Write-Host "`t[*] Finding available full installers"
+    $availableVersions = Get-AvailableVersions -IsBeta $BetaSearch
+    if ($DownloadLatestVersion) {
+        $shortMacOSVersion = Get-ShortMacOSVersion -MacOSVersion $MacOSVersion
+        $filterSearch = "${shortMacOSVersion}."
+        $filteredVersions = $availableVersions.Where{ $_.OSVersion.StartsWith($filterSearch) }
+        if (-not $filteredVersions) {
+            Write-Host "`t[x] Failed to find any macOS versions using '$filterSearch' search condition"
+            Show-StringWithFormat $availableVersions
+            exit 1
+        }
+        Show-StringWithFormat $filteredVersions 
+        $osVersions = $filteredVersions.OSVersion | Sort-Object {[version]$_}
+        $MacOSVersion = $osVersions | Select-Object -Last 1
+        Write-Host "`t[*] The 'DownloadLatestVersion' flag is set. Latest macOS version is '$MacOSVersion' now"
+    }
+
+    $macOSName = $availableVersions.Where{ $MacOSVersion -eq $_.OSVersion }.OSName
+    if (-not $macOSName) {
+        Write-Host "`t[x] Requested macOS '$MacOSVersion' version not found in the list of available installers. Available versions are:`n$($availableVersions.OSVersion)"
+        Write-Host "`t[x] Make sure to pass '-BetaSearch `$true' if you need a beta version installer"
+        exit 1
+    }
+
+    $installerPathPattern = "/Applications/Install*${macOSName}.app"
+    if (Test-Path $installerPathPattern) {
+        $previousInstallerPath = Get-Item -Path $installerPathPattern
+        Write-Host "`t[*] Removing '$previousInstallerPath' installation app before downloading the new one"
+        sudo rm -rf "$previousInstallerPath"
+    }
+
+    # Clear LastRecommendedMajorOSBundleIdentifier to prevent error during fetching updates
+    # Install failed with error: Update not found
+    Update-SoftwareBundle
+
+    # Download macOS installer
+    Write-Host "`t[*] Requested macOS '$MacOSVersion' version installer found, fetching it from Apple Software Update"
+    $result = Invoke-WithRetry { /usr/sbin/softwareupdate --fetch-full-installer --full-installer-version $MacOSVersion } {$LASTEXITCODE -eq 0} | Out-String
+    if (-not $result.Contains("Install finished successfully")) {
+        Write-Host "`t[x] Failed to fetch $MacOSVersion macOS `n$result"
+        exit 1
+    }
+
+    $installerPath = (Get-Item -Path $installerPathPattern).FullName
+    Write-Host "`t[*] Installer successfully downloaded to '$installerPath'"
+
+    $installerPath
+}
+
+function Get-ShortMacOSVersion {
+    param (
+        [Parameter(Mandatory)]
+        [version] $MacOSVersion
+    )
+
+    # Take Major.Minor version for macOS 10 (10.14 or 10.15) and Major for all further versions
+    $MacOSVersion.Major -eq 10 ? $MacOSVersion.ToString(2) : $MacOSVersion.ToString(1)
+}
+
+function Get-SoftwareUpdate {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName
+    )
+
+    $command = "/usr/sbin/softwareupdate --list"
+    $result = Invoke-SSHPassCommand -HostName $HostName -Command $command
+    $result | Where-Object { $_ -match "(Label|Title):" } | Out-String
+}
+
+function Get-SoftwareUpdateHistory {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName
+    )
+
+    $command = "/usr/sbin/softwareupdate --history"
+    Invoke-SSHPassCommand -HostName $HostName -Command $command | Out-String
+}
+
+function Install-SoftwareUpdate {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName
+    )
+
+    $command = "sudo /usr/sbin/softwareupdate --all --install --restart --verbose"
+    Invoke-SSHPassCommand -HostName $HostName -Command $command
+}
+
+function Invoke-SSHPassCommand {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $Command,
+
+        [int] $ConnectTimeout = 10,
+        [int] $ConnectionAttempts = 10,
+        [int] $ServerAliveInterval = 30
+    )
+
+    $sshArg = @(
+        "sshpass"
+        "-e"
+        "ssh"
+        "-o UserKnownHostsFile=/dev/null"
+        "-o StrictHostKeyChecking=no"
+        "-o ConnectTimeout=$ConnectTimeout"
+        "-o ConnectionAttempts=$ConnectionAttempts"
+        "-o LogLevel=ERROR"
+        "-o ServerAliveInterval=$ServerAliveInterval"
+        "${env:SSHUSER}@${HostName}"
+    )
+    $sshPassOptions = $sshArg -join " "
+    bash -c "$sshPassOptions \""$Command\"" 2>&1"
+}
+
+function Invoke-WithRetry {
+    param(
+        [scriptblock] $Command,
+        [scriptblock] $BreakCondition,
+        [int] $RetryCount = 20,
+        [int] $Seconds = 60
+    )
+
+    while ($RetryCount -gt 0) {
+        if ($Command) {
+            $result = & $Command
+        }
+
+        if (& $BreakCondition) {
+            return $result
+        }
+
+        $RetryCount--
+        if ($RetryCount -eq 0) {
+            Write-Error "No more attempts left: $BreakCondition"
+        }
+        Write-Host "`t    [/] Waiting $Seconds seconds before retrying. Retries left: $RetryCount"
+        Start-Sleep -Seconds $Seconds
+    }
+
+    $result
+}
+
+function Restart-VMSSH {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName
+    )
+
+    $command = "sudo reboot"
+    Invoke-SSHPassCommand -HostName $HostName -Command $command
+}
+
+function Show-StringWithFormat {
+    param(
+        [Parameter(ValuefromPipeline)]
+        [object] $string
+    )
+    
+    process {
+        ($string | Out-String).Trim().split("`n") | ForEach-Object { Write-Host "`t    $_" }
+    }
+}
+
+function Remove-CurrentBetaSeed {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName
+    )
+
+    $command = "sudo /System/Library/PrivateFrameworks/Seeding.framework/Versions/Current/Resources/seedutil unenroll"
+    Invoke-SSHPassCommand -HostName $HostName -Command $command | Out-String
+}
+
+function Test-AutoLogon {
+    param(
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $VMName,
+
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $UserName
+    )
+
+    Invoke-WithRetry -BreakCondition {
+        # pwsh crashes if it invokes directly
+        # https://github.com/dotnet/runtime/issues/59059
+        $ankaUser = "" | bash -c "anka run $VMName /usr/bin/id -nu"
+        $UserName -eq $ankaUser
+    }
+}
+
+function Test-SoftwareUpdate {
+    param (
+        [string] $UpdateProcessName = "softwareupdate"
+    )
+
+   $command = {
+      $updateProcess = (Get-Process -Name $UpdateProcessName -ErrorAction SilentlyContinue).id
+      if ($updateProcess) {
+          # Workaround to get commandline param as it doesn't work for macOS atm https://github.com/PowerShell/PowerShell/issues/13943
+          $processName = /bin/ps -o command= $updateProcess
+          Write-Host "`t[*] Another software update process with '$updateProcess' id is in place with the following arguments '$processName'"
+      }
+   }
+   $condition = {
+      $null -eq (Get-Process -Name $UpdateProcessName -ErrorAction SilentlyContinue)
+   }
+
+   Invoke-WithRetry -Command $command -BreakCondition $condition
+}
+
+function Test-SSHPort {
+    param(
+        [Parameter(Mandatory)]
+        [ipaddress] $IPAddress,
+
+        [int] $Port = 22,
+        [int] $Timeout = 2000
+    )
+
+    Invoke-WithRetry -Command {$true} -BreakCondition {
+        try {
+            $client = [System.Net.Sockets.TcpClient]::new()
+            $client.ConnectAsync($IPAddress, $Port).Wait($Timeout)
+        }
+        catch {
+            $false
+        }
+        finally {
+            $client.Close()
+        }
+    }
+}
+
+function Wait-LoginWindow {
+    param (
+        [Parameter(Mandatory)]
+        [ValidateNotNullOrEmpty()]
+        [string] $HostName,
+
+        [int] $RetryCount = 60,
+        [int] $Seconds = 60
+    )
+
+    $condition = {
+        $psCommand = "/bin/ps auxww"
+        $lw = "/System/Library/CoreServices/loginwindow.app/Contents/MacOS/loginwindow"
+        $ctk = "/System/Library/Frameworks/CryptoTokenKit.framework/ctkahp.bundle/Contents/MacOS/ctkahp"
+        $proc = Invoke-SSHPassCommand -HostName $HostName -Command $psCommand | Out-String
+        $proc.Contains($lw) -and $proc.Contains($ctk)
+    }
+    Invoke-WithRetry -RetryCount $RetryCount -Seconds $Seconds -BreakCondition $condition
+}
+
+function Update-SoftwareBundle {
+    $productVersion = sw_vers -productVersion
+
+    if ( $productVersion.StartsWith('11.') ) {
+        sudo rm -rf /Library/Preferences/com.apple.commerce.plist
+        sudo /usr/bin/defaults delete /Library/Preferences/com.apple.SoftwareUpdate.plist LastRecommendedMajorOSBundleIdentifier | Out-Null
+    }
+}

images.CI/macos/azure-pipelines/image-generation.yml

@@ -75,7 +75,6 @@ jobs:
         -var="vm_password=$(vm-password)" `
         -var="build_id=$(VirtualMachineName)" `
         -var="baseimage_name=${{ parameters.base_image_name }}" `
-        -var="github_feed_token=$(github-feed-token)" `
         -var="xcode_install_user=$(xcode-installation-user)" `
         -var="xcode_install_password=$(xcode-installation-password)" `
         -color=false `
@@ -121,15 +120,6 @@ jobs:
       arguments: -PackerLogPath "$(Agent.TempDirectory)/packer-log.txt" `
                         -PrintTopNLongest 25
 
-  - task: PublishTestResults@2
-    inputs:
-      testResultsFiles: '*.xml'
-      testResultsFormat: NUnit
-      searchFolder: '$(Common.TestResultsDirectory)'
-      failTaskOnFailedTests: true
-    displayName: Publish test results
-    condition: always()
-
   - task: PowerShell@2
     displayName: 'Move vm to cold storage and clear datastore tag'
     condition: always()
@@ -141,6 +131,9 @@ jobs:
                  -VIServer "$(vcenter-server-v2)" `
                  -VIUserName "$(vcenter-username-v2)" `
                  -VIPassword "$(vcenter-password-v2)"
+                 -CpuCount "$(cpu-count)" `
+                 -CoresPerSocketCount "$(cores-per-socket-count)" `
+                 -Memory "$(memory)"
 
   - task: PowerShell@2
     displayName: 'Destroy VM (if build canceled only)'

images.CI/macos/azure-pipelines/macos1013.yml

@@ -1,23 +0,0 @@
-name: macOS-10.13_$(date:yyyyMMdd)$(rev:.r)_unstable
-schedules:
-- cron: "0 0 * * *"
-  displayName: Daily
-  branches:
-    include:
-    - main
-  always: true
-
-trigger: none
-pr:
-  autoCancel: true
-  branches:
-    include:
-    - main
-
-jobs:
-- template: image-generation.yml
-  parameters:
-    image_label: 'macOS High Sierra'
-    base_image_name: 'clean-macOS-10.13.6-380Gb-SIPoff_runner'
-    template_path: 'templates/macOS-10.13.json'
-    target_datastore: 'ds-image'

images.CI/macos/azure-pipelines/macos11.yml

@@ -1,23 +1,23 @@
-name: macOS-11.0_$(date:yyyyMMdd)$(rev:.r)_unstable
-schedules:
-- cron: "0 0 * * *"
-  displayName: Daily
-  branches:
-    include:
-    - main
-  always: true
-
-trigger: none
-pr:
-  autoCancel: true
-  branches:
-    include:
-    - main
-
-jobs:
-- template: image-generation.yml
-  parameters:
-    image_label: 'macOS Big Sur'
-    base_image_name: 'clean-macOS-11.0-380Gb-runner'
-    template_path: 'templates/macOS-11.0.json'
-    target_datastore: 'ds-image'
+name: macOS-11_$(date:yyyyMMdd)$(rev:.r)_unstable
+schedules:
+- cron: "0 0 * * *"
+  displayName: Daily
+  branches:
+    include:
+    - main
+  always: true
+
+trigger: none
+pr:
+  autoCancel: true
+  branches:
+    include:
+    - main
+
+jobs:
+- template: image-generation.yml
+  parameters:
+    image_label: 'macOS Big Sur'
+    base_image_name: 'clean-macOS-11-380Gb-runner'
+    template_path: 'templates/macOS-11.json'
+    target_datastore: 'ds-image'

images.CI/macos/azure-pipelines/macos12.yml

@@ -1,23 +1,23 @@
-name: macOS-10.14_$(date:yyyyMMdd)$(rev:.r)_unstable
-schedules:
-- cron: "0 0 * * *"
-  displayName: Daily
-  branches:
-    include:
-    - main
-  always: true
-
-trigger: none
-pr:
-  autoCancel: true
-  branches:
-    include:
-    - main
-
-jobs:
-- template: image-generation.yml
-  parameters:
-    image_label: 'macOS Mojave'
-    base_image_name: 'clean-macOS-10.14-380Gb_runner'
-    template_path: 'templates/macOS-10.14.json'
-    target_datastore: 'ds-image'
+name: macOS-12_$(date:yyyyMMdd)$(rev:.r)_unstable
+schedules:
+- cron: "0 0 * * *"
+  displayName: Daily
+  branches:
+    include:
+    - main
+  always: true
+
+trigger: none
+pr:
+  autoCancel: true
+  branches:
+    include:
+    - main
+
+jobs:
+- template: image-generation.yml
+  parameters:
+    image_label: 'macOS Monterey'
+    base_image_name: 'clean-macOS-12-380Gb-runner'
+    template_path: 'templates/macOS-12.json'
+    target_datastore: 'ds-image'

images.CI/macos/move-vm.ps1

@@ -39,7 +39,13 @@ param(
 
     [Parameter(Mandatory)]
     [ValidateNotNullOrEmpty()]
-    [string]$VIPassword
+    [string]$VIPassword,
+
+    [int32]$CpuCount,
+
+    [int32]$CoresPerSocketCount,
+
+    [int64]$Memory
 )
 
 # Import helpers module
@@ -56,13 +62,12 @@ try {
 }
 
 $vm = Get-VM $VMName
-
 if ($env:AGENT_JOBSTATUS -eq 'Failed') {
     try {
         if($vm.PowerState -ne "PoweredOff") {
-            Stop-VM -VM $vm -Confirm:$false -ErrorAction Stop
+            Stop-VM -VM $vm -Confirm:$false -ErrorAction Stop | Out-Null
         }
-        Set-VM -VM $vm -Name "${VMName}_failed" -Confirm:$false -ErrorAction Stop
+        Set-VM -VM $vm -Name "${VMName}_failed" -Confirm:$false -ErrorAction Stop | Out-Null
         Write-Host "VM has been successfully powered off and renamed to [${VMName}_failed]"
     } catch {
         Write-Host "##vso[task.LogIssue type=error;]Failed to power off and rename VM '$VMName'"
@@ -70,8 +75,15 @@ if ($env:AGENT_JOBSTATUS -eq 'Failed') {
 }
 
 try {
-    Move-VM -Vm $vm -Datastore $TargetDataStore -ErrorAction Stop
+    Move-VM -Vm $vm -Datastore $TargetDataStore -ErrorAction Stop | Out-Null
     Write-Host "VM has been moved successfully to target datastore '$TargetDataStore'"
 } catch {
     Write-Host "##vso[task.LogIssue type=error;]Failed to move VM '$VMName' to target datastore '$TargetDataStore'"
-}
+}
+
+try {
+    Write-Host "Change CPU count to $CpuCount, cores count to $CoresPerSocketCount, amount of RAM to $Memory"
+    $vm | Set-VM -NumCPU $CpuCount -CoresPerSocket $CoresPerSocketCount -MemoryMB $Memory -Confirm:$false -ErrorAction Stop | Out-Null
+} catch {
+    Write-Host "##vso[task.LogIssue type=error;]Failed to change specs for VM '$VMName'"
+}

images.CI/macos/select-datastore.ps1

@@ -54,14 +54,19 @@ function Select-DataStore {
 
     # 1. Name starts with ds-local-Datastore
     # 2. FreespaceGB > 400 Gb
-    # 3. VM count on a datastore < 2
+    # 3. Choose a datastore with the minimal VM count < 2
 
     Write-Host "Start Datastore selection process..."
     $allDatastores = Get-Datastore -Name $templateDatastore | Where-Object { $_.State -eq "Available" }
-    $buildDatastore = $allDatastores | Where-Object { $_.FreeSpaceGB -ge $thresholdInGb } | Where-Object {
+    $availableDatastores = $allDatastores `
+    | Where-Object { $_.FreeSpaceGB -ge $thresholdInGb } `
+    | Where-Object {
         $vmOnDatastore = @((Get-ChildItem -Path $_.DatastoreBrowserPath).Name -notmatch "^\.").Count
-        $vmOnDatastore -lt $vmCount
-    } | Get-Random | Select-Object -ExpandProperty Name
+        $vmOnDatastore -lt $vmCount } `
+    | Group-Object -Property { $vmOnDatastore }
+
+    $datastore = $availableDatastores | Select-Object @{n="VmCount";e={$_.Name}},@{n="DatastoreName";e={$_.Group | Get-Random}} -First 1
+    $buildDatastore = $datastore.DatastoreName
 
     $tag = Get-Tag -Category $TagCategory -Name $VMName -ErrorAction Ignore
     if (-not $tag)
@@ -73,8 +78,9 @@ function Select-DataStore {
 
     # Wait for 60 seconds to check if any other tags are assigned to the same datastore
     Start-Sleep -Seconds 60
-    # Take only first 2 tags, all the others will go to the next round
-    $tagAssignments = (Get-TagAssignment -Entity $buildDatastore).Tag.Name | Select-Object -First 2
+    # If there are no datastores with 0 VMs, take a datastore with 1 VM (index 1 if datastore has 0 VMs and 2 if 1 VM)
+    $index = 1 + [int]$datastore.VmCount
+    $tagAssignments = (Get-TagAssignment -Entity $buildDatastore).Tag.Name | Select-Object -First $index
     $isAllow = $tagAssignments -contains $VMName
 
     if ($isAllow)

images/linux/Ubuntu1604-README.md

@@ -1,234 +0,0 @@
-| Announcements |
-|-|
-| [[Ubuntu] Default Clang will be set to Clang 11 on December, 14](https://github.com/actions/virtual-environments/issues/2130) |
-| [.NET 5.0 will become a default .NET version on December, 14](https://github.com/actions/virtual-environments/issues/1891) |
-| [Ubuntu-latest workflows will use Ubuntu-20.04](https://github.com/actions/virtual-environments/issues/1816) |
-| [Official Ruby binaries will be installed on images by default](https://github.com/actions/virtual-environments/issues/2193) |
-***
-# Ubuntu 16.04.7 LTS
-- Image Version: 20201129.1
-
-## Installed Software
-### Language and Runtime
-- GNU C++ 5.5.0, 7.5.0, 8.4.0, 9.3.0
-- GNU Fortran 5.5.0, 8.4.0, 9.3.0
-- Clang 6.0.0, 8.0.0, 9.0.1
-- Erlang 11.1
-- Mono 6.12.0.90
-- Node 14.15.1
-- Python 2.7.12
-- Python3 3.5.2
-- PowerShell 7.1.0
-- Ruby 2.3.1p112
-- Swift 5.3.1
-- Julia 1.5.3
-
-### Package Management
-- Gem 3.1.4
-- Helm 3.4.1
-- Homebrew 2.5.12
-- Miniconda 4.9.2
-- Npm 6.14.9
-- Pip 8.1.1
-- Pip3 8.1.1
-- Vcpkg 2020.11.12
-- Yarn 1.22.5
-
-### Project Management
-- Ant 1.9.6
-- Gradle 6.7.1
-- Maven 3.6.3
-- Sbt 1.4.4
-
-### Tools
-- 7-Zip 9.20
-- Ansible 2.9.15
-- apt-fast 1.9.10
-- AzCopy10 10.7.0 (available by `azcopy10` alias)
-- AzCopy7 7.3.0 (available by `azcopy` alias)
-- Bazel 3.7.1
-- Bazelisk 1.7.3
-- CMake 3.19.1
-- CodeQL Action Bundle 2.3.3
-- curl 7.47.0
-- Docker Compose 1.27.4
-- Docker-Buildx 0.4.2
-- Docker-Moby 19.03.13
-- Git 2.29.0
-- Git LFS 2.12.1
-- Git-ftp 1.0.2
-- Haveged 1.9.1
-- Heroku 7.47.3
-- HHVM (HipHop VM) 4.56.2
-- jq 1.5
-- Kind 0.9.0
-- Kubectl 1.19.4
-- Kustomize 3.8.7
-- Leiningen 2.9.4
-- m4 1.4.17
-- Mercurial 4.4.1
-- Minikube 1.15.1
-- Newman 5.2.1
-- nvm 0.37.2
-- Packer 1.6.5
-- PhantomJS 2.1.1
-- Pulumi 2.14.0
-- R 4.0.3
-- Sphinx Open Source Search Server 2.2.9
-- SVN 1.9.3
-- Swig 3.0.8
-- Terraform 0.13.5
-- unzip 6.00
-- wget 1.17.1
-- yamllint 1.2.1
-- zip 3.0
-- zstd 1.3.1
-
-### CLI Tools
-- Alibaba Cloud CLI 3.0.63
-- AWS CLI 1.18.185
-- AWS CLI Session manager plugin 1.2.30.0
-- AWS SAM CLI 1.12.0
-- Azure CLI (azure-cli) 2.15.1
-- Azure CLI (azure-devops) 0.18.0
-- GitHub CLI 1.3.0
-- Google Cloud SDK 319.0.0
-- Hub CLI 2.14.2
-- Netlify CLI 2.69.0
-- oc CLI 4.5.0
-- ORAS CLI 0.8.1
-- Vercel CLI 21.0.1
-
-### Java
-| Version             | Vendor       | Environment Variable |
-| ------------------- | ------------ | -------------------- |
-| 1.7.0_285           | Zulu         | JAVA_HOME_7_X64      |
-| 1.8.0_275 (default) | AdoptOpenJDK | JAVA_HOME_8_X64      |
-| 11.0.9.1            | AdoptOpenJDK | JAVA_HOME_11_X64     |
-| 12.0.2              | AdoptOpenJDK | JAVA_HOME_12_X64     |
-
-### PHP
-| Tool     | Version                                   |
-| -------- | ----------------------------------------- |
-| PHP      | 5.6.40 7.0.33 7.1.33 7.2.34 7.3.24 7.4.13 |
-| Composer | 2.0.7                                     |
-| PHPUnit  | 7.5.20                                    |
-
-### Haskell
-- GHC 8.10.2
-- Cabal 3.4.0.0
-- Stack 2.5.1
-
-### Rust Tools
-- Rust 1.48.0
-- Rustup 1.23.0
-- Rustdoc 1.48.0
-- Cargo 1.48.0
-
-#### Packages
-- Bindgen 0.56.0
-- Cargo audit 0.13.1
-- Cargo outdated 0.9.13
-- Cargo clippy 0.0.212
-- Cbindgen 0.15.0
-- Rustfmt 1.4.24
-
-### Browsers and Drivers
-- Google Chrome 87.0.4280.66
-- ChromeDriver 87.0.4280.20
-- Mozilla Firefox 83.0
-- Geckodriver 0.28.0
-
-### .NET Core SDK
-- 2.1.300 2.1.301 2.1.302 2.1.401 2.1.402 2.1.403 2.1.500 2.1.502 2.1.503 2.1.504 2.1.505 2.1.506 2.1.507 2.1.508 2.1.509 2.1.510 2.1.511 2.1.512 2.1.513 2.1.514 2.1.515 2.1.516 2.1.517 2.1.518 2.1.519 2.1.602 2.1.603 2.1.604 2.1.605 2.1.606 2.1.607 2.1.608 2.1.609 2.1.610 2.1.611 2.1.612 2.1.613 2.1.614 2.1.615 2.1.616 2.1.700 2.1.701 2.1.801 2.1.802 2.1.803 2.1.804 2.1.805 2.1.806 2.1.807 2.1.808 2.1.809 2.1.810 2.1.811 3.0.100 3.0.101 3.0.102 3.0.103 3.1.100 3.1.101 3.1.102 3.1.103 3.1.104 3.1.105 3.1.106 3.1.107 3.1.108 3.1.109 3.1.110 3.1.200 3.1.201 3.1.202 3.1.300 3.1.301 3.1.302 3.1.401 3.1.402 3.1.403 3.1.404
-
-### Az Module
-- 1.0.0 1.6.0 2.3.2 2.6.0 2.8.0 3.1.0 3.5.0 3.8.0 4.3.0 4.4.0 4.6.0 4.7.0
-
-### Databases
-- Postgre SQL 13.1
-- MongoDB 4.4.2
-- sqlite3 3.11.0
-
-#### MySQL
-- MySQL 5.7.32
-- MySQL Server (user:root password:root)
-
-```
-    MySQL service is disabled by default. Use the following command as a part of your job to start the service: 'sudo systemctl start mysql.service'
-```
-#### MS SQL Server Client Tools
-- sqlcmd 17.6.0001.1
-
-### Cached Tools
-#### Ruby
-- 2.4.10
-- 2.5.8
-- 2.6.6
-- 2.7.2
-
-#### Python
-- 2.7.18
-- 3.5.10
-- 3.6.12
-- 3.7.9
-- 3.8.6
-- 3.9.0
-
-#### PyPy
-- 2.7.18 [PyPy 7.3.3]
-- 3.6.12 [PyPy 7.3.3]
-
-#### Node.js
-- 8.17.0
-- 10.23.0
-- 12.20.0
-- 14.15.1
-
-#### Go
-- 1.13.15
-- 1.14.12
-- 1.15.5
-
-#### Boost
-- 1.72.0
-
-### Android
-| Package Name               | Version                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
-| -------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
-| Android SDK Platform-Tools | 30.0.5                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
-| Android SDK Tools          | 26.1.1                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
-| Android SDK Platforms      | android-30 (rev 3)<br>android-29 (rev 5)<br>android-28 (rev 6)<br>android-27 (rev 3)<br>android-26 (rev 2)<br>android-25 (rev 3)<br>android-24 (rev 2)<br>android-23 (rev 3)<br>android-22 (rev 2)<br>android-21 (rev 2)<br>android-20 (rev 2)<br>android-19 (rev 4)<br>android-18 (rev 3)<br>android-17 (rev 3)<br>android-16 (rev 5)<br>android-15 (rev 5)<br>android-14 (rev 4)<br>android-13 (rev 1)<br>android-12 (rev 3)<br>android-11 (rev 2)<br>android-10 (rev 2) |
-| Android SDK Build-tools    | 30.0.0 30.0.1 30.0.2<br>29.0.0 29.0.1 29.0.2 29.0.3<br>28.0.0 28.0.1 28.0.2 28.0.3<br>27.0.0 27.0.1 27.0.2 27.0.3<br>26.0.0 26.0.1 26.0.2 26.0.3<br>25.0.0 25.0.1 25.0.2 25.0.3<br>24.0.0 24.0.1 24.0.2 24.0.3<br>23.0.1 23.0.2 23.0.3<br>22.0.1<br>21.1.2<br>20.0.0<br>19.1.0                                                                                                                                                                                             |
-| Google APIs                | addon-google_apis-google-21<br>addon-google_apis-google-22<br>addon-google_apis-google-23<br>addon-google_apis-google-24                                                                                                                                                                                                                                                                                                                                                   |
-| NDK                        | 21.3.6528147                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
-| Android Support Repository | 47.0.0                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
-| Google Play services       | 49                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
-| Google Repository          | 58                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
-| SDK Patch Applier v4       | 1                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
-| CMake                      | 3.10.2<br>3.6.4111459                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
-
-### Cached Docker images
-| Repository:Tag                                            | Digest                                                                   | Created    |
-| --------------------------------------------------------- | ------------------------------------------------------------------------ | ---------- |
-| node:12                                                   | sha256:6e2db75c0a1e19ed760996957aef507f5abe1260ec412e8901855ac4a17a7ada  | 2020-11-25 |
-| node:12-alpine                                            | sha256:9f8d0fde57ef82d73d234d712edc211d1235469cb55426c0383b7eacf7d9199f  | 2020-11-25 |
-| node:10                                                   | sha256:14fa22a8989cd64ce811db9d47e3ed2910e0f2d95323240e23bc928201bbf313  | 2020-11-18 |
-| buildpack-deps:stretch                                    | sha256:c45c192a72b3155aca0c64fd0944e431a7c211bbc3383015a14cae3d3a389e79  | 2020-11-18 |
-| buildpack-deps:buster                                     | sha256:ad587f62e065044815955a4593500f79da89f5e5af95eb7798d1a4c869f50770  | 2020-11-18 |
-| debian:9                                                  | sha256:455a591bd690268d8f6f3dc6f2a84b9d0f3d1934828140d8ea2a5344a7c79063  | 2020-11-17 |
-| debian:8                                                  | sha256:0160d3bcc7266efe6a2a93dff33e3d54480bd2616a8ff5774c33fd8b482c8d75  | 2020-11-17 |
-| node:10-alpine                                            | sha256:34d01a98b50563abff4a8e18269f35d4eb1f33e911a38dd14e4798e430af5cac  | 2020-10-28 |
-| ubuntu:14.04                                              | sha256:63fce984528cec8714c365919882f8fb64c8a3edf23fdfa0b218a2756125456f  | 2020-09-16 |
-| jekyll/builder:latest                                     | sha256:4bc6a3b6eddebef1652ef38ceb965fc9c1b06677f65f764e1e17b88dc2aa9934  | 2020-09-03 |
-| alpine:3.9                                                | sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011  | 2020-04-24 |
-| alpine:3.10                                               | sha256:f0e9534a598e501320957059cb2a23774b4d4072e37c7b2cf7e95b241f019e35  | 2020-04-24 |
-| alpine:3.8                                                | sha256:2bb501e6173d9d006e56de5bce2720eb06396803300fe1687b58a7ff32bf4c14  | 2020-01-23 |
-| alpine:3.7                                                | sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10  | 2019-03-07 |
-| mcr.microsoft.com/azure-pipelines/node8-typescript:latest | sha256:e52e60b9f71183969830a3664279b5d8c799b4b0ec2c25a0686f7c02f6a9669a  | 2018-10-09 |
-
-### Installed apt packages
-- bison, brotli, bzip2, curl, dbus, dnsutils, dpkg, fakeroot, file, flex, ftp, gnupg2, iproute2, iputils-ping, jq, lib32z1, libc++-dev, libc++abi-dev, libcurl3, libgbm-dev, libgconf-2-4, libgtk-3-0, libicu55, libsecret-1-dev, libsqlite3-dev, libunwind8, libxkbfile-dev, libxss1, locales, m4, netcat, openssh-client, parallel, patchelf, pkg-config, rpm, rsync, shellcheck, sqlite3, ssh, sudo, telnet, texinfo, time, tk, tzdata, unzip, upx, wget, xorriso, xvfb, xz-utils, yamllint, zip, zstd, zsync
-
-
-

images/linux/Ubuntu1804-README.md

@@ -1,238 +0,0 @@
-| Announcements |
-|-|
-| [[Ubuntu] Default Clang will be set to Clang 11 on December, 14](https://github.com/actions/virtual-environments/issues/2130) |
-| [.NET 5.0 will become a default .NET version on December, 14](https://github.com/actions/virtual-environments/issues/1891) |
-| [Ubuntu-latest workflows will use Ubuntu-20.04](https://github.com/actions/virtual-environments/issues/1816) |
-| [Official Ruby binaries will be installed on images by default](https://github.com/actions/virtual-environments/issues/2193) |
-***
-# Ubuntu 18.04.5 LTS
-- Image Version: 20201129.1
-
-## Installed Software
-### Language and Runtime
-- GNU C++ 7.5.0, 8.4.0, 9.3.0, 10.1.0
-- GNU Fortran 7.5.0, 8.4.0, 9.3.0, 10.1.0
-- Clang 6.0.0, 8.0.0, 9.0.0
-- Erlang 11.1
-- Mono 6.12.0.90
-- Node 14.15.1
-- Python 2.7.17
-- Python3 3.6.9
-- PowerShell 7.1.0
-- Ruby 2.5.1p57
-- Swift 5.3.1
-- Julia 1.5.3
-
-### Package Management
-- Gem 3.1.4
-- Helm 3.4.1
-- Homebrew 2.5.12
-- Miniconda 4.9.2
-- Npm 6.14.9
-- Pip 9.0.1
-- Pip3 9.0.1
-- Pipx 0.15.6.0
-- Vcpkg 2020.11.12
-- Yarn 1.22.5
-
-### Project Management
-- Ant 1.10.5
-- Gradle 6.7.1
-- Maven 3.6.3
-- Sbt 1.4.4
-
-### Tools
-- 7-Zip 16.02
-- Ansible 2.9.15
-- apt-fast 1.9.10
-- AzCopy10 10.7.0 (available by `azcopy10` alias)
-- AzCopy7 7.3.0 (available by `azcopy` alias)
-- Bazel 3.7.1
-- Bazelisk 1.7.3
-- Buildah 1.18.0
-- CMake 3.19.1
-- CodeQL Action Bundle 2.3.3
-- curl 7.58.0
-- Docker Compose 1.27.4
-- Docker-Buildx 0.4.2
-- Docker-Moby 19.03.13
-- Git 2.29.2
-- Git LFS 2.12.1
-- Git-ftp 1.3.1
-- Haveged 1.9.1
-- Heroku 7.47.3
-- HHVM (HipHop VM) 4.84.0
-- jq 1.5
-- Kind 0.9.0
-- Kubectl 1.19.4
-- Kustomize 3.8.7
-- Leiningen 2.9.4
-- m4 1.4.18
-- Mercurial 4.5.3
-- Minikube 1.15.1
-- Newman 5.2.1
-- nvm 0.37.2
-- Packer 1.6.5
-- PhantomJS 2.1.1
-- Podman 2.1.1
-- Pulumi 2.14.0
-- R 4.0.3
-- Skopeo 1.2.0
-- Sphinx Open Source Search Server 2.2.11
-- SVN 1.9.7
-- Swig 3.0.12
-- Terraform 0.13.5
-- unzip 6.00
-- wget 1.19.4
-- yamllint 1.25.0
-- zip 3.0
-- zstd 1.3.3
-
-### CLI Tools
-- Alibaba Cloud CLI 3.0.63
-- AWS CLI 1.18.185
-- AWS CLI Session manager plugin 1.2.30.0
-- AWS SAM CLI 1.12.0
-- Azure CLI (azure-cli) 2.15.1
-- Azure CLI (azure-devops) 0.18.0
-- GitHub CLI 1.3.0
-- Google Cloud SDK 319.0.0
-- Hub CLI 2.14.2
-- Netlify CLI 2.69.0
-- oc CLI 4.5.0
-- ORAS CLI 0.8.1
-- Vercel CLI 21.0.1
-
-### Java
-| Version             | Vendor       | Environment Variable |
-| ------------------- | ------------ | -------------------- |
-| 1.7.0_285           | Zulu         | JAVA_HOME_7_X64      |
-| 1.8.0_275 (default) | AdoptOpenJDK | JAVA_HOME_8_X64      |
-| 11.0.9.1            | AdoptOpenJDK | JAVA_HOME_11_X64     |
-| 12.0.2              | AdoptOpenJDK | JAVA_HOME_12_X64     |
-
-### PHP
-| Tool     | Version                     |
-| -------- | --------------------------- |
-| PHP      | 7.1.33 7.2.34 7.3.24 7.4.13 |
-| Composer | 2.0.7                       |
-| PHPUnit  | 7.5.20                      |
-
-### Haskell
-- GHC 8.10.2
-- Cabal 3.4.0.0
-- Stack 2.5.1
-
-### Rust Tools
-- Rust 1.48.0
-- Rustup 1.23.0
-- Rustdoc 1.48.0
-- Cargo 1.48.0
-
-#### Packages
-- Bindgen 0.56.0
-- Cargo audit 0.13.1
-- Cargo outdated 0.9.13
-- Cargo clippy 0.0.212
-- Cbindgen 0.15.0
-- Rustfmt 1.4.24
-
-### Browsers and Drivers
-- Google Chrome 87.0.4280.66
-- ChromeDriver 87.0.4280.20
-- Mozilla Firefox 83.0
-- Geckodriver 0.28.0
-
-### .NET Core SDK
-- 2.1.300 2.1.301 2.1.302 2.1.401 2.1.402 2.1.403 2.1.500 2.1.502 2.1.503 2.1.504 2.1.505 2.1.506 2.1.507 2.1.508 2.1.509 2.1.510 2.1.511 2.1.512 2.1.513 2.1.514 2.1.515 2.1.516 2.1.517 2.1.518 2.1.519 2.1.602 2.1.603 2.1.604 2.1.605 2.1.606 2.1.607 2.1.608 2.1.609 2.1.610 2.1.611 2.1.612 2.1.613 2.1.614 2.1.615 2.1.616 2.1.700 2.1.701 2.1.801 2.1.802 2.1.803 2.1.804 2.1.805 2.1.806 2.1.807 2.1.808 2.1.809 2.1.810 2.1.811 3.0.100 3.0.101 3.0.102 3.0.103 3.1.100 3.1.101 3.1.102 3.1.103 3.1.104 3.1.105 3.1.106 3.1.107 3.1.108 3.1.109 3.1.110 3.1.200 3.1.201 3.1.202 3.1.300 3.1.301 3.1.302 3.1.401 3.1.402 3.1.403 3.1.404
-
-### Az Module
-- 1.0.0 1.6.0 2.3.2 2.6.0 2.8.0 3.1.0 3.5.0 3.8.0 4.3.0 4.4.0 4.6.0 4.7.0
-
-### Databases
-- Postgre SQL 13.1
-- MongoDB 4.4.2
-- sqlite3 3.22.0
-
-#### MySQL
-- MySQL 5.7.32
-- MySQL Server (user:root password:root)
-
-```
-    MySQL service is disabled by default. Use the following command as a part of your job to start the service: 'sudo systemctl start mysql.service'
-```
-#### MS SQL Server Client Tools
-- sqlcmd 17.6.0001.1
-
-### Cached Tools
-#### Ruby
-- 2.4.10
-- 2.5.8
-- 2.6.6
-- 2.7.2
-
-#### Python
-- 2.7.18
-- 3.5.10
-- 3.6.12
-- 3.7.9
-- 3.8.6
-- 3.9.0
-
-#### PyPy
-- 2.7.18 [PyPy 7.3.3]
-- 3.6.12 [PyPy 7.3.3]
-
-#### Node.js
-- 8.17.0
-- 10.23.0
-- 12.20.0
-- 14.15.1
-
-#### Go
-- 1.13.15
-- 1.14.12
-- 1.15.5
-
-#### Boost
-- 1.72.0
-
-### Android
-| Package Name               | Version                                                                                                                                                                                                                                                                                                          |
-| -------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
-| Android SDK Platform-Tools | 30.0.5                                                                                                                                                                                                                                                                                                           |
-| Android SDK Tools          | 26.1.1                                                                                                                                                                                                                                                                                                           |
-| Android SDK Platforms      | android-30 (rev 3)<br>android-29 (rev 5)<br>android-28 (rev 6)<br>android-27 (rev 3)<br>android-26 (rev 2)<br>android-25 (rev 3)<br>android-24 (rev 2)<br>android-23 (rev 3)<br>android-22 (rev 2)<br>android-21 (rev 2)<br>android-20 (rev 2)<br>android-19 (rev 4)<br>android-18 (rev 3)<br>android-17 (rev 3) |
-| Android SDK Build-tools    | 30.0.0 30.0.1 30.0.2<br>29.0.0 29.0.1 29.0.2 29.0.3<br>28.0.0 28.0.1 28.0.2 28.0.3<br>27.0.0 27.0.1 27.0.2 27.0.3<br>26.0.0 26.0.1 26.0.2 26.0.3<br>25.0.0 25.0.1 25.0.2 25.0.3<br>24.0.0 24.0.1 24.0.2 24.0.3<br>23.0.1 23.0.2 23.0.3<br>22.0.1<br>21.1.2<br>20.0.0<br>19.1.0                                   |
-| Google APIs                | addon-google_apis-google-21<br>addon-google_apis-google-22<br>addon-google_apis-google-23<br>addon-google_apis-google-24                                                                                                                                                                                         |
-| NDK                        | 21.3.6528147                                                                                                                                                                                                                                                                                                     |
-| Android Support Repository | 47.0.0                                                                                                                                                                                                                                                                                                           |
-| Google Play services       | 49                                                                                                                                                                                                                                                                                                               |
-| Google Repository          | 58                                                                                                                                                                                                                                                                                                               |
-| SDK Patch Applier v4       | 1                                                                                                                                                                                                                                                                                                                |
-| CMake                      | 3.10.2<br>3.6.4111459                                                                                                                                                                                                                                                                                            |
-
-### Cached Docker images
-| Repository:Tag                                            | Digest                                                                   | Created    |
-| --------------------------------------------------------- | ------------------------------------------------------------------------ | ---------- |
-| node:12                                                   | sha256:6e2db75c0a1e19ed760996957aef507f5abe1260ec412e8901855ac4a17a7ada  | 2020-11-25 |
-| node:12-alpine                                            | sha256:9f8d0fde57ef82d73d234d712edc211d1235469cb55426c0383b7eacf7d9199f  | 2020-11-25 |
-| node:10                                                   | sha256:14fa22a8989cd64ce811db9d47e3ed2910e0f2d95323240e23bc928201bbf313  | 2020-11-18 |
-| buildpack-deps:stretch                                    | sha256:c45c192a72b3155aca0c64fd0944e431a7c211bbc3383015a14cae3d3a389e79  | 2020-11-18 |
-| buildpack-deps:buster                                     | sha256:ad587f62e065044815955a4593500f79da89f5e5af95eb7798d1a4c869f50770  | 2020-11-18 |
-| debian:9                                                  | sha256:455a591bd690268d8f6f3dc6f2a84b9d0f3d1934828140d8ea2a5344a7c79063  | 2020-11-17 |
-| debian:8                                                  | sha256:0160d3bcc7266efe6a2a93dff33e3d54480bd2616a8ff5774c33fd8b482c8d75  | 2020-11-17 |
-| node:10-alpine                                            | sha256:34d01a98b50563abff4a8e18269f35d4eb1f33e911a38dd14e4798e430af5cac  | 2020-10-28 |
-| ubuntu:14.04                                              | sha256:63fce984528cec8714c365919882f8fb64c8a3edf23fdfa0b218a2756125456f  | 2020-09-16 |
-| jekyll/builder:latest                                     | sha256:4bc6a3b6eddebef1652ef38ceb965fc9c1b06677f65f764e1e17b88dc2aa9934  | 2020-09-03 |
-| alpine:3.9                                                | sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011  | 2020-04-24 |
-| alpine:3.10                                               | sha256:f0e9534a598e501320957059cb2a23774b4d4072e37c7b2cf7e95b241f019e35  | 2020-04-24 |
-| alpine:3.8                                                | sha256:2bb501e6173d9d006e56de5bce2720eb06396803300fe1687b58a7ff32bf4c14  | 2020-01-23 |
-| alpine:3.7                                                | sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10  | 2019-03-07 |
-| mcr.microsoft.com/azure-pipelines/node8-typescript:latest | sha256:e52e60b9f71183969830a3664279b5d8c799b4b0ec2c25a0686f7c02f6a9669a  | 2018-10-09 |
-
-### Installed apt packages
-- bison, brotli, bzip2, curl, dbus, dnsutils, dpkg, fakeroot, file, flex, ftp, gnupg2, iproute2, iputils-ping, jq, lib32z1, libc++-dev, libc++abi-dev, libcurl3, libgbm-dev, libgconf-2-4, libgtk-3-0, libsecret-1-dev, libsqlite3-dev, libunwind8, libxkbfile-dev, libxss1, locales, m4, netcat, openssh-client, parallel, patchelf, pkg-config, rpm, rsync, shellcheck, sqlite3, ssh, sudo, telnet, texinfo, time, tk, tzdata, unzip, upx, wget, xorriso, xvfb, xz-utils, zip, zstd, zsync
-
-
-

images/linux/Ubuntu1804-Readme.md

@@ -0,0 +1,370 @@
+| Announcements |
+|-|
+| [[All OSs] Python version 3.5 will be removed from the images on January 24, 2022](https://github.com/actions/virtual-environments/issues/4744) |
+***
+# Ubuntu 18.04.6 LTS
+- Linux kernel version: 5.4.0-1064-azure
+- Image Version: 20211219.1
+
+## Installed Software
+### Language and Runtime
+- Bash 4.4.20(1)-release
+- Clang 9.0.0
+- Clang-format 9.0.0
+- Erlang 24.1.7 (Eshell 12.1.5)
+- Erlang rebar3 3.17.0
+- GNU C++ 7.5.0, 9.4.0, 10.3.0
+- GNU Fortran 7.5.0, 9.4.0, 10.3.0
+- Julia 1.7.0
+- Kotlin 1.6.0-release-798
+- Mono 6.12.0.122 (apt source repository: https://download.mono-project.com/repo/ubuntu stable-bionic main)
+- MSBuild 16.6.0.15201 (from /usr/lib/mono/msbuild/15.0/bin/MSBuild.dll)
+- Node 16.13.1
+- Perl 5.26.1
+- Python 2.7.17
+- Python3 3.6.9
+- Ruby 2.5.1p57
+- Swift 5.5.2
+
+### Package Management
+- cpan 1.64
+- Helm 3.7.2
+- Homebrew 3.3.8
+- Miniconda 4.10.3
+- Npm 8.1.2
+- Pip 9.0.1
+- Pip3 9.0.1
+- Pipx 0.16.4
+- RubyGems 2.7.6
+- Vcpkg  (build from master \<50fd3d995>)
+- Yarn 1.22.17
+
+#### Environment variables
+| Name                    | Value                  |
+| ----------------------- | ---------------------- |
+| CONDA                   | /usr/share/miniconda   |
+| VCPKG_INSTALLATION_ROOT | /usr/local/share/vcpkg |
+
+### Project Management
+- Ant 1.10.5
+- Gradle 7.3.2
+- Maven 3.8.4
+- Sbt 1.5.7
+
+### Tools
+- Ansible 2.11.7
+- apt-fast 1.9.11
+- AzCopy 10.13.0 (available by `azcopy` and `azcopy10` aliases)
+- Bazel 4.2.2
+- Bazelisk 1.11.0
+- Bicep 0.4.1124
+- Buildah 1.19.6 (apt source repository: https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable)
+- CMake 3.22.1
+- CodeQL Action Bundle 2.7.3
+- Docker Compose v1 1.29.2
+- Docker Compose v2 2.2.2+azure-1
+- Docker-Buildx 0.7.1
+- Docker-Moby Client 20.10.11+azure-3
+- Docker-Moby Server 20.10.11+azure-3
+- Git 2.34.1 (apt source repository: ppa:git-core/ppa)
+- Git LFS 3.0.2 (apt source repository: https://packagecloud.io/install/repositories/github/git-lfs)
+- Git-ftp 1.3.1
+- Haveged 1.9.1
+- Heroku 7.59.2
+- HHVM (HipHop VM) 4.140.1
+- jq 1.5
+- Kind 0.11.1
+- Kubectl 1.23.1
+- Kustomize 4.4.1
+- Leiningen 2.9.8
+- MediaInfo 17.12
+- Mercurial 4.5.3
+- Minikube 1.24.0
+- n 8.0.1
+- Newman 5.3.0
+- nvm 0.39.1
+- OpenSSL 1.1.1  11 Sep 2018
+- Packer 1.7.8
+- Parcel 2.0.1
+- PhantomJS 2.1.1
+- Podman 3.0.1 (apt source repository: https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable)
+- Pulumi 3.19.0
+- R 4.1.2
+- Skopeo 1.2.2 (apt source repository: https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable)
+- Sphinx Open Source Search Server 2.2.11
+- SVN 1.9.7
+- Terraform 1.1.2
+- yamllint 1.26.3
+- yq 4.16.1
+- zstd 1.5.0 (homebrew)
+
+### CLI Tools
+- Alibaba Cloud CLI 3.0.102
+- AWS CLI 1.22.24
+- AWS CLI Session manager plugin 1.2.279.0
+- AWS SAM CLI 1.36.0
+- Azure CLI (azure-cli) 2.31.0 (installation method: https://docs.microsoft.com/en-us/cli/azure/install-azure-cli-linux?pivots=apt)
+- Azure CLI (azure-devops) 0.22.0
+- GitHub CLI 2.3.0
+- Google Cloud SDK 367.0.0 (apt source repository: https://packages.cloud.google.com/apt)
+- Hub CLI 2.14.2
+- Netlify CLI 8.1.8
+- OpenShift CLI 4.9.11
+- ORAS CLI 0.12.0
+- Vercel CLI 23.1.2
+
+### Java
+| Version             | Vendor        | Environment Variable |
+| ------------------- | ------------- | -------------------- |
+| 8.0.292+1 (default) | Adopt OpenJDK | JAVA_HOME_8_X64      |
+| 11.0.11+9           | Adopt OpenJDK | JAVA_HOME_11_X64     |
+| 12.0.2+10           | Adopt OpenJDK | JAVA_HOME_12_X64     |
+
+### PHP
+| Tool     | Version                                  |
+| -------- | ---------------------------------------- |
+| PHP      | 7.1.33 7.2.34 7.3.33 7.4.26 8.0.13 8.1.0 |
+| Composer | 2.1.14                                   |
+| PHPUnit  | 8.5.21                                   |
+```
+    Both Xdebug and PCOV extensions are installed, but only Xdebug is enabled.
+```
+### Haskell
+- Cabal 3.6.2.0
+- GHC 9.2.1
+- GHCup 0.1.17.4
+- Stack 2.7.3
+
+### Rust Tools
+- Cargo 1.57.0
+- Rust 1.57.0
+- Rustdoc 1.57.0
+- Rustup 1.24.3
+
+#### Packages
+- Bindgen 0.59.2
+- Cargo audit 0.16.0
+- Cargo clippy 0.1.57
+- Cargo outdated 0.10.2
+- Cbindgen 0.20.0
+- Rustfmt 1.4.37
+
+### Browsers and Drivers
+- Google Chrome 96.0.4664.110
+- ChromeDriver 96.0.4664.45
+- Mozilla Firefox 95.0
+- Geckodriver 0.30.0
+- Chromium 96.0.4664.0
+- Selenium server 4.1.0
+
+#### Environment variables
+| Name              | Value                               |
+| ----------------- | ----------------------------------- |
+| CHROMEWEBDRIVER   | /usr/local/share/chrome_driver      |
+| GECKOWEBDRIVER    | /usr/local/share/gecko_driver       |
+| SELENIUM_JAR_PATH | /usr/share/java/selenium-server.jar |
+
+### .NET Core SDK
+- 2.1.302 2.1.403 2.1.526 2.1.617 2.1.701 2.1.818 3.1.120 3.1.202 3.1.302 3.1.416 5.0.104 5.0.210 5.0.303 5.0.404
+
+### Databases
+- MongoDB 5.0.5 (apt source repository: https://repo.mongodb.org/apt/ubuntu)
+- PostgreSQL 14.1 (apt source repository: https://apt.postgresql.org/pub/repos/apt/)
+- sqlite3 3.22.0
+
+#### MySQL
+- MySQL 5.7.36
+- MySQL Server (user:root password:root)
+
+```
+    MySQL service is disabled by default. Use the following command as a part of your job to start the service: 'sudo systemctl start mysql.service'
+```
+#### MS SQL Server Client Tools
+- sqlcmd 17.8.0001.1
+- SqlPackage 15.0.5282.3
+
+### Cached Tools
+#### Go
+- 1.15.15
+- 1.16.12
+- 1.17.5
+
+#### Node.js
+- 12.22.8
+- 14.18.2
+- 16.13.1
+
+#### PyPy
+- 2.7.18 [PyPy 7.3.6]
+- 3.6.12 [PyPy 7.3.3]
+
+#### Python
+- 2.7.18
+- 3.5.10
+- 3.6.15
+- 3.7.12
+- 3.8.12
+- 3.9.9
+- 3.10.1
+
+#### Ruby
+- 2.4.10
+- 2.5.9
+- 2.6.9
+- 2.7.5
+- 3.0.3
+
+#### Environment variables
+| Name            | Value                               | Architecture |
+| --------------- | ----------------------------------- | ------------ |
+| GOROOT_1_15_X64 | /opt/hostedtoolcache/go/1.15.15/x64 | x64          |
+| GOROOT_1_16_X64 | /opt/hostedtoolcache/go/1.16.12/x64 | x64          |
+| GOROOT_1_17_X64 | /opt/hostedtoolcache/go/1.17.5/x64  | x64          |
+
+### PowerShell Tools
+- PowerShell 7.2.1
+
+#### PowerShell Modules
+| Module     | Version |
+| ---------- | ------- |
+| MarkdownPS | 1.9     |
+| Pester     | 5.3.1   |
+
+#### Az PowerShell Modules
+- 6.4.0 3.1.0.zip 4.4.0.zip 5.9.0.zip
+
+### Web Servers
+| Name    | Version | ConfigFile                | ServiceStatus | ListenPort |
+| ------- | ------- | ------------------------- | ------------- | ---------- |
+| apache2 | 2.4.29  | /etc/apache2/apache2.conf | inactive      | 80         |
+| nginx   | 1.14.0  | /etc/nginx/nginx.conf     | inactive      | 80         |
+
+### Android
+| Package Name               | Version                                                                                                                                                                                                                                                           |
+| -------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| Android Command Line Tools | 4.0                                                                                                                                                                                                                                                               |
+| Android Emulator           | 31.1.4                                                                                                                                                                                                                                                            |
+| Android SDK Build-tools    | 32.0.0<br>31.0.0<br>30.0.0 30.0.1 30.0.2 30.0.3<br>29.0.0 29.0.1 29.0.2 29.0.3<br>28.0.0 28.0.1 28.0.2 28.0.3<br>27.0.0 27.0.1 27.0.2 27.0.3<br>26.0.0 26.0.1 26.0.2 26.0.3<br>25.0.0 25.0.1 25.0.2 25.0.3<br>24.0.0 24.0.1 24.0.2 24.0.3<br>23.0.1 23.0.2 23.0.3 |
+| Android SDK Platform-Tools | 31.0.3                                                                                                                                                                                                                                                            |
+| Android SDK Platforms      | android-32 (rev 1)<br>android-31 (rev 1)<br>android-30 (rev 3)<br>android-29 (rev 5)<br>android-28 (rev 6)<br>android-27 (rev 3)<br>android-26 (rev 2)<br>android-25 (rev 3)<br>android-24 (rev 2)<br>android-23 (rev 3)                                          |
+| Android SDK Tools          | 26.1.1                                                                                                                                                                                                                                                            |
+| Android Support Repository | 47.0.0                                                                                                                                                                                                                                                            |
+| CMake                      | 3.10.2<br>3.18.1                                                                                                                                                                                                                                                  |
+| Google APIs                | addon-google_apis-google-21<br>addon-google_apis-google-22<br>addon-google_apis-google-23<br>addon-google_apis-google-24                                                                                                                                          |
+| Google Play services       | 49                                                                                                                                                                                                                                                                |
+| Google Repository          | 58                                                                                                                                                                                                                                                                |
+| NDK                        | 21.4.7075529 (default)<br>23.1.7779620                                                                                                                                                                                                                            |
+| SDK Patch Applier v4       | 1                                                                                                                                                                                                                                                                 |
+
+#### Environment variables
+| Name                    | Value                                                                                |
+| ----------------------- | ------------------------------------------------------------------------------------ |
+| ANDROID_HOME            | /usr/local/lib/android/sdk                                                           |
+| ANDROID_NDK_HOME        | /usr/local/lib/android/sdk/ndk-bundle -> /usr/local/lib/android/sdk/ndk/21.4.7075529 |
+| ANDROID_NDK_LATEST_HOME | /usr/local/lib/android/sdk/ndk/23.1.7779620                                          |
+| ANDROID_NDK_ROOT        | /usr/local/lib/android/sdk/ndk-bundle -> /usr/local/lib/android/sdk/ndk/21.4.7075529 |
+| ANDROID_SDK_ROOT        | /usr/local/lib/android/sdk                                                           |
+
+### Cached Docker images
+| Repository:Tag          | Digest                                                                   | Created    |
+| ----------------------- | ------------------------------------------------------------------------ | ---------- |
+| alpine:3.12             | sha256:d9459083f962de6bd980ae6a05be2a4cf670df6a1d898157bceb420342bec280  | 2021-11-12 |
+| alpine:3.13             | sha256:026f721af4cf2843e07bba648e158fb35ecc876d822130633cc49f707f0fc88c  | 2021-11-12 |
+| alpine:3.14             | sha256:635f0aa53d99017b38d1a0aa5b2082f7812b03e3cdb299103fe77b5c8a07f1d2  | 2021-11-12 |
+| buildpack-deps:bullseye | sha256:5445b145c8a1a2f7e5a4b233f571c629aed12fce435496f942ad267f21a05ff2  | 2021-12-02 |
+| buildpack-deps:buster   | sha256:c11cd0a4c97acd1aa8d2289aee5c126ac78adc48108744c104f6741cbd9a1f6c  | 2021-12-02 |
+| buildpack-deps:stretch  | sha256:bb93e2c2858cb20f7f16e433773adb2c583fce38dc9c71976c62bf098f956093  | 2021-12-02 |
+| debian:10               | sha256:5b57f8c365c40fde437d53b953c436995525be7c481eb0128b1cbf3b49b0df18  | 2021-12-02 |
+| debian:11               | sha256:45ee40a844048c2f6d0105899c1a17733530b56d481612608aab5e2e4048570b  | 2021-12-02 |
+| debian:9                | sha256:aa78ddaa7f8a14bad8f940ebff5542377f91843f6dcc168e41a8628c6007e815  | 2021-12-02 |
+| moby/buildkit:latest    | sha256:d6c89b7085b106301645ddcc77cf64eb7b705ab507b72d52d130ac33f1300417  | 2021-11-18 |
+| node:12                 | sha256:f881ce751096a214a7e595b0ccf9ee7d6e38d8e0141d7e9d5880b2f242ad392b  | 2021-12-18 |
+| node:12-alpine          | sha256:8fad09b7620b2bc715cbba92e3313c64a797e453f560118576f1740a44584d5d  | 2021-12-18 |
+| node:14                 | sha256:52c884d7cf8509c27def168415a1ff23a0bd95d358dd5787ca77b60474dcb3db  | 2021-12-02 |
+| node:14-alpine          | sha256:7bcf853eeb97a25465cb385b015606c22e926f548cbd117f85b7196df8aa0d29  | 2021-12-02 |
+| node:16                 | sha256:89b59ce49929d8a8e230946bdb1b58c14cdbbb86c9a7397610afcecfce1be035  | 2021-12-02 |
+| node:16-alpine          | sha256:a9b9cb880fa429b0bea899cd3b1bc081ab7277cc97e6d2dcd84bd9753b2027e1  | 2021-12-02 |
+| ubuntu:16.04            | sha256:0f71fa8d4d2d4292c3c617fda2b36f6dabe5c8b6e34c3dc5b0d17d4e704bd39c  | 2021-08-31 |
+| ubuntu:18.04            | sha256:0fedbd5bd9fb72089c7bbca476949e10593cebed9b1fb9edf5b79dbbacddd7d6  | 2021-10-01 |
+| ubuntu:20.04            | sha256:626ffe58f6e7566e00254b638eb7e0f3b11d4da9675088f4781a50ae288f3322  | 2021-10-16 |
+
+### Installed apt packages
+| Name              | Version                           |
+| ----------------- | --------------------------------- |
+| aria2             | 1.33.1-1                          |
+| binutils          | 2.30-21ubuntu1\~18.04.7           |
+| bison             | 2:3.0.4.dfsg-1build1              |
+| brotli            | 1.0.3-1ubuntu1.3                  |
+| build-essential   | 12.4ubuntu1                       |
+| bzip2             | 1.0.6-8.1ubuntu0.2                |
+| coreutils         | 8.28-1ubuntu1                     |
+| curl              | 7.58.0-2ubuntu3.16                |
+| dbus              | 1.12.2-1ubuntu1.2                 |
+| dnsutils          | 1:9.11.3+dfsg-1ubuntu1.16         |
+| dpkg              | 1.19.0.5ubuntu2.3                 |
+| fakeroot          | 1.22-2ubuntu1                     |
+| file              | 1:5.32-2ubuntu0.4                 |
+| flex              | 2.6.4-6                           |
+| ftp               | 0.17-34                           |
+| gnupg2            | 2.2.4-1ubuntu1.4                  |
+| haveged           | 1.9.1-6                           |
+| imagemagick       | 8:6.9.7.4+dfsg-16ubuntu6.12       |
+| iproute2          | 4.15.0-2ubuntu1.3                 |
+| iputils-ping      | 3:20161105-1ubuntu3               |
+| jq                | 1.5+dfsg-2                        |
+| lib32z1           | 1:1.2.11.dfsg-0ubuntu2            |
+| libc++-dev        | 6.0-2                             |
+| libc++abi-dev     | 6.0-2                             |
+| libcurl3          | 7.58.0-2ubuntu3.16                |
+| libgbm-dev        | 20.0.8-0ubuntu1\~18.04.1          |
+| libgconf-2-4      | 3.2.6-4ubuntu1                    |
+| libgsl-dev        | 2.4+dfsg-6                        |
+| libgtk-3-0        | 3.22.30-1ubuntu4                  |
+| libmagic-dev      | 1:5.32-2ubuntu0.4                 |
+| libmagickcore-dev | 8:6.9.7.4+dfsg-16ubuntu6.12       |
+| libmagickwand-dev | 8:6.9.7.4+dfsg-16ubuntu6.12       |
+| libsecret-1-dev   | 0.18.6-1                          |
+| libsqlite3-dev    | 3.22.0-1ubuntu0.4                 |
+| libunwind8        | 1.2.1-8                           |
+| libxkbfile-dev    | 1:1.0.9-2                         |
+| libxss1           | 1:1.2.2-1                         |
+| locales           | 2.27-3ubuntu1.4                   |
+| m4                | 1.4.18-1                          |
+| mediainfo         | 17.12-1                           |
+| mercurial         | 4.5.3-1ubuntu2.2                  |
+| net-tools         | 1.60+git20161116.90da8a0-1ubuntu1 |
+| netcat            | 1.10-41.1                         |
+| openssh-client    | 1:7.6p1-4ubuntu0.5                |
+| p7zip-full        | 16.02+dfsg-6                      |
+| p7zip-rar         | 16.02-2                           |
+| parallel          | 20161222-1                        |
+| pass              | 1.7.1-3                           |
+| patchelf          | 0.9-1                             |
+| pkg-config        | 0.29.1-0ubuntu2                   |
+| pollinate         | 4.33-0ubuntu1\~18.04.2            |
+| python-setuptools | 39.0.1-2                          |
+| rpm               | 4.14.1+dfsg1-2                    |
+| rsync             | 3.1.2-2.1ubuntu1.2                |
+| shellcheck        | 0.4.6-1                           |
+| sphinxsearch      | 2.2.11-2                          |
+| sqlite3           | 3.22.0-1ubuntu0.4                 |
+| ssh               | 1:7.6p1-4ubuntu0.5                |
+| sshpass           | 1.06-1                            |
+| subversion        | 1.9.7-4ubuntu1                    |
+| sudo              | 1.8.21p2-3ubuntu1.4               |
+| swig              | 3.0.12-1                          |
+| telnet            | 0.17-41                           |
+| texinfo           | 6.5.0.dfsg.1-2                    |
+| time              | 1.7-25.1build1                    |
+| tk                | 8.6.0+9                           |
+| tzdata            | 2021e-0ubuntu0.18.04              |
+| unzip             | 6.0-21ubuntu1.1                   |
+| upx               | 3.94-4                            |
+| wget              | 1.19.4-1ubuntu2.2                 |
+| xorriso           | 1.4.8-3                           |
+| xvfb              | 2:1.19.6-1ubuntu4.10              |
+| xz-utils          | 5.2.2-1.3                         |
+| zip               | 3.0-11build1                      |
+| zsync             | 0.6.2-3ubuntu1                    |
+
+

images/linux/Ubuntu2004-README.md

@@ -1,230 +0,0 @@
-| Announcements |
-|-|
-| [[Ubuntu] Default Clang will be set to Clang 11 on December, 14](https://github.com/actions/virtual-environments/issues/2130) |
-| [.NET 5.0 will become a default .NET version on December, 14](https://github.com/actions/virtual-environments/issues/1891) |
-| [Ubuntu-latest workflows will use Ubuntu-20.04](https://github.com/actions/virtual-environments/issues/1816) |
-| [Official Ruby binaries will be installed on images by default](https://github.com/actions/virtual-environments/issues/2193) |
-***
-# Ubuntu 20.04.1 LTS
-- Image Version: 20201130.1
-
-## Installed Software
-### Language and Runtime
-- GNU C++ 7.5.0, 8.4.0, 9.3.0, 10.2.0
-- GNU Fortran 8.4.0, 9.3.0, 10.2.0
-- Clang 8.0.1, 9.0.1, 10.0.0
-- Erlang 11.1
-- Mono 6.12.0.90
-- Node 14.15.1
-- Python 3.8.5
-- Python3 3.8.5
-- PowerShell 7.1.0
-- Ruby 2.7.0p0
-- Swift 5.3.1
-- Julia 1.5.3
-
-### Package Management
-- Gem 3.1.2
-- Helm 3.4.1
-- Homebrew 2.5.12
-- Miniconda 4.9.2
-- Npm 6.14.9
-- Pip 20.0.2
-- Pip3 20.0.2
-- Pipx 0.15.6.0
-- Vcpkg 2020.11.12
-- Yarn 1.22.5
-
-### Project Management
-- Ant 1.10.7
-- Gradle 6.7.1
-- Maven 3.6.3
-- Sbt 1.4.4
-
-### Tools
-- 7-Zip 16.02
-- Ansible 2.9.6
-- apt-fast 1.9.10
-- AzCopy10 10.7.0 (available by `azcopy10` alias)
-- AzCopy7 7.3.0 (available by `azcopy` alias)
-- Bazel 3.7.1
-- Bazelisk 1.7.3
-- Buildah 1.18.0
-- CMake 3.19.1
-- CodeQL Action Bundle 2.3.3
-- curl 7.68.0
-- Docker Compose 1.27.4
-- Docker-Buildx 0.4.2
-- Docker-Moby 19.03.13
-- Git 2.29.2
-- Git LFS 2.12.1
-- Git-ftp 1.6.0
-- Haveged 1.9.1
-- Heroku 7.47.3
-- HHVM (HipHop VM) 4.84.0
-- jq 1.6
-- Kind 0.9.0
-- Kubectl 1.19.4
-- Kustomize 3.8.7
-- Leiningen 2.9.4
-- m4 1.4.18
-- Mercurial 5.3.1
-- Minikube 1.15.1
-- Newman 5.2.1
-- nvm 0.37.2
-- Packer 1.6.5
-- PhantomJS 2.1.1
-- Podman 2.1.1
-- Pulumi 2.14.0
-- R 4.0.3
-- Skopeo 1.2.0
-- Sphinx Open Source Search Server 2.2.11
-- SVN 1.13.0
-- Swig 4.0.1
-- Terraform 0.13.5
-- unzip 6.00
-- wget 1.20.3
-- yamllint 1.25.0
-- zip 3.0
-- zstd 1.4.4
-
-### CLI Tools
-- Alibaba Cloud CLI 3.0.63
-- AWS CLI 2.1.4
-- AWS CLI Session manager plugin 1.2.30.0
-- AWS SAM CLI 1.12.0
-- Azure CLI (azure-cli) 2.15.1
-- Azure CLI (azure-devops) 0.18.0
-- GitHub CLI 1.3.0
-- Google Cloud SDK 319.0.0
-- Hub CLI 2.14.2
-- Netlify CLI 2.69.0
-- oc CLI 4.5.0
-- ORAS CLI 0.8.1
-- Vercel CLI 21.0.1
-
-### Java
-| Version            | Vendor       | Environment Variable |
-| ------------------ | ------------ | -------------------- |
-| 1.8.0_275          | AdoptOpenJDK | JAVA_HOME_8_X64      |
-| 11.0.9.1 (default) | AdoptOpenJDK | JAVA_HOME_11_X64     |
-
-### PHP
-| Tool     | Version |
-| -------- | ------- |
-| PHP      | 7.4.13  |
-| Composer | 2.0.7   |
-| PHPUnit  | 7.5.20  |
-
-### Haskell
-- GHC 8.10.2
-- Cabal 3.4.0.0
-- Stack 2.5.1
-
-### Rust Tools
-- Rust 1.48.0
-- Rustup 1.23.0
-- Rustdoc 1.48.0
-- Cargo 1.48.0
-
-#### Packages
-- Bindgen 0.56.0
-- Cargo audit 0.13.1
-- Cargo outdated 0.9.13
-- Cargo clippy 0.0.212
-- Cbindgen 0.15.0
-- Rustfmt 1.4.24
-
-### Browsers and Drivers
-- Google Chrome 87.0.4280.66
-- ChromeDriver 87.0.4280.20
-- Mozilla Firefox 83.0
-- Geckodriver 0.28.0
-
-### .NET Core SDK
-- 2.1.300 2.1.301 2.1.302 2.1.401 2.1.402 2.1.403 2.1.500 2.1.502 2.1.503 2.1.504 2.1.505 2.1.506 2.1.507 2.1.508 2.1.509 2.1.510 2.1.511 2.1.512 2.1.513 2.1.514 2.1.515 2.1.516 2.1.517 2.1.518 2.1.519 2.1.602 2.1.603 2.1.604 2.1.605 2.1.606 2.1.607 2.1.608 2.1.609 2.1.610 2.1.611 2.1.612 2.1.613 2.1.614 2.1.615 2.1.616 2.1.700 2.1.701 2.1.801 2.1.802 2.1.803 2.1.804 2.1.805 2.1.806 2.1.807 2.1.808 2.1.809 2.1.810 2.1.811 3.1.100 3.1.101 3.1.102 3.1.103 3.1.104 3.1.105 3.1.106 3.1.107 3.1.108 3.1.109 3.1.110 3.1.200 3.1.201 3.1.202 3.1.300 3.1.301 3.1.302 3.1.401 3.1.402 3.1.403 3.1.404
-
-### Az Module
-- 3.8.0 4.8.0
-
-### Databases
-- Postgre SQL 13.1
-- MongoDB 4.4.2
-- sqlite3 3.31.1
-
-#### MySQL
-- MySQL 8.0.22
-- MySQL Server (user:root password:root)
-
-```
-    MySQL service is disabled by default. Use the following command as a part of your job to start the service: 'sudo systemctl start mysql.service'
-```
-#### MS SQL Server Client Tools
-- sqlcmd 17.6.0001.1
-
-### Cached Tools
-#### Ruby
-- 2.5.8
-- 2.6.6
-- 2.7.2
-
-#### Python
-- 2.7.18
-- 3.5.10
-- 3.6.12
-- 3.7.9
-- 3.8.6
-- 3.9.0
-
-#### PyPy
-- 2.7.18 [PyPy 7.3.3]
-- 3.6.12 [PyPy 7.3.3]
-
-#### Node.js
-- 8.17.0
-- 10.23.0
-- 12.20.0
-- 14.15.1
-
-#### Go
-- 1.14.12
-- 1.15.5
-
-### Android
-| Package Name               | Version                                                                                                           |
-| -------------------------- | ----------------------------------------------------------------------------------------------------------------- |
-| Android SDK Platform-Tools | 30.0.5                                                                                                            |
-| Android SDK Tools          | 26.1.1                                                                                                            |
-| Android SDK Platforms      | android-30 (rev 3)<br>android-29 (rev 5)<br>android-28 (rev 6)<br>android-27 (rev 3)                              |
-| Android SDK Build-tools    | 30.0.0 30.0.1 30.0.2<br>29.0.0 29.0.1 29.0.2 29.0.3<br>28.0.0 28.0.1 28.0.2 28.0.3<br>27.0.0 27.0.1 27.0.2 27.0.3 |
-| NDK                        | 21.3.6528147                                                                                                      |
-| Android Support Repository | 47.0.0                                                                                                            |
-| Google Play services       | 49                                                                                                                |
-| Google Repository          | 58                                                                                                                |
-| SDK Patch Applier v4       | 1                                                                                                                 |
-| CMake                      | 3.10.2                                                                                                            |
-
-### Cached Docker images
-| Repository:Tag                                            | Digest                                                                   | Created    |
-| --------------------------------------------------------- | ------------------------------------------------------------------------ | ---------- |
-| node:12                                                   | sha256:6e2db75c0a1e19ed760996957aef507f5abe1260ec412e8901855ac4a17a7ada  | 2020-11-25 |
-| node:12-alpine                                            | sha256:9f8d0fde57ef82d73d234d712edc211d1235469cb55426c0383b7eacf7d9199f  | 2020-11-25 |
-| node:10                                                   | sha256:14fa22a8989cd64ce811db9d47e3ed2910e0f2d95323240e23bc928201bbf313  | 2020-11-18 |
-| buildpack-deps:stretch                                    | sha256:c45c192a72b3155aca0c64fd0944e431a7c211bbc3383015a14cae3d3a389e79  | 2020-11-18 |
-| buildpack-deps:buster                                     | sha256:ad587f62e065044815955a4593500f79da89f5e5af95eb7798d1a4c869f50770  | 2020-11-18 |
-| debian:9                                                  | sha256:455a591bd690268d8f6f3dc6f2a84b9d0f3d1934828140d8ea2a5344a7c79063  | 2020-11-17 |
-| debian:8                                                  | sha256:0160d3bcc7266efe6a2a93dff33e3d54480bd2616a8ff5774c33fd8b482c8d75  | 2020-11-17 |
-| node:10-alpine                                            | sha256:34d01a98b50563abff4a8e18269f35d4eb1f33e911a38dd14e4798e430af5cac  | 2020-10-28 |
-| ubuntu:14.04                                              | sha256:63fce984528cec8714c365919882f8fb64c8a3edf23fdfa0b218a2756125456f  | 2020-09-16 |
-| jekyll/builder:latest                                     | sha256:4bc6a3b6eddebef1652ef38ceb965fc9c1b06677f65f764e1e17b88dc2aa9934  | 2020-09-03 |
-| alpine:3.9                                                | sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011  | 2020-04-24 |
-| alpine:3.10                                               | sha256:f0e9534a598e501320957059cb2a23774b4d4072e37c7b2cf7e95b241f019e35  | 2020-04-24 |
-| alpine:3.8                                                | sha256:2bb501e6173d9d006e56de5bce2720eb06396803300fe1687b58a7ff32bf4c14  | 2020-01-23 |
-| alpine:3.7                                                | sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10  | 2019-03-07 |
-| mcr.microsoft.com/azure-pipelines/node8-typescript:latest | sha256:e52e60b9f71183969830a3664279b5d8c799b4b0ec2c25a0686f7c02f6a9669a  | 2018-10-09 |
-
-### Installed apt packages
-- bison, brotli, bzip2, curl, dbus, dnsutils, dpkg, fakeroot, file, flex, ftp, gnupg2, iproute2, iputils-ping, jq, lib32z1, libc++-dev, libc++abi-dev, libcurl4, libgbm-dev, libgconf-2-4, libgtk-3-0, libsecret-1-dev, libsqlite3-dev, libunwind8, libxkbfile-dev, libxss1, locales, m4, netcat, openssh-client, parallel, patchelf, pkg-config, python-is-python3, rpm, rsync, shellcheck, sqlite3, ssh, sudo, telnet, texinfo, time, tk, tzdata, unzip, upx, wget, xorriso, xvfb, xz-utils, zip, zstd, zsync
-
-
-

images/linux/Ubuntu2004-Readme.md

@@ -0,0 +1,380 @@
+| Announcements |
+|-|
+| [[All OSs] Python version 3.5 will be removed from the images on January 24, 2022](https://github.com/actions/virtual-environments/issues/4744) |
+***
+# Ubuntu 20.04.3 LTS
+- Linux kernel version: 5.11.0-1022-azure
+- Image Version: 20211219.1
+
+## Installed Software
+### Language and Runtime
+- Bash 5.0.17(1)-release
+- Clang 10.0.0, 11.0.0, 12.0.0
+- Clang-format 10.0.0, 11.0.0, 12.0.0
+- Erlang 24.1.7 (Eshell 12.1.5)
+- Erlang rebar3 3.17.0
+- GNU C++ 9.3.0, 10.3.0
+- GNU Fortran 9.3.0, 10.3.0
+- Julia 1.7.0
+- Kotlin 1.6.0-release-798
+- Mono 6.12.0.122 (apt source repository: https://download.mono-project.com/repo/ubuntu stable-focal main)
+- MSBuild 16.6.0.15201 (from /usr/lib/mono/msbuild/15.0/bin/MSBuild.dll)
+- Node 16.13.1
+- Perl 5.30.0
+- Python 3.8.10
+- Python3 3.8.10
+- Ruby 2.7.0p0
+- Swift 5.5.2
+
+### Package Management
+- cpan 1.64
+- Helm 3.7.2
+- Homebrew 3.3.8
+- Miniconda 4.10.3
+- Npm 8.1.2
+- Pip 20.0.2
+- Pip3 20.0.2
+- Pipx 0.16.4
+- RubyGems 3.1.2
+- Vcpkg  (build from master \<50fd3d995>)
+- Yarn 1.22.17
+
+#### Environment variables
+| Name                    | Value                  |
+| ----------------------- | ---------------------- |
+| CONDA                   | /usr/share/miniconda   |
+| VCPKG_INSTALLATION_ROOT | /usr/local/share/vcpkg |
+
+### Project Management
+- Ant 1.10.7
+- Gradle 7.3.2
+- Lerna 4.0.0
+- Maven 3.8.4
+- Sbt 1.5.7
+
+### Tools
+- Ansible 2.12.1
+- apt-fast 1.9.11
+- AzCopy 10.13.0 (available by `azcopy` and `azcopy10` aliases)
+- Bazel 4.2.2
+- Bazelisk 1.11.0
+- Bicep 0.4.1124
+- Buildah 1.21.3 (apt source repository: https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable)
+- CMake 3.22.1
+- CodeQL Action Bundle 2.7.3
+- Docker Compose v1 1.29.2
+- Docker Compose v2 2.2.2+azure-1
+- Docker-Buildx 0.7.1
+- Docker-Moby Client 20.10.11+azure-3
+- Docker-Moby Server 20.10.11+azure-3
+- Fastlane 2.199.0
+- Git 2.34.1 (apt source repository: ppa:git-core/ppa)
+- Git LFS 3.0.2 (apt source repository: https://packagecloud.io/install/repositories/github/git-lfs)
+- Git-ftp 1.6.0
+- Haveged 1.9.1
+- Heroku 7.59.2
+- HHVM (HipHop VM) 4.140.1
+- jq 1.6
+- Kind 0.11.1
+- Kubectl 1.23.1
+- Kustomize 4.4.1
+- Leiningen 2.9.8
+- MediaInfo 19.09
+- Mercurial 5.3.1
+- Minikube 1.24.0
+- n 8.0.1
+- Newman 5.3.0
+- nvm 0.39.1
+- OpenSSL 1.1.1f  31 Mar 2020
+- Packer 1.7.8
+- Parcel 2.0.1
+- PhantomJS 2.1.1
+- Podman 3.4.2 (apt source repository: https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable)
+- Pulumi 3.19.0
+- R 4.1.2
+- Skopeo 1.3.0 (apt source repository: https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable)
+- Sphinx Open Source Search Server 2.2.11
+- SVN 1.13.0
+- Terraform 1.1.2
+- yamllint 1.26.3
+- yq 4.16.1
+- zstd 1.5.0 (homebrew)
+
+### CLI Tools
+- Alibaba Cloud CLI 3.0.102
+- AWS CLI 2.4.6
+- AWS CLI Session manager plugin 1.2.279.0
+- AWS SAM CLI 1.36.0
+- Azure CLI (azure-cli) 2.31.0 (installation method: https://docs.microsoft.com/en-us/cli/azure/install-azure-cli-linux?pivots=apt)
+- Azure CLI (azure-devops) 0.22.0
+- GitHub CLI 2.3.0
+- Google Cloud SDK 367.0.0 (apt source repository: https://packages.cloud.google.com/apt)
+- Hub CLI 2.14.2
+- Netlify CLI 8.1.8
+- OpenShift CLI 4.9.11
+- ORAS CLI 0.12.0
+- Vercel CLI 23.1.2
+
+### Java
+| Version             | Vendor        | Environment Variable |
+| ------------------- | ------------- | -------------------- |
+| 8.0.292+1           | Adopt OpenJDK | JAVA_HOME_8_X64      |
+| 11.0.11+9 (default) | Adopt OpenJDK | JAVA_HOME_11_X64     |
+
+### GraalVM
+| Version   | Environment variables |
+| --------- | --------------------- |
+| CE 21.3.0 | GRAALVM_11_ROOT       |
+
+### PHP
+| Tool     | Version             |
+| -------- | ------------------- |
+| PHP      | 7.4.26 8.0.13 8.1.0 |
+| Composer | 2.1.14              |
+| PHPUnit  | 8.5.21              |
+```
+    Both Xdebug and PCOV extensions are installed, but only Xdebug is enabled.
+```
+### Haskell
+- Cabal 3.6.2.0
+- GHC 9.2.1
+- GHCup 0.1.17.4
+- Stack 2.7.3
+
+### Rust Tools
+- Cargo 1.57.0
+- Rust 1.57.0
+- Rustdoc 1.57.0
+- Rustup 1.24.3
+
+#### Packages
+- Bindgen 0.59.2
+- Cargo audit 0.16.0
+- Cargo clippy 0.1.57
+- Cargo outdated 0.10.2
+- Cbindgen 0.20.0
+- Rustfmt 1.4.37
+
+### Browsers and Drivers
+- Google Chrome 96.0.4664.110
+- ChromeDriver 96.0.4664.45
+- Mozilla Firefox 95.0
+- Geckodriver 0.30.0
+- Chromium 96.0.4664.0
+- Selenium server 4.1.0
+
+#### Environment variables
+| Name              | Value                               |
+| ----------------- | ----------------------------------- |
+| CHROMEWEBDRIVER   | /usr/local/share/chrome_driver      |
+| GECKOWEBDRIVER    | /usr/local/share/gecko_driver       |
+| SELENIUM_JAR_PATH | /usr/share/java/selenium-server.jar |
+
+### .NET Core SDK
+- 2.1.302 2.1.403 2.1.526 2.1.617 2.1.701 2.1.818 3.1.120 3.1.202 3.1.302 3.1.416 5.0.104 5.0.210 5.0.303 5.0.404
+
+### Databases
+- MongoDB 5.0.5 (apt source repository: https://repo.mongodb.org/apt/ubuntu)
+- PostgreSQL 14.1 (apt source repository: https://apt.postgresql.org/pub/repos/apt/)
+- sqlite3 3.31.1
+
+#### MySQL
+- MySQL 8.0.26
+- MySQL Server (user:root password:root)
+
+```
+    MySQL service is disabled by default. Use the following command as a part of your job to start the service: 'sudo systemctl start mysql.service'
+```
+#### MS SQL Server Client Tools
+- sqlcmd 17.8.0001.1
+- SqlPackage 15.0.5282.3
+
+### Cached Tools
+#### Go
+- 1.15.15
+- 1.16.12
+- 1.17.5
+
+#### Node.js
+- 12.22.8
+- 14.18.2
+- 16.13.1
+
+#### PyPy
+- 2.7.18 [PyPy 7.3.6]
+- 3.6.12 [PyPy 7.3.3]
+- 3.7.12 [PyPy 7.3.7]
+- 3.8.12 [PyPy 7.3.7]
+
+#### Python
+- 2.7.18
+- 3.5.10
+- 3.6.15
+- 3.7.12
+- 3.8.12
+- 3.9.9
+- 3.10.1
+
+#### Ruby
+- 2.5.9
+- 2.6.9
+- 2.7.5
+- 3.0.3
+
+#### Environment variables
+| Name            | Value                               | Architecture |
+| --------------- | ----------------------------------- | ------------ |
+| GOROOT_1_15_X64 | /opt/hostedtoolcache/go/1.15.15/x64 | x64          |
+| GOROOT_1_16_X64 | /opt/hostedtoolcache/go/1.16.12/x64 | x64          |
+| GOROOT_1_17_X64 | /opt/hostedtoolcache/go/1.17.5/x64  | x64          |
+
+### PowerShell Tools
+- PowerShell 7.2.1
+
+#### PowerShell Modules
+| Module           | Version |
+| ---------------- | ------- |
+| MarkdownPS       | 1.9     |
+| Pester           | 5.3.1   |
+| PSScriptAnalyzer | 1.20.0  |
+
+#### Az PowerShell Modules
+- 6.4.0 3.1.0.zip 4.4.0.zip 5.9.0.zip
+
+### Web Servers
+| Name      | Version | ConfigFile                | ServiceStatus | ListenPort |
+| --------- | ------- | ------------------------- | ------------- | ---------- |
+| apache2   | 2.4.41  | /etc/apache2/apache2.conf | inactive      | 80         |
+| mono-xsp4 | 4.7.1   | /etc/default/mono-xsp4    | active        | 8084       |
+| nginx     | 1.18.0  | /etc/nginx/nginx.conf     | inactive      | 80         |
+
+### Android
+| Package Name               | Version                                                                                                                                      |
+| -------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------- |
+| Android Command Line Tools | 4.0                                                                                                                                          |
+| Android Emulator           | 31.1.4                                                                                                                                       |
+| Android SDK Build-tools    | 32.0.0<br>31.0.0<br>30.0.0 30.0.1 30.0.2 30.0.3<br>29.0.0 29.0.1 29.0.2 29.0.3<br>28.0.0 28.0.1 28.0.2 28.0.3<br>27.0.0 27.0.1 27.0.2 27.0.3 |
+| Android SDK Platform-Tools | 31.0.3                                                                                                                                       |
+| Android SDK Platforms      | android-32 (rev 1)<br>android-31 (rev 1)<br>android-30 (rev 3)<br>android-29 (rev 5)<br>android-28 (rev 6)<br>android-27 (rev 3)             |
+| Android SDK Tools          | 26.1.1                                                                                                                                       |
+| Android Support Repository | 47.0.0                                                                                                                                       |
+| CMake                      | 3.10.2<br>3.18.1                                                                                                                             |
+| Google Play services       | 49                                                                                                                                           |
+| Google Repository          | 58                                                                                                                                           |
+| NDK                        | 21.4.7075529 (default)<br>22.1.7171670<br>23.1.7779620                                                                                       |
+| SDK Patch Applier v4       | 1                                                                                                                                            |
+
+#### Environment variables
+| Name                    | Value                                                                                |
+| ----------------------- | ------------------------------------------------------------------------------------ |
+| ANDROID_HOME            | /usr/local/lib/android/sdk                                                           |
+| ANDROID_NDK_HOME        | /usr/local/lib/android/sdk/ndk-bundle -> /usr/local/lib/android/sdk/ndk/21.4.7075529 |
+| ANDROID_NDK_LATEST_HOME | /usr/local/lib/android/sdk/ndk/23.1.7779620                                          |
+| ANDROID_NDK_ROOT        | /usr/local/lib/android/sdk/ndk-bundle -> /usr/local/lib/android/sdk/ndk/21.4.7075529 |
+| ANDROID_SDK_ROOT        | /usr/local/lib/android/sdk                                                           |
+
+### Cached Docker images
+| Repository:Tag          | Digest                                                                   | Created    |
+| ----------------------- | ------------------------------------------------------------------------ | ---------- |
+| alpine:3.12             | sha256:d9459083f962de6bd980ae6a05be2a4cf670df6a1d898157bceb420342bec280  | 2021-11-12 |
+| alpine:3.13             | sha256:026f721af4cf2843e07bba648e158fb35ecc876d822130633cc49f707f0fc88c  | 2021-11-12 |
+| alpine:3.14             | sha256:635f0aa53d99017b38d1a0aa5b2082f7812b03e3cdb299103fe77b5c8a07f1d2  | 2021-11-12 |
+| buildpack-deps:bullseye | sha256:5445b145c8a1a2f7e5a4b233f571c629aed12fce435496f942ad267f21a05ff2  | 2021-12-02 |
+| buildpack-deps:buster   | sha256:c11cd0a4c97acd1aa8d2289aee5c126ac78adc48108744c104f6741cbd9a1f6c  | 2021-12-02 |
+| buildpack-deps:stretch  | sha256:bb93e2c2858cb20f7f16e433773adb2c583fce38dc9c71976c62bf098f956093  | 2021-12-02 |
+| debian:10               | sha256:5b57f8c365c40fde437d53b953c436995525be7c481eb0128b1cbf3b49b0df18  | 2021-12-02 |
+| debian:11               | sha256:45ee40a844048c2f6d0105899c1a17733530b56d481612608aab5e2e4048570b  | 2021-12-02 |
+| debian:9                | sha256:aa78ddaa7f8a14bad8f940ebff5542377f91843f6dcc168e41a8628c6007e815  | 2021-12-02 |
+| moby/buildkit:latest    | sha256:d6c89b7085b106301645ddcc77cf64eb7b705ab507b72d52d130ac33f1300417  | 2021-11-18 |
+| node:12                 | sha256:f881ce751096a214a7e595b0ccf9ee7d6e38d8e0141d7e9d5880b2f242ad392b  | 2021-12-18 |
+| node:12-alpine          | sha256:8fad09b7620b2bc715cbba92e3313c64a797e453f560118576f1740a44584d5d  | 2021-12-18 |
+| node:14                 | sha256:52c884d7cf8509c27def168415a1ff23a0bd95d358dd5787ca77b60474dcb3db  | 2021-12-02 |
+| node:14-alpine          | sha256:7bcf853eeb97a25465cb385b015606c22e926f548cbd117f85b7196df8aa0d29  | 2021-12-02 |
+| node:16                 | sha256:89b59ce49929d8a8e230946bdb1b58c14cdbbb86c9a7397610afcecfce1be035  | 2021-12-02 |
+| node:16-alpine          | sha256:a9b9cb880fa429b0bea899cd3b1bc081ab7277cc97e6d2dcd84bd9753b2027e1  | 2021-12-02 |
+| ubuntu:16.04            | sha256:0f71fa8d4d2d4292c3c617fda2b36f6dabe5c8b6e34c3dc5b0d17d4e704bd39c  | 2021-08-31 |
+| ubuntu:18.04            | sha256:0fedbd5bd9fb72089c7bbca476949e10593cebed9b1fb9edf5b79dbbacddd7d6  | 2021-10-01 |
+| ubuntu:20.04            | sha256:626ffe58f6e7566e00254b638eb7e0f3b11d4da9675088f4781a50ae288f3322  | 2021-10-16 |
+
+### Installed apt packages
+| Name                   | Version                           |
+| ---------------------- | --------------------------------- |
+| acl                    | 2.2.53-6                          |
+| aria2                  | 1.35.0-1build1                    |
+| binutils               | 2.34-6ubuntu1.3                   |
+| bison                  | 2:3.5.1+dfsg-1                    |
+| brotli                 | 1.0.7-6ubuntu0.1                  |
+| build-essential        | 12.8ubuntu1.1                     |
+| bzip2                  | 1.0.8-2                           |
+| coreutils              | 8.30-3ubuntu2                     |
+| curl                   | 7.68.0-1ubuntu2.7                 |
+| dbus                   | 1.12.16-2ubuntu2.1                |
+| dnsutils               | 1:9.16.1-0ubuntu2.9               |
+| dpkg                   | 1.19.7ubuntu3                     |
+| fakeroot               | 1.24-1                            |
+| file                   | 1:5.38-4                          |
+| flex                   | 2.6.4-6.2                         |
+| fonts-noto-color-emoji | 0\~20200916-1\~ubuntu20.04.1      |
+| ftp                    | 0.17-34.1                         |
+| gnupg2                 | 2.2.19-3ubuntu2.1                 |
+| haveged                | 1.9.1-6ubuntu1                    |
+| imagemagick            | 8:6.9.10.23+dfsg-2.1ubuntu11.4    |
+| iproute2               | 5.5.0-1ubuntu1                    |
+| iputils-ping           | 3:20190709-3                      |
+| jq                     | 1.6-1ubuntu0.20.04.1              |
+| lib32z1                | 1:1.2.11.dfsg-2ubuntu1.2          |
+| libc++-dev             | 1:10.0-50\~exp1                   |
+| libc++abi-dev          | 1:10.0-50\~exp1                   |
+| libcurl4               | 7.68.0-1ubuntu2.7                 |
+| libgbm-dev             | 21.0.3-0ubuntu0.3\~20.04.5        |
+| libgconf-2-4           | 3.2.6-6ubuntu1                    |
+| libgsl-dev             | 2.5+dfsg-6build1                  |
+| libgtk-3-0             | 3.24.20-0ubuntu1                  |
+| libmagic-dev           | 1:5.38-4                          |
+| libmagickcore-dev      | 8:6.9.10.23+dfsg-2.1ubuntu11.4    |
+| libmagickwand-dev      | 8:6.9.10.23+dfsg-2.1ubuntu11.4    |
+| libsecret-1-dev        | 0.20.4-0ubuntu1                   |
+| libsqlite3-dev         | 3.31.1-4ubuntu0.2                 |
+| libunwind8             | 1.2.1-9build1                     |
+| libxkbfile-dev         | 1:1.1.0-1                         |
+| libxss1                | 1:1.2.3-1                         |
+| locales                | 2.31-0ubuntu9.2                   |
+| m4                     | 1.4.18-4                          |
+| mediainfo              | 19.09-1build1                     |
+| mercurial              | 5.3.1-1ubuntu1                    |
+| net-tools              | 1.60+git20180626.aebd88e-1ubuntu1 |
+| netcat                 | 1.206-1ubuntu1                    |
+| openssh-client         | 1:8.2p1-4ubuntu0.3                |
+| p7zip-full             | 16.02+dfsg-7build1                |
+| p7zip-rar              | 16.02-3build1                     |
+| parallel               | 20161222-1.1                      |
+| pass                   | 1.7.3-2                           |
+| patchelf               | 0.10-2build1                      |
+| pkg-config             | 0.29.1-0ubuntu4                   |
+| pollinate              | 4.33-3ubuntu1.20.04.1             |
+| python-is-python3      | 3.8.2-4                           |
+| rpm                    | 4.14.2.1+dfsg1-1build2            |
+| rsync                  | 3.1.3-8ubuntu0.1                  |
+| shellcheck             | 0.7.0-2build2                     |
+| sphinxsearch           | 2.2.11-2ubuntu2                   |
+| sqlite3                | 3.31.1-4ubuntu0.2                 |
+| ssh                    | 1:8.2p1-4ubuntu0.3                |
+| sshpass                | 1.06-1                            |
+| subversion             | 1.13.0-3                          |
+| sudo                   | 1.8.31-1ubuntu1.2                 |
+| swig                   | 4.0.1-5build1                     |
+| telnet                 | 0.17-41.2build1                   |
+| texinfo                | 6.7.0.dfsg.2-5                    |
+| time                   | 1.7-25.1build1                    |
+| tk                     | 8.6.9+1                           |
+| tzdata                 | 2021e-0ubuntu0.20.04              |
+| unzip                  | 6.0-25ubuntu1                     |
+| upx                    | 3.95-2build1                      |
+| wget                   | 1.20.3-1ubuntu2                   |
+| xorriso                | 1.5.2-1                           |
+| xvfb                   | 2:1.20.13-1ubuntu1\~20.04.2       |
+| xz-utils               | 5.2.4-1ubuntu1                    |
+| zip                    | 3.0-11build1                      |
+| zsync                  | 0.6.2-3ubuntu1                    |
+
+

images/linux/config/ubuntu1604.conf

@@ -1,2 +0,0 @@
-# Name of the pool supported by this image
-POOL_NAME="Ubuntu 1604"

images/linux/post-generation/environment-variables.sh

@@ -0,0 +1,6 @@
+#!/bin/bash
+
+# Replace $HOME with the default user's home directory for environmental variables related to the default user home directory
+
+homeDir=$(cut -d: -f6 /etc/passwd | tail -1)
+sed -i "s|\$HOME|$homeDir|g" /etc/environment

images/linux/post-generation/homebrew-permissions.sh

@@ -1,18 +0,0 @@
-#!/bin/bash
-
-# Fix permissions for Homebrew
-# https://github.com/actions/virtual-environments/issues/1568
-
-# Reset brew repository directory to make the brew clean after chmoding /home
-cd $(brew --repo)
-git reset --hard
-
-brew_folder="/home/linuxbrew/"
-homebrew_user=$(cut -d: -f1 /etc/passwd | tail -1)
-
-if [ -d "$brew_folder" ]; then
-    brew_folder_owner=$(ls -ld $brew_folder | awk '{print $3}')
-    if [ "$homebrew_user" != "$brew_folder_owner" ]; then
-        chown "$homebrew_user":docker -R $brew_folder
-    fi
-fi

images/linux/post-generation/rust-permissions.sh

@@ -1,14 +0,0 @@
-#!/bin/bash
-
-# Fix permissions for the Rust folder
-# https://github.com/actions/virtual-environments/issues/572
-
-rust_folder="/usr/share/rust"
-rust_user=$(cut -d: -f1 /etc/passwd | tail -1)
-
-if [ -d "$rust_folder" ]; then
-    rust_folder_owner=$(ls -ld $rust_folder | awk '{print $3}')
-    if [ "$rust_user" != "$rust_folder_owner" ]; then
-        chown "$rust_user":docker -R $rust_folder
-    fi
-fi

images/linux/scripts/SoftwareReport/SoftwareReport.Android.psm1

@@ -11,21 +11,13 @@ function Get-AndroidSDKRoot {
 
 function Get-AndroidSDKManagerPath {
     $androidSDKDir = Get-AndroidSDKRoot
-    return Join-Path $androidSDKDir "tools" "bin" "sdkmanager"
+    return Join-Path $androidSDKDir "cmdline-tools" "latest" "bin" "sdkmanager"
 }
 
 function Get-AndroidInstalledPackages {
     $androidSDKManagerPath = Get-AndroidSDKManagerPath
-    $androidSDKManagerList = Invoke-Expression "$androidSDKManagerPath --list --include_obsolete"
-    $androidInstalledPackages = @()
-    foreach($packageInfo in $androidSDKManagerList) {
-        if($packageInfo -Match "Available Packages:") {
-            break
-        }
-
-        $androidInstalledPackages += $packageInfo
-    }
-    return $androidInstalledPackages
+    $androidSDKManagerList = Invoke-Expression "$androidSDKManagerPath --list_installed --include_obsolete"
+    return $androidSDKManagerList
 }
 
 
@@ -33,37 +25,41 @@ function Build-AndroidTable {
     $packageInfo = Get-AndroidInstalledPackages
     return @(
         @{
-            "Package" = "Android SDK Platform-Tools"
-            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android SDK Platform-Tools"
+            "Package" = "Android Command Line Tools"
+            "Version" = Get-AndroidCommandLineToolsVersion
         },
         @{
-            "Package" = "Android SDK Tools"
-            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android SDK Tools"
-        },
-        @{
-            "Package" = "Android SDK Platforms"
-            "Version" = Get-AndroidPlatformVersions -PackageInfo $packageInfo
+            "Package" = "Android Emulator"
+            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android Emulator"
         },
         @{
             "Package" = "Android SDK Build-tools"
             "Version" = Get-AndroidBuildToolVersions -PackageInfo $packageInfo
         },
         @{
-            "Package" = "Android emulator"
-            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android Emulator"
+            "Package" = "Android SDK Platform-Tools"
+            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android SDK Platform-Tools"
         },
         @{
-            "Package" = "Google APIs"
-            "Version" = Get-AndroidGoogleAPIsVersions -PackageInfo $packageInfo
+            "Package" = "Android SDK Platforms"
+            "Version" = Get-AndroidPlatformVersions -PackageInfo $packageInfo
         },
         @{
-            "Package" = "NDK"
-            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "ndk-bundle"
+            "Package" = "Android SDK Tools"
+            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android SDK Tools"
         },
         @{
             "Package" = "Android Support Repository"
             "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Android Support Repository"
         },
+        @{
+            "Package" = "CMake"
+            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "cmake"
+        },
+        @{
+            "Package" = "Google APIs"
+            "Version" = Get-AndroidGoogleAPIsVersions -PackageInfo $packageInfo
+        },
         @{
             "Package" = "Google Play services"
             "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Google Play services"
@@ -73,12 +69,12 @@ function Build-AndroidTable {
             "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "Google Repository"
         },
         @{
-            "Package" = "SDK Patch Applier v4"
-            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "SDK Patch Applier v4"
+            "Package" = "NDK"
+            "Version" = Get-AndroidNDKVersions
         },
         @{
-            "Package" = "CMake"
-            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "cmake"
+            "Package" = "SDK Patch Applier v4"
+            "Version" = Get-AndroidPackageVersions -PackageInfo $packageInfo -MatchedString "SDK Patch Applier v4"
         }
     ) | Where-Object { $_.Version } | ForEach-Object {
         [PSCustomObject] @{
@@ -119,6 +115,13 @@ function Get-AndroidPlatformVersions {
     return ($versions -Join "<br>")
 }
 
+function Get-AndroidCommandLineToolsVersion {
+    $commandLineTools = Get-AndroidSDKManagerPath
+    (& $commandLineTools --version | Out-String).Trim() -match "(?<version>^(\d+\.){1,}\d+$)" | Out-Null
+    $commandLineToolsVersion = $Matches.Version
+    return $commandLineToolsVersion
+}
+
 function Get-AndroidBuildToolVersions {
     param (
         [Parameter(Mandatory)]
@@ -150,3 +153,26 @@ function Get-AndroidGoogleAPIsVersions {
     return ($versions -Join "<br>")
 }
 
+function Get-AndroidNDKVersions {
+    $ndkFolderPath = Join-Path (Get-AndroidSDKRoot) "ndk"
+    $versions = Get-ChildItem -Path $ndkFolderPath -Name
+    $ndkDefaultVersion = Get-ToolsetValue "android.ndk.default"
+    $ndkDefaultFullVersion = Get-ChildItem "$env:ANDROID_HOME/ndk/$ndkDefaultVersion.*" -Name | Select-Object -Last 1
+
+    return ($versions | ForEach-Object {
+        $defaultPostfix = ( $_ -eq $ndkDefaultFullVersion ) ? " (default)" : ""
+        $_ + $defaultPostfix
+    } | Join-String -Separator "<br>")
+}
+
+function Build-AndroidEnvironmentTable {
+    $androidVersions = Get-Item env:ANDROID_*	
+
+    $shouldResolveLink = 'ANDROID_NDK_PATH', 'ANDROID_NDK_HOME', 'ANDROID_NDK_ROOT', 'ANDROID_NDK_LATEST_HOME'
+    return $androidVersions | Sort-Object -Property Name | ForEach-Object {
+        [PSCustomObject] @{
+            "Name" = $_.Name
+            "Value" = if ($shouldResolveLink.Contains($_.Name )) { Get-PathWithLink($_.Value) } else {$_.Value}
+        }
+    }
+}

images/linux/scripts/SoftwareReport/SoftwareReport.Browsers.psm1

@@ -16,4 +16,37 @@ function Get-FirefoxVersion {
 function Get-GeckodriverVersion {
     $geckodriverVersion = geckodriver --version | Select-Object -First 1 | Take-OutputPart -Part 1
     return "Geckodriver $geckodriverVersion"
-}
+}
+
+function Get-ChromiumVersion {
+    $chromiumVersion = chromium-browser --version | Take-OutputPart -Part 0,1
+    return $chromiumVersion
+}
+
+function Get-SeleniumVersion {
+    $seleniumBinaryName = Get-ToolsetValue "selenium.binary_name"
+    $fullSeleniumVersion = (Get-ChildItem "/usr/share/java/${seleniumBinaryName}-*").Name -replace "${seleniumBinaryName}-"
+    return "Selenium server $fullSeleniumVersion"
+}
+
+function Build-BrowserWebdriversEnvironmentTable {
+    return @(
+        @{
+            "Name" = "CHROMEWEBDRIVER"
+            "Value" = $env:CHROMEWEBDRIVER
+        },
+        @{
+            "Name" = "GECKOWEBDRIVER"
+            "Value" = $env:GECKOWEBDRIVER
+        },
+        @{
+            "Name" = "SELENIUM_JAR_PATH"
+            "Value" = $env:SELENIUM_JAR_PATH
+        }
+    ) | ForEach-Object {
+        [PSCustomObject] @{
+            "Name" = $_.Name
+            "Value" = $_.Value
+        }
+    }
+}

images/linux/scripts/SoftwareReport/SoftwareReport.CachedTools.psm1

@@ -13,7 +13,7 @@ function Get-ToolcachePyPyVersions {
     Get-ChildItem -Path $toolcachePath -Name | Sort-Object { [Version] $_ } | ForEach-Object {
         $pypyRootPath = Join-Path $toolcachePath $_ "x64"
         [string]$pypyVersionOutput = & "$pypyRootPath/bin/python" -c "import sys;print(sys.version)"
-        $pypyVersionOutput -match "^([\d\.]+) \(.+\) \[PyPy ([\d\.]+) .+]$" | Out-Null
+        $pypyVersionOutput -match "^([\d\.]+) \(.+\) \[PyPy ([\d\.]+\S*) .+]$" | Out-Null
         return "{0} [PyPy {1}]" -f $Matches[1], $Matches[2]
     }
 }
@@ -28,37 +28,36 @@ function Get-ToolcacheGoVersions {
     return Get-ChildItem $toolcachePath -Name | Sort-Object { [Version]$_ }
 }
 
-function Get-ToolcacheBoostVersions {
-    $toolcachePath = Join-Path $env:AGENT_TOOLSDIRECTORY "boost"
-    if (-not (Test-Path $toolcachePath)) {
-        return @()
+function Build-GoEnvironmentTable {
+    return Get-CachedToolInstances -Name "go" -VersionCommand "version" | ForEach-Object {
+        $Version = [System.Version]($_.Version -Split(" "))[0]
+        $Name = "GOROOT_$($Version.major)_$($Version.minor)_X64"
+        $Value = (Get-Item env:\$Name).Value
+        [PSCustomObject] @{
+            "Name" = $Name
+            "Value" = (Get-Item env:\$Name).Value
+            "Architecture" = $_. Architecture
+        }
     }
-    return Get-ChildItem $toolcachePath -Name | Sort-Object { [Version]$_ }
 }
 
 function Build-CachedToolsSection {
     $output = ""
 
-    $output += New-MDHeader "Ruby" -Level 4
-    $output += New-MDList -Lines (Get-ToolcacheRubyVersions) -Style Unordered
-
-    $output += New-MDHeader "Python" -Level 4
-    $output += New-MDList -Lines (Get-ToolcachePythonVersions) -Style Unordered
-
-    $output += New-MDHeader "PyPy" -Level 4
-    $output += New-MDList -Lines (Get-ToolcachePyPyVersions) -Style Unordered
+    $output += New-MDHeader "Go" -Level 4
+    $output += New-MDList -Lines (Get-ToolcacheGoVersions) -Style Unordered
 
     $output += New-MDHeader "Node.js" -Level 4
     $output += New-MDList -Lines (Get-ToolcacheNodeVersions) -Style Unordered
 
-    $output += New-MDHeader "Go" -Level 4
-    $output += New-MDList -Lines (Get-ToolcacheGoVersions) -Style Unordered
+    $output += New-MDHeader "PyPy" -Level 4
+    $output += New-MDList -Lines (Get-ToolcachePyPyVersions) -Style Unordered
 
-    $boostVersions = Get-ToolcacheBoostVersions
-    if ($boostVersions.Count -gt 0) {
-        $output += New-MDHeader "Boost" -Level 4
-        $output += New-MDList -Lines $boostVersions -Style Unordered
-    }
+    $output += New-MDHeader "Python" -Level 4
+    $output += New-MDList -Lines (Get-ToolcachePythonVersions) -Style Unordered
+
+    $output += New-MDHeader "Ruby" -Level 4
+    $output += New-MDList -Lines (Get-ToolcacheRubyVersions) -Style Unordered
 
     return $output
-}
+}

images/linux/scripts/SoftwareReport/SoftwareReport.Common.psm1

@@ -1,7 +1,6 @@
-Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Helpers.psm1") -DisableNameChecking
-
-function Get-OSName {
-    lsb_release -ds
+function Get-BashVersion {
+    $version = bash -c 'echo ${BASH_VERSION}'
+    return "Bash $version"
 }
 
 function Get-CPPVersions {
@@ -21,27 +20,61 @@ function Get-FortranVersions {
     return "GNU Fortran " + ($fortranVersions -Join ", ")
 }
 
-function Get-ClangVersions {
-    $clangVersions = @()
+function Get-ClangToolVersions {
+    param (
+        [Parameter(Mandatory = $true)]
+        [string] $ToolName,
+        [string] $VersionPattern = "\d+\.\d+\.\d+)-"
+    )
+
     $result = Get-CommandResult "apt list --installed" -Multiline
-    $clangVersions = $result.Output | Where-Object { $_ -match "^clang-\d+"} | ForEach-Object {
+    $toolVersions = $result.Output | Where-Object { $_ -match "^${ToolName}-\d+"} | ForEach-Object {
         $clangCommand = ($_ -Split "/")[0]
-        Invoke-Expression "$clangCommand --version" | Where-Object { $_ -match "clang version" } | ForEach-Object {
-            $_ -match "clang version (?<version>\d+\.\d+\.\d+)-" | Out-Null
+        Invoke-Expression "$clangCommand --version" | Where-Object { $_ -match "${ToolName} version" } | ForEach-Object {
+            $_ -match "${ToolName} version (?<version>${VersionPattern}" | Out-Null
             $Matches.version
-        }
-    } | Sort-Object {[Version]$_}
-    return "Clang " + ($clangVersions -Join ", ")
+            }
+        } | Sort-Object {[Version]$_}
+
+    return $toolVersions -Join ", "
 }
 
+function Get-ClangVersions {
+    $clangVersions = Get-ClangToolVersions -ToolName "clang"
+    return "Clang " + $clangVersions
+}
+
+function Get-ClangFormatVersions {
+    $clangFormatVersions = Get-ClangToolVersions -ToolName "clang-format"
+    return "Clang-format " + $clangFormatVersions
+}
+
+
 function Get-ErlangVersion {
-    $version = (erl -eval 'erlang:display(erlang:system_info(version)), halt().' -noshell).Trim('"')
-    return "Erlang $version"
+    $erlangVersion = (erl -eval '{ok, Version} = file:read_file(filename:join([code:root_dir(), "releases", erlang:system_info(otp_release), ''OTP_VERSION''])), io:fwrite(Version), halt().' -noshell)
+    $shellVersion = (erl -eval 'erlang:display(erlang:system_info(version)), halt().' -noshell).Trim('"')
+    return "Erlang $erlangVersion (Eshell $shellVersion)"
+}
+
+function Get-ErlangRebar3Version {
+    $result = Get-CommandResult "rebar3 --version"
+    $result.Output -match "rebar (?<version>(\d+.){2}\d+)" | Out-Null
+    $rebarVersion = $Matches.version
+    return "Erlang rebar3 $rebarVersion"
 }
 
 function Get-MonoVersion {
     $monoVersion = mono --version | Out-String | Take-OutputPart -Part 4
-    return "Mono $monoVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "mono"
+    return "Mono $monoVersion (apt source repository: $aptSourceRepo)"
+}
+
+function Get-MsbuildVersion {
+    $msbuildVersion = msbuild -version | Select-Object -Last 1
+    $result = Select-String -Path (Get-Command msbuild).Source -Pattern "msbuild"
+    $result -match "(?<path>\/\S*\.dll)" | Out-Null
+    $msbuildPath = $Matches.path
+    return "MSBuild $msbuildVersion (from $msbuildPath)"
 }
 
 function Get-NodeVersion {
@@ -49,6 +82,10 @@ function Get-NodeVersion {
     return "Node $nodeVersion"
 }
 
+function Get-OpensslVersion {
+    return $(openssl version)
+}
+
 function Get-PerlVersion {
     $version = $(perl -e 'print substr($^V,1)')
     return "Perl $version"
@@ -80,11 +117,21 @@ function Get-SwiftVersion {
     return "Swift $swiftVersion"
 }
 
+function Get-KotlinVersion {
+    $kotlinVersion = kotlin -version | Out-String | Take-OutputPart -Part 2
+    return "Kotlin $kotlinVersion"
+}
+
 function Get-JuliaVersion {
     $juliaVersion = julia --version | Take-OutputPart -Part 2
     return "Julia $juliaVersion"
 }
 
+function Get-LernaVersion {
+    $version = lerna -v
+    return "Lerna $version"
+}
+
 function Get-HomebrewVersion {
     $result = Get-CommandResult "brew -v"
     $result.Output -match "Homebrew (?<version>\d+\.\d+\.\d+)" | Out-Null
@@ -92,11 +139,18 @@ function Get-HomebrewVersion {
     return "Homebrew $version"
 }
 
+function Get-CpanVersion {
+    $result = Get-CommandResult "cpan --version" -ExpectExitCode @(25, 255)
+    $result.Output -match "version (?<version>\d+\.\d+) " | Out-Null
+    $cpanVersion = $Matches.version
+    return "cpan $cpanVersion"
+}
+
 function Get-GemVersion {
     $result = Get-CommandResult "gem --version"
     $result.Output -match "(?<version>\d+\.\d+\.\d+)" | Out-Null
     $gemVersion = $Matches.version
-    return "Gem $gemVersion"
+    return "RubyGems $gemVersion"
 }
 
 function Get-MinicondaVersion {
@@ -120,6 +174,11 @@ function Get-YarnVersion {
     return "Yarn $yarnVersion"
 }
 
+function Get-ParcelVersion {
+    $parcelVersion = parcel --version
+    return "Parcel $parcelVersion"
+}
+
 function Get-PipVersion {
     $result = Get-CommandResult "pip --version"
     $result.Output -match "pip (?<version>\d+\.\d+\.\d+)" | Out-Null
@@ -139,7 +198,7 @@ function Get-VcpkgVersion {
     $result.Output -match "version (?<version>\d+\.\d+\.\d+)" | Out-Null
     $vcpkgVersion = $Matches.version
     $commitId = git -C "/usr/local/share/vcpkg" rev-parse --short HEAD
-    return "Vcpkg $vcpkgVersion (build from master <$commitId>)"
+    return "Vcpkg $vcpkgVersion (build from master \<$commitId>)"
 }
 
 function Get-AntVersion {
@@ -207,12 +266,29 @@ function Build-PHPTable {
     }
 }
 
+function Build-PHPSection {
+    $output = ""
+    $output += New-MDHeader "PHP" -Level 3
+    $output += Build-PHPTable | New-MDTable
+    $output += New-MDCode -Lines @(
+        "Both Xdebug and PCOV extensions are installed, but only Xdebug is enabled."
+    )
+
+    return $output
+}
+
 function Get-GHCVersion {
     $(ghc --version) -match "version (?<version>\d+\.\d+\.\d+)" | Out-Null
     $ghcVersion = $Matches.version
     return "GHC $ghcVersion"
 }
 
+function Get-GHCupVersion {
+    $(ghcup --version) -match "version v(?<version>\d+(\.\d+){2,})" | Out-Null
+    $ghcVersion = $Matches.version
+    return "GHCup $ghcVersion"
+}
+
 function Get-CabalVersion {
     $(cabal --version | Out-String) -match "cabal-install version (?<version>\d+\.\d+\.\d+\.\d+)" | Out-Null
     $cabalVersion = $Matches.version
@@ -262,21 +338,34 @@ function Get-CachedDockerImages {
 }
 
 function Get-CachedDockerImagesTableData {
-    return (sudo docker images --digests --format "*{{.Repository}}:{{.Tag}}|{{.Digest}} |{{.CreatedAt}}").Split("*")     | Where-Object { $_ } |  ForEach-Object {
-      $parts=$_.Split("|")
-      [PSCustomObject] @{
-             "Repository:Tag" = $parts[0]
-              "Digest" = $parts[1]
-              "Created" = $parts[2].split(' ')[0]
-         }
-    }
+    $allImages = sudo docker images --digests --format "*{{.Repository}}:{{.Tag}}|{{.Digest}} |{{.CreatedAt}}"
+    $allImages.Split("*") | Where-Object { $_ } | ForEach-Object {
+        $parts = $_.Split("|")
+        [PSCustomObject] @{
+            "Repository:Tag" = $parts[0]
+            "Digest" = $parts[1]
+            "Created" = $parts[2].split(' ')[0]
+        }
+    } | Sort-Object -Property "Repository:Tag"
 }
 
 function Get-AptPackages {
-    $toolsetJson = Get-ToolsetContent
-    $apt = $toolsetJson.apt
-    $pkgs = ($apt.common_packages + $apt.cmd_packages | Sort-Object) -join ", "
-    return $pkgs
+    $apt = (Get-ToolsetContent).Apt
+    $output = @()
+    ForEach ($pkg in ($apt.common_packages + $apt.cmd_packages)) {
+        $version = $(dpkg-query -W -f '${Version}' $pkg)
+        if ($Null -eq $version) {
+            $version = $(dpkg-query -W -f '${Version}' "$pkg*")
+        }
+        
+        $version = $version -replace '~','\~'
+
+        $output += [PSCustomObject] @{
+            Name    = $pkg
+            Version = $version
+        }
+    }
+    return ($output | Sort-Object Name)
 }
 
 function Get-PipxVersion {
@@ -285,3 +374,36 @@ function Get-PipxVersion {
     $pipxVersion = $Matches.Version
     return "Pipx $pipxVersion"
 }
+
+function Get-GraalVMVersion {
+    $version = & "$env:GRAALVM_11_ROOT\bin\java" --version | Select-String -Pattern "GraalVM" | Take-OutputPart -Part 5,6
+    return $version
+}
+
+function Build-GraalVMTable {
+    $version = Get-GraalVMVersion
+    $envVariables = "GRAALVM_11_ROOT"
+
+    return [PSCustomObject] @{
+        "Version" = $version
+        "Environment variables" = $envVariables
+    }
+}
+
+function Build-PackageManagementEnvironmentTable {
+    return @(
+        @{
+            "Name" = "CONDA"
+            "Value" = $env:CONDA
+        },
+        @{
+            "Name" = "VCPKG_INSTALLATION_ROOT"
+            "Value" = $env:VCPKG_INSTALLATION_ROOT
+        }
+    ) | ForEach-Object {
+        [PSCustomObject] @{
+            "Name" = $_.Name
+            "Value" = $_.Value
+        }
+    }
+}

images/linux/scripts/SoftwareReport/SoftwareReport.Databases.psm1

@@ -1,11 +1,13 @@
 function Get-PostgreSqlVersion {
     $postgreSQLVersion = psql --version | Take-OutputPart -Part 2
-    return "Postgre SQL $postgreSQLVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "postgresql"
+    return "PostgreSQL $postgreSQLVersion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-MongoDbVersion {
     $mongoDBVersion = mongod --version | Select-Object -First 1 | Take-OutputPart -Part 2 -Delimiter "v"
-    return "MongoDB $mongoDBVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "mongodb"
+    return "MongoDB $mongoDBVersion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-SqliteVersion {
@@ -14,7 +16,10 @@ function Get-SqliteVersion {
 }
 
 function Get-MySQLVersion {
-    $mySQLVersion = mysqld --version | Take-OutputPart -Part 2 | Take-OutputPart -Part 0 -Delimiter "-"
+    $mySQLVersion = mysqld --version | Take-OutputPart -Part 2
+    if (-not (Test-IsUbuntu20)) {
+        $mySQLVersion = $mySQLVersion | Take-OutputPart -Part 0 -Delimiter "-"
+    }
     return "MySQL $mySQLVersion"
 }
 
@@ -23,6 +28,11 @@ function Get-SQLCmdVersion {
     return "sqlcmd $sqlcmdVersion"
 }
 
+function Get-SqlPackageVersion {
+    $sqlPackageVersion = sqlpackage /version
+    return "SqlPackage $sqlPackageVersion"
+}
+
 function Build-MySQLSection {
     $output = ""
 
@@ -43,8 +53,9 @@ function Build-MSSQLToolsSection {
 
     $output += New-MDHeader "MS SQL Server Client Tools" -Level 4
     $output += New-MDList -Style Unordered -Lines @(
-        (Get-SQLCmdVersion)
+        (Get-SQLCmdVersion),
+        (Get-SqlPackageVersion)
     )
 
     return $output
-}
+}

images/linux/scripts/SoftwareReport/SoftwareReport.Generator.ps1

@@ -3,7 +3,9 @@ param (
     $OutputDirectory
 )
 
-$ErrorActionPreference = "Stop"
+$global:ErrorActionPreference = "Stop"
+$global:ErrorView = "NormalView"
+Set-StrictMode -Version Latest
 
 Import-Module MarkdownPS
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Android.psm1") -DisableNameChecking
@@ -11,10 +13,12 @@ Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Browsers.psm1") -DisableN
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.CachedTools.psm1") -DisableNameChecking
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Common.psm1") -DisableNameChecking
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Databases.psm1") -DisableNameChecking
-Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Helpers.psm1") -DisableNameChecking
+Import-Module "$PSScriptRoot/../helpers/SoftwareReport.Helpers.psm1" -DisableNameChecking
+Import-Module "$PSScriptRoot/../helpers/Common.Helpers.psm1" -DisableNameChecking
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Java.psm1") -DisableNameChecking
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Rust.psm1") -DisableNameChecking
 Import-Module (Join-Path $PSScriptRoot "SoftwareReport.Tools.psm1") -DisableNameChecking
+Import-Module (Join-Path $PSScriptRoot "SoftwareReport.WebServers.psm1") -DisableNameChecking
 
 # Restore file owner in user profile
 Restore-UserOwner
@@ -24,72 +28,88 @@ $markdown = ""
 $OSName = Get-OSName
 $markdown += New-MDHeader "$OSName" -Level 1
 
+$kernelVersion = Get-KernelVersion
 $markdown += New-MDList -Style Unordered -Lines @(
+    "$kernelVersion"
     "Image Version: $env:IMAGE_VERSION"
 )
 
 $markdown += New-MDHeader "Installed Software" -Level 2
 $markdown += New-MDHeader "Language and Runtime" -Level 3
 
-$markdown += New-MDList -Style Unordered -Lines @(
-        (Get-CPPVersions),
-        (Get-FortranVersions),
-        (Get-ClangVersions),
-        (Get-ErlangVersion),
-        (Get-MonoVersion),
-        (Get-NodeVersion),
-        (Get-PerlVersion),
-        (Get-PythonVersion),
-        (Get-Python3Version),
-        (Get-RubyVersion),
-        (Get-SwiftVersion),
-        (Get-JuliaVersion)
+$runtimesList = @(
+    (Get-BashVersion),
+    (Get-CPPVersions),
+    (Get-FortranVersions),
+    (Get-ErlangVersion),
+    (Get-ErlangRebar3Version),
+    (Get-MonoVersion),
+    (Get-MsbuildVersion),
+    (Get-NodeVersion),
+    (Get-PerlVersion),
+    (Get-PythonVersion),
+    (Get-Python3Version),
+    (Get-RubyVersion),
+    (Get-SwiftVersion),
+    (Get-JuliaVersion),
+    (Get-KotlinVersion),
+    (Get-ClangVersions),
+    (Get-ClangFormatVersions)
 )
 
+$markdown += New-MDList -Style Unordered -Lines ($runtimesList | Sort-Object)
+
 $markdown += New-MDHeader "Package Management" -Level 3
 
 $packageManagementList = @(
-        (Get-HomebrewVersion),
-        (Get-GemVersion),
-        (Get-MinicondaVersion),
-        (Get-HelmVersion),
-        (Get-NpmVersion),
-        (Get-YarnVersion),
-        (Get-PipVersion),
-        (Get-Pip3Version),
-        (Get-VcpkgVersion)
+    (Get-HomebrewVersion),
+    (Get-CpanVersion),
+    (Get-GemVersion),
+    (Get-MinicondaVersion),
+    (Get-HelmVersion),
+    (Get-NpmVersion),
+    (Get-YarnVersion),
+    (Get-PipxVersion),
+    (Get-PipVersion),
+    (Get-Pip3Version),
+    (Get-VcpkgVersion)
 )
 
-if (-not (Test-IsUbuntu16)) {
-    $packageManagementList += @(
-        (Get-PipxVersion)
-    )
-}
-
 $markdown += New-MDList -Style Unordered -Lines ($packageManagementList | Sort-Object)
+$markdown += New-MDHeader "Environment variables" -Level 4
+$markdown += Build-PackageManagementEnvironmentTable | New-MDTable
+$markdown += New-MDNewLine
 
 $markdown += New-MDHeader "Project Management" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
-        (Get-AntVersion),
-        (Get-GradleVersion),
-        (Get-MavenVersion),
-        (Get-SbtVersion)
+$projectManagementList = @(
+    (Get-AntVersion),
+    (Get-GradleVersion),
+    (Get-MavenVersion),
+    (Get-SbtVersion)
 )
 
+if (Test-IsUbuntu20) {
+    $projectManagementList += @(
+        (Get-LernaVersion)
+    )
+}
+$markdown += New-MDList -Style Unordered -Lines ($projectManagementList | Sort-Object)
+
 $markdown += New-MDHeader "Tools" -Level 3
 $toolsList = @(
-    (Get-7zipVersion),
     (Get-AnsibleVersion),
     (Get-AptFastVersion),
-    (Get-AzCopy7Version),
-    (Get-AzCopy10Version),
+    (Get-AzCopyVersion),
     (Get-BazelVersion),
     (Get-BazeliskVersion),
+    (Get-BicepVersion),
+    (Get-BuildahVersion),
     (Get-CodeQLBundleVersion),
     (Get-CMakeVersion),
-    (Get-CurlVersion),
-    (Get-DockerMobyVersion),
-    (Get-DockerComposeVersion),
+    (Get-DockerMobyClientVersion),
+    (Get-DockerMobyServerVersion),
+    (Get-DockerComposeV1Version),
+    (Get-DockerComposeV2Version),
     (Get-DockerBuildxVersion),
     (Get-GitVersion),
     (Get-GitLFSVersion),
@@ -99,42 +119,39 @@ $toolsList = @(
     (Get-HHVMVersion),
     (Get-SVNVersion),
     (Get-JqVersion),
+    (Get-YqVersion),
     (Get-KindVersion),
     (Get-KubectlVersion),
     (Get-KustomizeVersion),
     (Get-LeiningenVersion),
     (Get-MediainfoVersion),
-    (Get-M4Version),
     (Get-HGVersion),
     (Get-MinikubeVersion),
     (Get-NewmanVersion),
+    (Get-NVersion),
     (Get-NvmVersion),
+    (Get-OpensslVersion),
     (Get-PackerVersion),
+    (Get-ParcelVersion),
     (Get-PhantomJSVersion),
+    (Get-PodManVersion),
     (Get-PulumiVersion),
     (Get-RVersion),
+    (Get-SkopeoVersion),
     (Get-SphinxVersion),
-    (Get-SwigVersion),
     (Get-TerraformVersion),
-    (Get-UnZipVersion),
-    (Get-WgetVersion),
     (Get-YamllintVersion),
-    (Get-ZipVersion),
     (Get-ZstdVersion)
 )
 
-if (-not (Test-IsUbuntu16)) {
-    $toolsList += @(
-        (Get-PodManVersion),
-        (Get-BuildahVersion),
-        (Get-SkopeoVersion)
-    )
+if (Test-IsUbuntu20) {
+    $toolsList += (Get-FastlaneVersion)
 }
 
 $markdown += New-MDList -Style Unordered -Lines ($toolsList | Sort-Object)
 
 $markdown += New-MDHeader "CLI Tools" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
+$markdown += New-MDList -Style Unordered -Lines (@(
     (Get-AlibabaCloudCliVersion),
     (Get-AWSCliVersion),
     (Get-AWSCliSessionManagerPluginVersion),
@@ -148,64 +165,77 @@ $markdown += New-MDList -Style Unordered -Lines @(
     (Get-OCCliVersion),
     (Get-ORASCliVersion),
     (Get-VerselCliversion)
+    ) | Sort-Object
 )
 
 $markdown += New-MDHeader "Java" -Level 3
 $markdown += Get-JavaVersions | New-MDTable
 $markdown += New-MDNewLine
 
-$markdown += New-MDHeader "PHP" -Level 3
-$markdown += Build-PHPTable | New-MDTable
-$markdown += New-MDNewLine
+if (Test-IsUbuntu20) {
+    $markdown += New-MDHeader "GraalVM" -Level 3
+    $markdown += Build-GraalVMTable | New-MDTable
+    $markdown += New-MDNewLine
+}
+
+$markdown += Build-PHPSection
 
 $markdown += New-MDHeader "Haskell" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
+$markdown += New-MDList -Style Unordered -Lines (@(
     (Get-GHCVersion),
+    (Get-GHCupVersion),
     (Get-CabalVersion),
     (Get-StackVersion)
+    ) | Sort-Object
 )
 
 $markdown += New-MDHeader "Rust Tools" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
+$markdown += New-MDList -Style Unordered -Lines (@(
     (Get-RustVersion),
     (Get-RustupVersion),
     (Get-RustdocVersion),
     (Get-CargoVersion)
+    ) | Sort-Object
 )
 
 $markdown += New-MDHeader "Packages" -Level 4
-$markdown += New-MDList -Style Unordered -Lines @(
+$markdown += New-MDList -Style Unordered -Lines (@(
     (Get-BindgenVersion),
     (Get-CargoAuditVersion),
     (Get-CargoOutdatedVersion),
     (Get-CargoClippyVersion),
     (Get-CbindgenVersion),
     (Get-RustfmtVersion)
+    ) | Sort-Object
 )
 
 $markdown += New-MDHeader "Browsers and Drivers" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
+
+$browsersAndDriversList = @(
     (Get-ChromeVersion),
     (Get-ChromeDriverVersion),
     (Get-FirefoxVersion),
-    (Get-GeckodriverVersion)
+    (Get-GeckodriverVersion),
+    (Get-ChromiumVersion),
+    (Get-SeleniumVersion)
 )
 
+$markdown += New-MDList -Style Unordered -Lines $browsersAndDriversList
+$markdown += New-MDHeader "Environment variables" -Level 4
+$markdown += Build-BrowserWebdriversEnvironmentTable | New-MDTable
+$markdown += New-MDNewLine
+
 $markdown += New-MDHeader ".NET Core SDK" -Level 3
 $markdown += New-MDList -Style Unordered -Lines @(
     (Get-DotNetCoreSdkVersions)
 )
 
-$markdown += New-MDHeader "Az Module" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
-    (Get-AzModuleVersions)
-)
-
 $markdown += New-MDHeader "Databases" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(
+$markdown += New-MDList -Style Unordered -Lines (@(
     (Get-PostgreSqlVersion),
     (Get-MongoDbVersion),
     (Get-SqliteVersion)
+    ) | Sort-Object
 )
 
 $markdown += Build-MySQLSection
@@ -214,22 +244,36 @@ $markdown += Build-MSSQLToolsSection
 $markdown += New-MDHeader "Cached Tools" -Level 3
 $markdown += Build-CachedToolsSection
 
+$markdown += New-MDHeader "Environment variables" -Level 4
+$markdown += Build-GoEnvironmentTable | New-MDTable
+$markdown += New-MDNewLine
+
 $markdown += New-MDHeader "PowerShell Tools" -Level 3
 $markdown += New-MDList -Lines (Get-PowershellVersion) -Style Unordered
 
 $markdown += New-MDHeader "PowerShell Modules" -Level 4
 $markdown += Get-PowerShellModules | New-MDTable
 $markdown += New-MDNewLine
+$markdown += New-MDHeader "Az PowerShell Modules" -Level 4
+$markdown += New-MDList -Style Unordered -Lines @(
+    (Get-AzModuleVersions)
+)
+
+$markdown += Build-WebServersSection
 
 $markdown += New-MDHeader "Android" -Level 3
 $markdown += Build-AndroidTable | New-MDTable
 $markdown += New-MDNewLine
+$markdown += New-MDHeader "Environment variables" -Level 4
+$markdown += Build-AndroidEnvironmentTable | New-MDTable
+$markdown += New-MDNewLine
 
 $markdown += New-MDHeader "Cached Docker images" -Level 3
 $markdown += Get-CachedDockerImagesTableData | New-MDTable
 $markdown += New-MDNewLine
 
 $markdown += New-MDHeader "Installed apt packages" -Level 3
-$markdown += New-MDList -Style Unordered -Lines @(Get-AptPackages)
+$markdown += Get-AptPackages | New-MDTable
 
+Test-BlankElement
 $markdown | Out-File -FilePath "${OutputDirectory}/Ubuntu-Readme.md"

images/linux/scripts/SoftwareReport/SoftwareReport.Helpers.psm1

@@ -1,55 +0,0 @@
-function Get-CommandResult {
-    param (
-        [Parameter(Mandatory=$true)]
-        [string] $Command,
-        [switch] $Multiline
-    )
-    # Bash trick to suppress and show error output because some commands write to stderr (for example, "python --version")
-    $stdout = & bash -c "$Command 2>&1"
-    $exitCode = $LASTEXITCODE
-    return @{
-        Output = If ($Multiline -eq $true) { $stdout } else { [string]$stdout }
-        ExitCode = $exitCode
-    }
-}
-
-function Take-OutputPart {
-    param (
-        [Parameter(ValueFromPipeline)]
-        [string] $toolOutput,
-        [string] $Delimiter = " ",
-        [int[]] $Part
-    )
-    $parts = $toolOutput.Split($Delimiter, [System.StringSplitOptions]::RemoveEmptyEntries)
-    $selectedParts = $parts[$Part]
-    return [string]::Join($Delimiter, $selectedParts)
-}
-
-function Test-IsUbuntu16 {
-    return (lsb_release -rs) -eq "16.04"
-}
-
-function Test-IsUbuntu18 {
-    return (lsb_release -rs) -eq "18.04"
-}
-
-function Test-IsUbuntu20 {
-    return (lsb_release -rs) -eq "20.04"
-}
-
-function Get-ToolsetContent {
-    $toolset = Join-Path $env:INSTALLER_SCRIPT_FOLDER "toolset.json"
-    Get-Content $toolset -Raw | ConvertFrom-Json
-}
-
-function New-MDNewLine {
-    param (
-        [int] $Count = 1
-    )
-    $newLineSymbol = [System.Environment]::NewLine
-    return $newLineSymbol * $Count
-}
-
-function Restore-UserOwner {
-    sudo chown -R ${env:USER}: $env:HOME
-}

images/linux/scripts/SoftwareReport/SoftwareReport.Java.psm1

@@ -1,30 +1,19 @@
-function Get-JavaFullVersion {
-    param($JavaRootPath)
-
-    $javaBinPath = Join-Path $javaRootPath "/bin/java"
-    $javaVersionOutput = (Get-CommandResult "$javaBinPath -version").Output
-    $matchResult = $javaVersionOutput | Select-String '^openjdk version \"([\d\._]+)\"'
-    return $matchResult.Matches.Groups[1].Value
-}
-
 function Get-JavaVersions {
-    $defaultJavaPath = $env:JAVA_HOME
-    $javaVersions = Get-Item env:JAVA_HOME_*_X64
-    $sortRules = @{
-        Expression = { [Int32]$_.Name.Split("_")[2] }  
-        Descending = $false
-    }
+    $toolcachePath = Join-Path $env:AGENT_TOOLSDIRECTORY "Java_Adopt_jdk"
+    $javaToolcacheVersions = Get-ChildItem $toolcachePath -Name | Sort-Object { [int]$_.Split(".")[0] }
 
-    return $javaVersions | Sort-Object $sortRules | ForEach-Object {
-        $javaPath = $_.Value
-        $version = Get-JavaFullVersion $javaPath
-        $vendor = $version.StartsWith("1.7") ? "Zulu" : "AdoptOpenJDK"
-        $defaultPostfix = ($javaPath -eq $defaultJavaPath) ? " (default)" : ""
+    return $javaToolcacheVersions | ForEach-Object {
+        $majorVersion = $_.split(".")[0]
+        $fullVersion = $_.Replace("-", "+")
+        $defaultJavaPath = $env:JAVA_HOME
+        $javaPath = Get-Item env:JAVA_HOME_${majorVersion}_X64
+
+        $defaultPostfix = ($javaPath.Value -eq $defaultJavaPath) ? " (default)" : ""
 
         [PSCustomObject] @{
-            "Version" = $version + $defaultPostfix
-            "Vendor" = $vendor
-            "Environment Variable" = $_.Name
+            "Version" = $fullVersion + $defaultPostfix
+            "Vendor" = "Adopt OpenJDK"
+            "Environment Variable" = $javaPath.Name
         }
     }
 }

images/linux/scripts/SoftwareReport/SoftwareReport.Rust.psm1

@@ -1,55 +1,56 @@
-function Initialize-RustEnvironment {
-    ln -sf "/usr/share/rust/.rustup" $HOME/.rustup
-    ln -sf "/usr/share/rust/.cargo" $HOME/.cargo
-}
-
-function Get-RustVersion {
-    Initialize-RustEnvironment
-    $rustVersion = $(rustc --version) | Take-OutputPart -Part 1
-    return "Rust $rustVersion"
-}
-
-function Get-BindgenVersion {
-    $bindgenVersion = $(bindgen --version) | Take-OutputPart -Part 1
-    return "Bindgen $bindgenVersion"
-}
-
-function Get-CargoVersion {
-    $cargoVersion = $(cargo --version) | Take-OutputPart -Part 1
-    return "Cargo $cargoVersion"
-}
-
-function Get-CargoAuditVersion {
-    $cargoAuditVersion = $(cargo audit --version) | Take-OutputPart -Part 1
-    return "Cargo audit $cargoAuditVersion"
-}
-
-function Get-CargoOutdatedVersion {
-    $cargoOutdatedVersion = $(cargo outdated --version) | Take-OutputPart -Part 1 -Delimiter "v"
-    return "Cargo outdated $cargoOutdatedVersion"
-}
-
-function Get-CargoClippyVersion {
-    $cargoClippyVersion = $(cargo-clippy --version) | Take-OutputPart -Part 1
-    return "Cargo clippy $cargoClippyVersion"
-}
-
-function Get-CbindgenVersion {
-    $cbindgenVersion = $(cbindgen --version) | Take-OutputPart -Part 1
-    return "Cbindgen $cbindgenVersion"
-}
-
-function Get-RustupVersion {
-    $rustupVersion = $(rustup --version) | Take-OutputPart -Part 1
-    return "Rustup $rustupVersion"
-}
-
-function Get-RustdocVersion {
-    $rustdocVersion = $(rustdoc --version) | Take-OutputPart -Part 1
-    return "Rustdoc $rustdocVersion"
-}
-
-function Get-RustfmtVersion {
-    $rustfmtVersion = $(rustfmt --version) | Take-OutputPart -Part 1 | Take-OutputPart -Part 0 -Delimiter "-"
-    return "Rustfmt $rustfmtVersion"
-}
+function Initialize-RustEnvironment {
+    $env:PATH = "/etc/skel/.cargo/bin:/etc/skel/.rustup/bin:$($env:PATH)"
+    $env:RUSTUP_HOME = "/etc/skel/.rustup"
+    $env:CARGO_HOME = "/etc/skel/.cargo"
+}
+
+function Get-RustVersion {
+    Initialize-RustEnvironment
+    $rustVersion = $(rustc --version) | Take-OutputPart -Part 1
+    return "Rust $rustVersion"
+}
+
+function Get-BindgenVersion {
+    $bindgenVersion = $(bindgen --version) | Take-OutputPart -Part 1
+    return "Bindgen $bindgenVersion"
+}
+
+function Get-CargoVersion {
+    $cargoVersion = $(cargo --version) | Take-OutputPart -Part 1
+    return "Cargo $cargoVersion"
+}
+
+function Get-CargoAuditVersion {
+    $cargoAuditVersion = $(cargo audit --version) | Take-OutputPart -Part 1
+    return "Cargo audit $cargoAuditVersion"
+}
+
+function Get-CargoOutdatedVersion {
+    $cargoOutdatedVersion = $(cargo outdated --version) | Take-OutputPart -Part 1 -Delimiter "v"
+    return "Cargo outdated $cargoOutdatedVersion"
+}
+
+function Get-CargoClippyVersion {
+    $cargoClippyVersion = $(cargo-clippy --version) | Take-OutputPart -Part 1
+    return "Cargo clippy $cargoClippyVersion"
+}
+
+function Get-CbindgenVersion {
+    $cbindgenVersion = $(cbindgen --version) | Take-OutputPart -Part 1
+    return "Cbindgen $cbindgenVersion"
+}
+
+function Get-RustupVersion {
+    $rustupVersion = $(rustup --version) | Take-OutputPart -Part 1
+    return "Rustup $rustupVersion"
+}
+
+function Get-RustdocVersion {
+    $rustdocVersion = $(rustdoc --version) | Take-OutputPart -Part 1
+    return "Rustdoc $rustdocVersion"
+}
+
+function Get-RustfmtVersion {
+    $rustfmtVersion = $(rustfmt --version) | Take-OutputPart -Part 1 | Take-OutputPart -Part 0 -Delimiter "-"
+    return "Rustfmt $rustfmtVersion"
+}

images/linux/scripts/SoftwareReport/SoftwareReport.Tools.psm1

@@ -1,26 +1,18 @@
-function Get-7zipVersion {
-    $7zVersion = 7z i | Select-String "7-Zip" | Take-OutputPart -Part 2
-    return "7-Zip $7zVersion"
-}
-
 function Get-AnsibleVersion {
-    $ansibleVersion = ansible --version | Select-Object -First 1 | Take-OutputPart -Part 1
+    $ansibleVersion = (ansible --version)[0] -replace "[^\d.]"
     return "Ansible $ansibleVersion"
 }
 
 function Get-AptFastVersion {
-    $aptFastVersion = (dpkg-query --showformat='${Version}' --show apt-fast).Split('-')[0]
+    $versionFileContent = Get-Content (which apt-fast) -Raw
+    $match = [Regex]::Match($versionFileContent, '# apt-fast v(.+)\n')
+    $aptFastVersion = $match.Groups[1].Value
     return "apt-fast $aptFastVersion"
 }
 
-function Get-AzCopy7Version {
-    $azcopy7Version = azcopy --version | Take-OutputPart -Part 1 | Take-OutputPart -Part 0 -Delimiter "-"
-    return "AzCopy7 $azcopy7Version (available by ``azcopy`` alias)"
-}
-
-function Get-AzCopy10Version {
-    $azcopy10Version = azcopy10 --version | Take-OutputPart -Part 2
-    return "AzCopy10 $azcopy10Version (available by ``azcopy10`` alias)"
+function Get-AzCopyVersion {
+    $azcopyVersion = azcopy --version | Take-OutputPart -Part 2
+    return "AzCopy $azcopyVersion (available by ``azcopy`` and ``azcopy10`` aliases)"
 }
 
 function Get-BazelVersion {
@@ -34,6 +26,12 @@ function Get-BazeliskVersion {
     return "Bazelisk $bazeliskVersion"
 }
 
+function Get-BicepVersion {
+    (bicep --version | Out-String) -match  "bicep cli version (?<version>\d+\.\d+\.\d+)" | Out-Null
+    $bicepVersion = $Matches.Version
+    return "Bicep $bicepVersion"
+}
+
 function Get-CodeQLBundleVersion {
     $CodeQLVersionsWildcard = Join-Path $Env:AGENT_TOOLSDIRECTORY -ChildPath "CodeQL" | Join-Path -ChildPath "*"
     $CodeQLVersionPath = Get-ChildItem $CodeQLVersionsWildcard | Select-Object -First 1 -Expand FullName
@@ -44,17 +42,20 @@ function Get-CodeQLBundleVersion {
 
 function Get-PodManVersion {
     $podmanVersion = podman --version | Take-OutputPart -Part 2
-    return "Podman $podmanVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "containers"
+    return "Podman $podmanVersion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-BuildahVersion {
     $buildahVersion = buildah --version | Take-OutputPart -Part 2
-    return "Buildah $buildahVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "containers"
+    return "Buildah $buildahVersion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-SkopeoVersion {
     $skopeoVersion = skopeo --version | Take-OutputPart -Part 2
-    return "Skopeo $skopeoVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "containers"
+    return "Skopeo $skopeoVersion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-CMakeVersion {
@@ -62,19 +63,24 @@ function Get-CMakeVersion {
     return "CMake $cmakeVersion"
 }
 
-function Get-CurlVersion {
-    $curlVersion = curl --version | Select-Object -First 1 | Take-OutputPart -Part 0,1
-    return $curlVersion
-}
-
-function Get-DockerComposeVersion {
+function Get-DockerComposeV1Version {
     $composeVersion = docker-compose -v | Take-OutputPart -Part 2 | Take-OutputPart -Part 0 -Delimiter ","
-    return "Docker Compose $composeVersion"
+    return "Docker Compose v1 $composeVersion"
 }
 
-function Get-DockerMobyVersion {
-    $dockerVersion = docker -v | Take-OutputPart -Part 2 | Take-OutputPart -Part 0 -Delimiter "+"
-    return "Docker-Moby $dockerVersion"
+function Get-DockerComposeV2Version {
+    $composeVersion = docker compose version | Take-OutputPart -Part 3
+    return "Docker Compose v2 $composeVersion"
+}
+
+function Get-DockerMobyClientVersion {
+    $dockerClientVersion = sudo docker version --format '{{.Client.Version}}'
+    return "Docker-Moby Client $dockerClientVersion"
+}
+
+function Get-DockerMobyServerVersion {
+    $dockerServerVersion = sudo docker version --format '{{.Server.Version}}'
+    return "Docker-Moby Server $dockerServerVersion"
 }
 
 function Get-DockerBuildxVersion {
@@ -85,13 +91,15 @@ function Get-DockerBuildxVersion {
 function Get-GitVersion {
     $result = Get-CommandResult "git --version"
     $gitVersion = $result.Output | Take-OutputPart -Part 2
-    return "Git $gitVersion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "git-core"
+    return "Git $gitVersion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-GitLFSVersion {
     $result = Get-CommandResult "git-lfs --version"
     $gitlfsversion = $result.Output | Take-OutputPart -Part 0 | Take-OutputPart -Part 1 -Delimiter "/"
-    return "Git LFS $gitlfsversion"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "git-lfs"
+    return "Git LFS $gitlfsversion (apt source repository: $aptSourceRepo)"
 }
 
 function Get-GitFTPVersion {
@@ -100,7 +108,8 @@ function Get-GitFTPVersion {
 }
 
 function Get-GoogleCloudSDKVersion {
-    return "$(gcloud --version | Select-Object -First 1)"
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "google-cloud-sdk"
+    return "$(gcloud --version | Select-Object -First 1) (apt source repository: $aptSourceRepo)"
 }
 
 function Get-HavegedVersion {
@@ -139,7 +148,7 @@ function Get-KubectlVersion {
 }
 
 function Get-MinikubeVersion {
-    $minikubeVersion = minikube version --short | Take-OutputPart -Part 2 | Take-OutputPart -Part 0 -Delimiter "v"
+    $minikubeVersion = minikube version --short | Take-OutputPart -Part 0 -Delimiter "v"
     return "Minikube $minikubeVersion"
 }
 
@@ -148,11 +157,6 @@ function Get-HGVersion {
     return "Mercurial $hgVersion"
 }
 
-function Get-M4Version {
-    $m4Version = m4 --version | Select-Object -First 1 | Take-OutputPart -Part -1
-    return "m4 $m4Version"
-}
-
 function Get-LeiningenVersion {
     return "$(lein -v | Take-OutputPart -Part 0,1)"
 }
@@ -166,60 +170,44 @@ function Get-NewmanVersion {
     return "Newman $(newman --version)"
 }
 
+function Get-NVersion {
+    $nVersion = (n --version).Replace('v', '')
+    return "n $nVersion"
+}
+
 function Get-NvmVersion {
     $nvmVersion = bash -c "source /etc/skel/.nvm/nvm.sh && nvm --version"
     return "nvm $nvmVersion"
 }
 
 function Get-PackerVersion {
-    return "Packer $(packer --version)"
+    # Packer 1.7.1 has a bug and outputs version to stderr instead of stdout https://github.com/hashicorp/packer/issues/10855
+    $result = (Get-CommandResult "packer --version").Output
+    $packerVersion = [regex]::matches($result, "(\d+.){2}\d+").Value
+    return "Packer $packerVersion"
 }
 
 function Get-PhantomJSVersion {
     return "PhantomJS $(phantomjs --version)"
 }
 
-function Get-SwigVersion {
-    $swigVersion = swig -version | Select-String "SWIG Version" | Take-OutputPart -Part 2
-    return "Swig $swigVersion"
-}
-
 function Get-TerraformVersion {
     return (terraform version | Select-String "^Terraform").Line.Replace('v','')
 }
 
-function Get-UnZipVersion {
-    $unzipVersion = unzip -v | Select-Object -First 1 | Take-OutputPart -Part 1
-    return "unzip $unzipVersion"
-}
-
-function Get-WgetVersion {
-    $wgetVersion = wget --version | Select-Object -First 1 | Take-OutputPart -Part 2
-    return "wget $wgetVersion"
-}
-
-function Get-ZipVersion {
-    $zipVersion = zip -v | Select-String "This is Zip" | Take-OutputPart -Part 3
-    return "zip $zipVersion"
-}
-
-function Get-ZstdVersion {
-    $zstdVersion = (zstd --version).Split() -match "v\d+" | ForEach-Object {$_.Replace("v","").Replace(",","")}
-    return "zstd $zstdVersion"
-}
-
 function Get-JqVersion {
     $jqVersion = jq --version | Take-OutputPart -Part 1 -Delimiter "-"
     return "jq $jqVersion"
 }
 
 function Get-AzureCliVersion {
-    $azcliVersion = az -v | Select-String "azure-cli" | Take-OutputPart -Part -1
-    return "Azure CLI (azure-cli) $azcliVersion"
+    $azcliVersion = (az version | ConvertFrom-Json).'azure-cli'
+    $aptSourceRepo = Get-AptSourceRepository -PackageName "azure-cli"
+    return "Azure CLI (azure-cli) $azcliVersion (installation method: $aptSourceRepo)"
 }
 
 function Get-AzureDevopsVersion {
-    $azdevopsVersion = az -v | Select-String "azure-devops" | Take-OutputPart -Part -1
+    $azdevopsVersion = (az version | ConvertFrom-Json).extensions.'azure-devops'
     return "Azure CLI (azure-devops) $azdevopsVersion"
 }
 
@@ -242,6 +230,11 @@ function Get-AWSSAMVersion {
     return "AWS SAM CLI $(sam --version | Take-OutputPart -Part -1)"
 }
 
+function Get-FastlaneVersion {
+    $fastlaneVersion = fastlane --version | Select-String "^fastlane [0-9]" | Take-OutputPart -Part 1
+    return "Fastlane $fastlaneVersion"
+}
+
 function Get-HubCliVersion {
     $hubVersion = hub --version | Select-String "hub version" | Take-OutputPart -Part 2
     return "Hub CLI $hubVersion"
@@ -259,7 +252,7 @@ function Get-NetlifyCliVersion {
 
 function Get-OCCliVersion {
     $ocVersion = oc version | Take-OutputPart -Part 2 | Take-OutputPart -Part 0 -Delimiter "-"
-    return "oc CLI $ocVersion"
+    return "OpenShift CLI $ocVersion"
 }
 
 function Get-ORASCliVersion {
@@ -289,4 +282,14 @@ function Get-SphinxVersion {
 
 function Get-YamllintVersion {
     return "$(yamllint --version)"
+}
+
+function Get-ZstdVersion {
+    $zstdVersion = zstd --version | Take-OutputPart -Part 1 -Delimiter "v" | Take-OutputPart -Part 0 -Delimiter ","
+    return "zstd $zstdVersion (homebrew)"
+}
+
+function Get-YqVersion {
+    $yqVersion = ($(yq -V) -Split " ")[-1]
+    return "yq $yqVersion"
 }

images/linux/scripts/SoftwareReport/SoftwareReport.WebServers.psm1

@@ -0,0 +1,61 @@
+function Get-ApacheVersion {
+    $name = "apache2"
+    $port = 80
+    $version = bash -c "apache2 -v | grep -Po 'Apache/(\d+.){2}\d+'" | Take-OutputPart -Part 1 -Delimiter "/"
+    $serviceStatus = systemctl status apache2 | grep "Active:" | Take-OutputPart -Part 1
+    $configFile = "/etc/apache2/apache2.conf"
+    return [PsCustomObject]@{
+        "Name" = $name
+        "Version" = $version
+        "ConfigFile" = $configFile
+        "ServiceStatus" = $serviceStatus
+        "ListenPort" = $port
+    }
+}
+
+function Get-NginxVersion {
+    $name = "nginx"
+    $port = 80
+    $version = (dpkg-query --showformat='${Version}' --show nginx).Split('-')[0]
+    $serviceStatus = systemctl status nginx | grep "Active:" | Take-OutputPart -Part 1
+    $configFile = "/etc/nginx/nginx.conf"
+    return [PsCustomObject]@{
+        "Name" = $name
+        "Version" = $version
+        "ConfigFile" = $configFile
+        "ServiceStatus" = $serviceStatus
+        "ListenPort" = $port
+    }
+}
+
+function Get-Xsp4Version {
+    $name = "mono-xsp4"
+    $port = (grep '^port=' /etc/default/mono-xsp4).Split('=')[1]
+    $version = (dpkg-query --showformat='${Version}' --show mono-xsp4).Split('-')[0]
+    $serviceStatus = systemctl show -p ActiveState --value mono-xsp4
+    $configFile = "/etc/default/mono-xsp4"
+    return [PsCustomObject]@{
+        "Name" = $name
+        "Version" = $version
+        "ConfigFile" = $configFile
+        "ServiceStatus" = $serviceStatus
+        "ListenPort" = $port
+    }
+}
+
+function Build-WebServersSection {
+    $servers = @(
+        (Get-ApacheVersion),
+        (Get-NginxVersion)
+    )
+    if (Test-IsUbuntu20) {
+        $servers += (Get-Xsp4Version)
+    }
+
+    $output = ""
+    $output += New-MDHeader "Web Servers" -Level 3
+    $output += $servers | Sort-Object Name | New-MDTable
+    $output += New-MDNewLine
+
+    return $output
+}

images/linux/scripts/base/apt-mock.sh

@@ -32,6 +32,9 @@ while [ \$i -le 30 ];do
   elif grep -q 'Temporary failure in name resolution' \$err;then
     # It looks like DNS is not updated with random generated hostname yet
     retry=true
+  elif grep -q 'dpkg frontend is locked by another process' \$err;then
+    # dpkg process is busy by another process
+    retry=true
   fi
 
   rm \$err

images/linux/scripts/base/apt.sh

@@ -8,20 +8,21 @@ systemctl stop apt-daily-upgrade.timer
 systemctl disable apt-daily-upgrade.timer
 systemctl disable apt-daily-upgrade.service
 
-# This step should completely disable any automatic updates except manual
-sudo sed -i 's/APT::Periodic::Update-Package-Lists "1"/APT::Periodic::Update-Package-Lists "0"/' /etc/apt/apt.conf.d/20auto-upgrades
-
 # Enable retry logic for apt up to 10 times
 echo "APT::Acquire::Retries \"10\";" > /etc/apt/apt.conf.d/80-retries
 
 # Configure apt to always assume Y
 echo "APT::Get::Assume-Yes \"true\";" > /etc/apt/apt.conf.d/90assumeyes
 
-# Uninstall unattended-upgrades
-apt-get remove unattended-upgrades
+# Fix bad proxy and http headers settings
+cat <<EOF >> /etc/apt/apt.conf.d/99bad_proxy
+Acquire::http::Pipeline-Depth 0;
+Acquire::http::No-Cache true;
+Acquire::BrokenProxy    true;
+EOF
 
-# Use apt-fast for parallel downloads
-add-apt-repository -y ppa:apt-fast/stable
+# Uninstall unattended-upgrades
+apt-get purge unattended-upgrades
 
 # Need to limit arch for default apt repos due to 
 # https://github.com/actions/virtual-environments/issues/1961
@@ -31,5 +32,9 @@ echo 'APT sources limited to the actual architectures'
 cat /etc/apt/sources.list
 
 apt-get update
-# Install aria2 , jq and apt-fast
-apt-get install aria2 jq apt-fast
+# Install jq
+apt-get install jq
+
+# Install apt-fast using quick-install.sh
+# https://github.com/ilikenwf/apt-fast
+bash -c "$(curl -sL https://raw.githubusercontent.com/ilikenwf/apt-fast/master/quick-install.sh)"

images/linux/scripts/base/limits.sh

@@ -1,7 +1,14 @@
 #!/bin/bash -e
 
-echo '* soft nofile 65536' >> /etc/security/limits.conf
-echo '* hard nofile 65536' >> /etc/security/limits.conf
 echo 'session required pam_limits.so' >> /etc/pam.d/common-session
 echo 'session required pam_limits.so' >> /etc/pam.d/common-session-noninteractive
 echo 'DefaultLimitNOFILE=65536' >> /etc/systemd/system.conf
+echo 'DefaultLimitSTACK=16M:infinity' >> /etc/systemd/system.conf
+
+# Raise Number of File Descriptors
+echo '* soft nofile 65536' >> /etc/security/limits.conf
+echo '* hard nofile 65536' >> /etc/security/limits.conf
+
+# Double stack size from default 8192KB
+echo '* soft stack 16384' >> /etc/security/limits.conf
+echo '* hard stack 16384' >> /etc/security/limits.conf

images/linux/scripts/base/snap.sh

@@ -0,0 +1,14 @@
+#!/bin/bash -e
+
+# Put snapd auto refresh on hold
+# as it may generate too much traffic on Canonical's snap server
+# when they are rolling a new major update out.
+# Hold is calculated as today's date + 60 days
+
+# snapd is started automatically, but during image generation
+# a unix socket may die, restart snapd.service (and therefore snapd.socket)
+# to make sure the socket is alive.
+
+systemctl restart snapd.socket
+systemctl restart snapd
+snap set system refresh.hold="$(date --date='today+60 days' +%Y-%m-%dT%H:%M:%S%:z)"

images/linux/scripts/helpers/Common.Helpers.psm1

@@ -0,0 +1,78 @@
+function Get-CommandResult {
+    param (
+        [Parameter(Mandatory=$true)]
+        [string] $Command,
+        [int[]] $ExpectExitCode = 0,
+        [switch] $Multiline,
+        [bool] $ValidateExitCode = $true
+    )
+
+    # Bash trick to suppress and show error output because some commands write to stderr (for example, "python --version")
+    $stdout = & bash -c "$Command 2>&1"
+    $exitCode = $LASTEXITCODE
+
+    if ($ValidateExitCode) {
+        if ($ExpectExitCode -notcontains $exitCode) {
+            try {
+                throw "StdOut: '$stdout' ExitCode: '$exitCode'"
+            } catch {
+                Write-Host $_.Exception.Message
+                Write-Host $_.ScriptStackTrace
+                exit $LASTEXITCODE
+            }
+        }
+    }
+
+    return @{
+        Output = If ($Multiline -eq $true) { $stdout } else { [string]$stdout }
+        ExitCode = $exitCode
+    }
+}
+
+function Get-OSName {
+    lsb_release -ds
+}
+
+function Get-KernelVersion {
+    $kernelVersion = uname -r
+    return "Linux kernel version: $kernelVersion"
+}
+
+function Test-IsUbuntu18 {
+    return (lsb_release -rs) -eq "18.04"
+}
+
+function Test-IsUbuntu20 {
+    return (lsb_release -rs) -eq "20.04"
+}
+
+function Get-ToolsetContent {
+    $toolset = Join-Path $env:INSTALLER_SCRIPT_FOLDER "toolset.json"
+    Get-Content $toolset -Raw | ConvertFrom-Json
+}
+
+function Get-ToolsetValue {
+    param (
+        [Parameter(Mandatory = $true)]
+        [string] $KeyPath
+    )
+
+    $jsonNode = Get-ToolsetContent
+
+    $pathParts = $KeyPath.Split(".")
+    # try to walk through all arguments consequentially to resolve specific json node
+    $pathParts | ForEach-Object {
+        $jsonNode = $jsonNode.$_
+    }
+    return $jsonNode
+}
+
+function Get-AndroidPackages {
+    $androidSDKManagerPath = "/usr/local/lib/android/sdk/cmdline-tools/latest/bin/sdkmanager"
+    $androidPackages = & $androidSDKManagerPath --list --verbose
+    return $androidPackages
+}
+
+function Get-EnvironmentVariable($variable) {
+    return [System.Environment]::GetEnvironmentVariable($variable)
+}

images/linux/scripts/helpers/SoftwareReport.Helpers.psm1

@@ -0,0 +1,158 @@
+function Take-OutputPart {
+    param (
+        [Parameter(ValueFromPipeline)]
+        [string] $toolOutput,
+        [string] $Delimiter = " ",
+        [int[]] $Part
+    )
+    $parts = $toolOutput.Split($Delimiter, [System.StringSplitOptions]::RemoveEmptyEntries)
+    $selectedParts = $parts[$Part]
+    return [string]::Join($Delimiter, $selectedParts)
+}
+
+function New-MDNewLine {
+    param (
+        [int] $Count = 1
+    )
+    $newLineSymbol = [System.Environment]::NewLine
+    return $newLineSymbol * $Count
+}
+
+function Restore-UserOwner {
+    sudo chown -R ${env:USER}: $env:HOME
+}
+
+function Get-LinkTarget {
+    param (
+        [string] $inputPath
+    )
+    $link = Get-Item $inputPath | Select-Object -ExpandProperty Target
+    if ($link) {
+      return " -> $link"
+    }
+    return ""
+}
+
+function Get-PathWithLink {
+    param (
+        [string] $inputPath
+    )
+    $link = Get-LinkTarget($inputPath)
+    return "${inputPath}${link}"
+}
+
+function Get-CachedToolInstances
+{
+    <#
+    .SYNOPSIS
+    Returns hastable of installed cached tools.
+
+    .DESCRIPTION
+    Return hastable that contains versions and architectures for selected cached tool.
+
+    .PARAMETER Name
+    Name of cached tool.
+
+    .PARAMETER VersionCommand
+    Optional parameter. Command to return version of system default tool.
+
+    .EXAMPLE
+    Get-CachedToolInstances -Name "Python" -VersionCommand "--version"
+
+    #>
+
+    param
+    (
+        [String] $Name,
+        [String] $VersionCommand
+    )
+
+    $toolInstances = @()
+    $toolPath = Join-Path -Path $env:AGENT_TOOLSDIRECTORY -ChildPath $Name
+
+    # Get all installed versions from TOOLSDIRECTORY folder
+    $versions = Get-ChildItem $toolPath | Sort-Object { [System.Version]$_.Name }
+    foreach ($version in $versions)
+    {
+        $instanceInfo = @{}
+
+        # Create instance hashtable
+        [string]$instanceInfo.Path = Join-Path -Path $toolPath -ChildPath $version.Name
+        [string]$instanceInfo.Version = $version.Name
+
+        # Get all architectures for current version
+        [array]$instanceInfo.Architecture_Array = Get-ChildItem $version.FullName -Name -Directory | Where-Object { $_ -match "^x[0-9]{2}$" }
+        [string]$instanceInfo.Architecture = $instanceInfo.Architecture_Array -Join ", "
+
+        # Add (default) postfix to version name, in case if current version is in environment path
+        if (-not ([string]::IsNullOrEmpty($VersionCommand)))
+        {
+            $defaultVersion = $(& ($Name.ToLower()) $VersionCommand 2>&1)
+            $defaultToolVersion = $defaultVersion   | Select-String -Pattern "\d+\.\d+\.\d+" -AllMatches `
+                                                    | ForEach-Object { $_.Matches.Value }
+
+            if ([version]$version.Name -eq [version]$defaultToolVersion)
+            {
+                $instanceInfo.Version += " (Default)"
+            }
+        }
+
+        $toolInstances += $instanceInfo
+    }
+
+    return $toolInstances
+}
+
+function Get-AptSourceRepository {
+    param([String] $PackageName)
+
+    $sourceUrl = Get-Content "$PSScriptRoot/../helpers/apt-sources.txt" | Select-String -Pattern $PackageName | Take-OutputPart -Part (1..3)
+    return $sourceUrl
+}
+
+function Test-BlankElement {
+    param(
+        [string] $Markdown
+    )
+
+    $splitByLines = $Markdown.Split("`n")
+    # Validate entry without version
+    $blankVersions = $splitByLines -match "^-" -notmatch "Image Version|MySQL Server|Vcpkg|\d\." | Out-String
+
+    # Validate tables with blank rows
+    $blankRows = ""
+    for($i = 0; $i -lt $splitByLines.Length; $i++) {
+        $addRows= $false
+        $table = @()
+        if ($splitByLines[$i].StartsWith("#") -and $splitByLines[$i+1].StartsWith("|")) {
+            $table += $splitByLines[$i,($i+1),($i+2)]
+            $i += 3
+            $current = $splitByLines[$i]
+            while ($current.StartsWith("|")) {
+                $isBlankRow = $current.Substring(1, $current.LastIndexOf("|") - 2).Split("|").Trim() -contains ""
+                if ($isBlankRow) {
+                    $table += $current
+                    $addRows = $true
+                }
+                $current = $splitByLines[++$i]
+            }
+            if ($addRows) {
+                $blankRows += $table | Out-String
+            }
+        }
+    }
+
+    # Display report
+    $isReport = $false
+    if ($blankVersions) {
+        Write-Host "Software list with blank version:`n${blankVersions}"
+        $isReport = $true
+    }
+    if ($blankRows) {
+        Write-Host "Tables with blank rows:`n${blankRows}"
+        $isReport = $true
+    }
+    if ($isReport) {
+        exit 1
+    }
+}

images/linux/scripts/helpers/Tests.Helpers.psm1

@@ -0,0 +1,104 @@
+Import-Module "$PSScriptRoot/../helpers/Common.Helpers.psm1" -DisableNameChecking
+
+# Validates that tool is installed and in PATH
+function Validate-ToolExist($tool) {
+    Get-Command $tool -ErrorAction SilentlyContinue | Should -BeTrue
+}
+
+function Invoke-PesterTests {
+    Param(
+        [Parameter(Mandatory)][string] $TestFile,
+        [string] $TestName
+    )
+
+    $testPath = "/imagegeneration/tests/${TestFile}.Tests.ps1"
+    if (-not (Test-Path $testPath)) {
+        throw "Unable to find test file '$TestFile' on '$testPath'."
+    }
+
+    # Check that Pester module is imported
+    if (!(Get-Module "Pester")) {
+        Import-Module Pester
+    }
+    
+    $configuration = [PesterConfiguration] @{
+        Run = @{ Path = $testPath; PassThru = $true }
+        Output = @{ Verbosity = "Detailed" }
+    }
+    if ($TestName) {
+        $configuration.Filter.FullName = $TestName
+    }
+
+    # Switch ErrorActionPreference to Stop temporary to make sure that tests will fail on silent errors too
+    $backupErrorActionPreference = $ErrorActionPreference
+    $ErrorActionPreference = "Stop"
+    $results = Invoke-Pester -Configuration $configuration
+    $ErrorActionPreference = $backupErrorActionPreference
+
+    # Fail in case if no tests are run
+    if (-not ($results -and ($results.FailedCount -eq 0) -and (($results.PassedCount + $results.SkippedCount) -gt 0))) {
+        $results
+        throw "Test run has failed"
+    }
+}
+
+function ShouldReturnZeroExitCode {
+    Param(
+        [string] $ActualValue,
+        [switch] $Negate,
+        [string] $Because # This parameter is unused but we need it to match Pester asserts signature
+    )
+
+    $result = Get-CommandResult $ActualValue -ValidateExitCode $false
+
+    [bool]$succeeded = $result.ExitCode -eq 0
+    if ($Negate) { $succeeded = -not $succeeded }
+
+    if (-not $succeeded)
+    {
+        $commandOutputIndent = " " * 4
+        $commandOutput = ($result.Output | ForEach-Object { "${commandOutputIndent}${_}" }) -join "`n"
+        $failureMessage = "Command '${ActualValue}' has finished with exit code`n${commandOutput}"
+    }
+
+    return [PSCustomObject] @{
+        Succeeded      = $succeeded
+        FailureMessage = $failureMessage
+    }
+}
+
+function ShouldMatchCommandOutput {
+    Param(
+        [string] $ActualValue,
+        [string] $RegularExpression,
+        [switch] $Negate
+    )
+
+    $output = (Get-CommandResult $ActualValue -ValidateExitCode $false).Output | Out-String
+    [bool] $succeeded = $output -cmatch $RegularExpression
+
+    if ($Negate) {
+        $succeeded = -not $succeeded
+    }
+
+    $failureMessage = ''
+
+    if (-not $succeeded) {
+        if ($Negate) {
+            $failureMessage = "Expected regular expression '$RegularExpression' for '$ActualValue' command to not match '$output', but it did match."
+        }
+        else {
+            $failureMessage = "Expected regular expression '$RegularExpression' for '$ActualValue' command to match '$output', but it did not match."
+        }
+    }
+
+    return [PSCustomObject] @{
+        Succeeded      = $succeeded
+        FailureMessage = $failureMessage
+    }
+}
+
+If (Get-Command -Name Add-ShouldOperator -ErrorAction SilentlyContinue) {
+    Add-ShouldOperator -Name ReturnZeroExitCode -InternalName ShouldReturnZeroExitCode -Test ${function:ShouldReturnZeroExitCode}
+    Add-ShouldOperator -Name MatchCommandOutput -InternalName ShouldMatchCommandOutput -Test ${function:ShouldMatchCommandOutput}
+}

images/linux/scripts/helpers/etc-environment.sh

@@ -18,7 +18,7 @@ function addEtcEnvironmentVariable {
     variable_name="$1"
     variable_value="$2"
 
-    echo "$variable_name=\"$variable_value\"" | sudo tee -a /etc/environment
+    echo "$variable_name=$variable_value" | sudo tee -a /etc/environment
 }
 
 function replaceEtcEnvironmentVariable {

images/linux/scripts/helpers/install.sh

@@ -14,21 +14,29 @@ download_with_retries() {
     local COMPRESSED="$4"
 
     if [[ $COMPRESSED == "compressed" ]]; then
-        COMMAND="curl $URL -4 -sL --compressed -o '$DEST/$NAME'"
+        local COMMAND="curl $URL -4 -sL --compressed -o '$DEST/$NAME' -w '%{http_code}'"
     else
-        COMMAND="curl $URL -4 -sL -o '$DEST/$NAME'"
+        local COMMAND="curl $URL -4 -sL -o '$DEST/$NAME' -w '%{http_code}'"
     fi
 
-    echo "Downloading $URL..."
-    i=20
-    while [ $i -gt 0 ]; do
-        ((i--))
-        eval $COMMAND
-        if [ $? != 0 ]; then
-            sleep 30
-        else
+    echo "Downloading '$URL' to '${DEST}/${NAME}'..."
+    retries=20
+    interval=30
+    while [ $retries -gt 0 ]; do
+        ((retries--))
+        # Temporary disable exit on error to retry on non-zero exit code
+        set +e
+        http_code=$(eval $COMMAND)
+        exit_code=$?
+        if [ $http_code -eq 200 ] && [ $exit_code -eq 0 ]; then
+            echo "Download completed"
             return 0
+        else
+            echo "Error — Either HTTP response code for '$URL' is wrong - '$http_code' or exit code is not 0 - '$exit_code'. Waiting $interval seconds before the next attempt, $retries attempts left"
+            sleep 30
         fi
+        # Enable exit on error back
+        set -e
     done
 
     echo "Could not download $URL"
@@ -40,11 +48,21 @@ download_with_retries() {
 ## if ! IsPackageInstalled packageName; then
 ##     echo "packageName is not installed!"
 ## fi
-function IsPackageInstalled {
+IsPackageInstalled() {
     dpkg -S $1 &> /dev/null
 }
 
 verlte() {
     sortedVersion=$(echo -e "$1\n$2" | sort -V | head -n1)
     [  "$1" = "$sortedVersion" ]
-}
+}
+
+get_toolset_path() {
+    echo "/imagegeneration/installers/toolset.json"
+}
+
+get_toolset_value() {
+    local toolset_path=$(get_toolset_path)
+    local query=$1
+    echo "$(jq -r "$query" $toolset_path)"
+}

images/linux/scripts/helpers/invoke-tests.sh

@@ -0,0 +1,8 @@
+#!/bin/bash -e
+################################################################################
+##  File:  invoke-tests.sh
+##  Desc:  Helper function for invoking tests
+################################################################################
+
+pwsh -Command "Import-Module '$HELPER_SCRIPTS/Tests.Helpers.psm1' -DisableNameChecking
+    Invoke-PesterTests -TestFile \"$1\" -TestName \"$2\""

images/linux/scripts/helpers/mysql-service-helper.sh

@@ -0,0 +1,193 @@
+#!/bin/bash -e
+#
+# Temporary fix for the https://github.com/actions/virtual-environments/issues/4732 issue
+# Taken from the official ubuntu:20.04 docker container
+### BEGIN INIT INFO
+# Provides:          mysql
+# Required-Start:    $remote_fs $syslog
+# Required-Stop:     $remote_fs $syslog
+# Should-Start:      $network $time
+# Should-Stop:       $network $time
+# Default-Start:     2 3 4 5
+# Default-Stop:      0 1 6
+# Short-Description: Start and stop the mysql database server daemon
+# Description:       Controls the main MySQL database server daemon "mysqld"
+#                    and its wrapper script "mysqld_safe".
+### END INIT INFO
+#
+set -e
+set -u
+${DEBIAN_SCRIPT_DEBUG:+ set -v -x}
+
+test -x /usr/bin/mysqld_safe || exit 0
+
+. /lib/lsb/init-functions
+
+SELF=$(cd $(dirname $0); pwd -P)/$(basename $0)
+CONF=/etc/mysql/my.cnf
+MYADMIN="/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf"
+
+# priority can be overriden and "-s" adds output to stderr
+ERR_LOGGER="logger -p daemon.err -t /etc/init.d/mysql -i"
+
+# Safeguard (relative paths, core dumps..)
+cd /
+umask 077
+
+# mysqladmin likes to read /root/.my.cnf. This is usually not what I want
+# as many admins e.g. only store a password without a username there and
+# so break my scripts.
+export HOME=/etc/mysql/
+
+## Fetch a particular option from mysql's invocation.
+#
+# Usage: void mysqld_get_param option
+mysqld_get_param() {
+	/usr/sbin/mysqld --print-defaults \
+		| tr " " "\n" \
+		| grep -- "--$1" \
+		| tail -n 1 \
+		| cut -d= -f2
+}
+
+## Do some sanity checks before even trying to start mysqld.
+sanity_checks() {
+  # check for config file
+  if [ ! -r /etc/mysql/my.cnf ]; then
+    log_warning_msg "$0: WARNING: /etc/mysql/my.cnf cannot be read. See README.Debian.gz"
+    echo                "WARNING: /etc/mysql/my.cnf cannot be read. See README.Debian.gz" | $ERR_LOGGER
+  fi
+
+  # check for diskspace shortage
+  datadir=`mysqld_get_param datadir`
+  if LC_ALL=C BLOCKSIZE= df --portability $datadir/. | tail -n 1 | awk '{ exit ($4>4096) }'; then
+    log_failure_msg "$0: ERROR: The partition with $datadir is too full!"
+    echo                "ERROR: The partition with $datadir is too full!" | $ERR_LOGGER
+    exit 1
+  fi
+}
+
+## Checks if there is a server running and if so if it is accessible.
+#
+# check_alive insists on a pingable server
+# check_dead also fails if there is a lost mysqld in the process list
+#
+# Usage: boolean mysqld_status [check_alive|check_dead] [warn|nowarn]
+mysqld_status () {
+    ping_output=`$MYADMIN ping 2>&1`; ping_alive=$(( ! $? ))
+
+    ps_alive=0
+    pidfile=`mysqld_get_param pid-file`
+    if [ -f "$pidfile" ] && ps `cat $pidfile` >/dev/null 2>&1; then ps_alive=1; fi
+    
+    if [ "$1" = "check_alive"  -a  $ping_alive = 1 ] ||
+       [ "$1" = "check_dead"   -a  $ping_alive = 0  -a  $ps_alive = 0 ]; then
+	return 0 # EXIT_SUCCESS
+    else
+  	if [ "$2" = "warn" ]; then
+  	    echo -e "$ps_alive processes alive and '$MYADMIN ping' resulted in\n$ping_output\n" | $ERR_LOGGER -p daemon.debug
+	fi
+  	return 1 # EXIT_FAILURE
+    fi
+}
+
+#
+# main()
+#
+
+case "${1:-''}" in
+  'start')
+	sanity_checks;
+	# Start daemon
+	log_daemon_msg "Starting MySQL database server" "mysqld"
+	if mysqld_status check_alive nowarn; then
+	   log_progress_msg "already running"
+	   log_end_msg 0
+	else
+	    # Could be removed during boot
+	    test -e /var/run/mysqld || install -m 755 -o mysql -g root -d /var/run/mysqld
+
+	    # Start MySQL! 
+  	    su - mysql -s /bin/sh -c "/usr/bin/mysqld_safe > /dev/null 2>&1 &"
+
+	    # 6s was reported in #352070 to be too few when using ndbcluster
+	    # 14s was reported in #736452 to be too few with large installs
+	    for i in $(seq 1 30); do
+                sleep 1
+	        if mysqld_status check_alive nowarn ; then break; fi
+		log_progress_msg "."
+	    done
+	    if mysqld_status check_alive warn; then
+                log_end_msg 0
+	        # Now start mysqlcheck or whatever the admin wants.
+	        output=$(/etc/mysql/debian-start)
+		[ -n "$output" ] && log_action_msg "$output"
+	    else
+	        log_end_msg 1
+		log_failure_msg "Please take a look at the syslog"
+	    fi
+	fi
+	;;
+
+  'stop')
+	# * As a passwordless mysqladmin (e.g. via ~/.my.cnf) must be possible
+	# at least for cron, we can rely on it here, too. (although we have 
+	# to specify it explicit as e.g. sudo environments points to the normal
+	# users home and not /root)
+	log_daemon_msg "Stopping MySQL database server" "mysqld"
+	if ! mysqld_status check_dead nowarn; then
+	  set +e
+	  shutdown_out=`$MYADMIN shutdown 2>&1`; r=$?
+	  set -e
+	  if [ "$r" -ne 0 ]; then
+	    log_end_msg 1
+	    [ "$VERBOSE" != "no" ] && log_failure_msg "Error: $shutdown_out"
+	    log_daemon_msg "Killing MySQL database server by signal" "mysqld"
+	    killall -15 mysqld
+            server_down=
+	    for i in 1 2 3 4 5 6 7 8 9 10; do
+              sleep 1
+              if mysqld_status check_dead nowarn; then server_down=1; break; fi
+            done
+          if test -z "$server_down"; then killall -9 mysqld; fi
+	  fi
+        fi
+
+        if ! mysqld_status check_dead warn; then
+	  log_end_msg 1
+	  log_failure_msg "Please stop MySQL manually and read /usr/share/doc/mysql-server-5.7/README.Debian.gz!"
+	  exit -1
+	else
+	  log_end_msg 0
+        fi
+	;;
+
+  'restart')
+	set +e; $SELF stop; set -e
+	$SELF start 
+	;;
+
+  'reload'|'force-reload')
+  	log_daemon_msg "Reloading MySQL database server" "mysqld"
+	$MYADMIN reload
+	log_end_msg 0
+	;;
+
+  'status')
+	if mysqld_status check_alive nowarn; then
+	  log_action_msg "$($MYADMIN version)"
+	else
+	  log_action_msg "MySQL is stopped."
+	  exit 3
+	fi
+  	;;
+
+  *)
+	echo "Usage: $SELF start|stop|restart|reload|force-reload|status"
+	exit 1
+	;;
+esac
+
+# Some success paths end up returning non-zero so exit 0 explicitly. See
+# bug #739846.
+exit 0

images/linux/scripts/helpers/os.sh

@@ -4,11 +4,6 @@
 ##  Desc:  Helper functions for installing tools
 ################################################################################
 
-function isUbuntu16
-{
-    lsb_release -d | grep -q 'Ubuntu 16'
-}
-
 function isUbuntu18
 {
     lsb_release -d | grep -q 'Ubuntu 18'

images/linux/scripts/installers/7-zip.sh

@@ -1,16 +0,0 @@
-#!/bin/bash -e
-################################################################################
-##  File:  7-zip.sh
-##  Desc:  Installs 7-zip
-################################################################################
-
-# Install 7-Zip
-apt-get update -y
-apt-get install -y p7zip p7zip-full p7zip-rar
-
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v 7z; then
-    echo "7-Zip was not installed"
-    exit 1
-fi

images/linux/scripts/installers/Configure-Toolset.ps1

@@ -4,6 +4,8 @@
 ##  Desc:  Configure toolset
 ################################################################################
 
+Import-Module "$env:HELPER_SCRIPTS/Tests.Helpers.psm1" -DisableNameChecking
+
 function Get-ToolsetToolFullPath
 {
     param
@@ -37,12 +39,8 @@ $ErrorActionPreference = "Stop"
 
 Write-Host "Configure toolset tools environment..."
 $toolsEnvironment = @{
-    boost = @{
-        variableTemplate = "BOOST_ROOT_{0}_{1}_{2}"
-    }
     go = @{
         command = "ln -s {0}/bin/* /usr/bin/"
-        defaultVariable = "GOROOT"
         variableTemplate = "GOROOT_{0}_{1}_X64"
     }
 }
@@ -93,3 +91,5 @@ foreach ($tool in $toolset.toolcache)
         Invoke-Expression -Command $command
     }
 }
+
+Invoke-PesterTests -TestFile "Toolset" -TestName "Toolset"

images/linux/scripts/installers/Install-AzureModules.ps1

@@ -0,0 +1,40 @@
+$ErrorActionPreference = "Stop"
+$ProgressPreference = "SilentlyContinue"
+
+Import-Module "$env:HELPER_SCRIPTS/Tests.Helpers.psm1" -DisableNameChecking
+
+# Get modules content from toolset
+$modules = (Get-ToolsetContent).azureModules
+$installPSModulePath = "/usr/share"
+
+foreach ($module in $modules)
+{
+    $moduleName = $module.name
+    Write-Host "Installing ${moduleName} to the ${installPSModulePath} path..."
+    foreach ($version in $module.versions)
+    {
+        $modulePath = Join-Path -Path $installPSModulePath -ChildPath "${moduleName}_${version}"
+        Write-Host " - $version [$modulePath]"
+        Save-Module -Path $modulePath -Name $moduleName -RequiredVersion $version -Force
+    }
+
+    $assets = Invoke-RestMethod $module.url
+
+    # Get github release asset for each version
+    foreach ($toolVersion in $module.zip_versions) {
+        $asset = $assets | Where-Object version -eq $toolVersion `
+        | Select-Object -ExpandProperty files `
+        | Select-Object -First 1
+
+        Write-Host "Installing $($module.name) $toolVersion ..."
+        if ($null -ne $asset) {
+            Write-Host "Download $($asset.filename)"
+            wget $asset.download_url -nv --retry-connrefused --tries=10 -P $installPSModulePath
+        } else {
+            Write-Host "Asset was not found in versions manifest"
+            exit 1
+        }
+    }
+}
+
+Invoke-PesterTests -TestFile "PowerShellModules" -TestName "AzureModules"

images/linux/scripts/installers/Install-PowerShellModules.ps1

@@ -1,14 +1,15 @@
 $ErrorActionPreference = "Stop"
+$ProgressPreference = "SilentlyContinue"
 
-function Get-ToolsetContent
-{
-    $toolset = Join-Path $env:INSTALLER_SCRIPT_FOLDER "toolset.json"
-    Get-Content $toolset -Raw | ConvertFrom-Json
-}
+Import-Module "$env:HELPER_SCRIPTS/Tests.Helpers.psm1" -DisableNameChecking
 
 # Specifies the installation policy
 Set-PSRepository -InstallationPolicy Trusted -Name PSGallery
 
+# Try to update PowerShellGet before the actual installation
+Install-Module -Name PowerShellGet -Force
+Update-Module -Name PowerShellGet -Force
+
 # Install PowerShell modules
 $modules = (Get-ToolsetContent).powershellModules
 
@@ -29,3 +30,5 @@ foreach($module in $modules)
 
     Install-Module -Name $moduleName -Scope AllUsers -SkipPublisherCheck -Force
 }
+
+Invoke-PesterTests -TestFile "PowerShellModules" -TestName "PowerShellModules"

images/linux/scripts/installers/Install-Toolset.ps1

@@ -28,9 +28,8 @@ $ErrorActionPreference = "Stop"
 
 # Get toolset content
 $toolset = Get-Content -Path "$env:INSTALLER_SCRIPT_FOLDER/toolset.json" -Raw
-$toolsToInstall = @("Python", "Node", "Boost", "Go")
 
-$tools = ConvertFrom-Json -InputObject $toolset | Select-Object -ExpandProperty toolcache | Where-Object {$ToolsToInstall -contains $_.Name}
+$tools = ConvertFrom-Json -InputObject $toolset | Select-Object -ExpandProperty toolcache | Where-Object {$_.url -ne $null }
 
 foreach ($tool in $tools) {
     # Get versions manifest for current tool
@@ -51,8 +50,5 @@ foreach ($tool in $tools) {
             exit 1
         }
     }
+    chown -R "$($env:SUDO_USER):$($env:SUDO_USER)" "/opt/hostedtoolcache/$($tool.name)"
 }
-
-chown -R "$($env:SUDO_USER):$($env:SUDO_USER)" /opt/hostedtoolcache/Python
-chown -R "$($env:SUDO_USER):$($env:SUDO_USER)" /opt/hostedtoolcache/node
-chown -R "$($env:SUDO_USER):$($env:SUDO_USER)" /opt/hostedtoolcache/go

images/linux/scripts/installers/Validate-Toolset.ps1

@@ -1,92 +0,0 @@
-################################################################################
-##  File:  Validate-Toolset.ps1
-##  Team:  CI-Build
-##  Desc:  Validate Toolset
-################################################################################
-
-function Run-ExecutableTests {
-    param (
-        [Parameter(Mandatory)] [string[]] $Executables,
-        [Parameter(Mandatory)] [string] $ToolPath
-    )
-    $versionCommand = $Executables["command"]
-
-    foreach ($executable in $Executables["tools"]) {
-        $executablePath = Join-Path $ToolPath $executable
-        Write-Host "Check $executable..."
-        if (Test-Path $executablePath) {
-            Write-Host "$executable is successfully installed: $(& $executablePath $versionCommand)"
-        } else {
-            Write-Host "$executablePath is not installed!"
-            exit 1
-        }
-    }
-}
-
-$ErrorActionPreference = "Stop"
-
-# Define executables for cached tools
-$toolsExecutables = @{
-    Python = @{
-        tools = @("python", "bin/pip")
-        command = "--version"
-    }
-    node = @{
-        tools = @("bin/node", "bin/npm")
-        command = "--version"
-    }
-    PyPy = @{
-        tools = @("bin/python", "bin/pip")
-        command = "--version"
-    }
-    go = @{
-        tools = @("bin/go")
-        command = "version"
-    }
-    Ruby = @{
-        tools = @("bin/ruby")
-        command = "--version"
-    }
-}
-
-# Get toolset content
-$toolset = Get-Content -Path "$env:INSTALLER_SCRIPT_FOLDER/toolset.json" -Raw
-$tools = ConvertFrom-Json -InputObject $toolset | Select-Object -ExpandProperty toolcache
-
-foreach($tool in $tools) {
-
-    $toolPath = Join-Path $env:AGENT_TOOLSDIRECTORY $tool.name
-    # Get executables for current tool
-    $toolExecs = $toolsExecutables[$tool.name]
-
-    foreach ($version in $tool.versions) {
-        # Add wildcard if missing
-        if ($version.Split(".").Length -lt 3) {
-            $version += ".*"
-        }
-
-        # Check if version folder exists
-        $expectedVersionPath = Join-Path $toolPath $version
-        if (-not (Test-Path $expectedVersionPath)) {
-            Write-Host "Expected $($tool.name) $version folder is not found!"
-            exit 1
-        }
-
-        # Take latest installed version in case if toolset version contains wildcards
-        $foundVersion = Get-Item $expectedVersionPath `
-                        | Sort-Object -Property {[version]$_.name} -Descending `
-                        | Select-Object -First 1
-        $foundVersionPath = Join-Path $foundVersion $tool.arch
-
-        if ($toolExecs) {
-            Write-Host "Run validation test for $($tool.name)($($tool.arch)) $($foundVersion.name) executables..."
-            Run-ExecutableTests -Executables $toolExecs -ToolPath $foundVersionPath
-        }
-        $foundVersionName = $foundVersion.name
-        if ($tool.name -eq 'PyPy')
-        {
-            $pypyVersion = & "$foundVersionPath/bin/python" -c "import sys;print(sys.version.split('\n')[1])"
-            $foundVersionName = "{0} {1}" -f $foundVersionName, $pypyVersion
-        }
-    }
-}

images/linux/scripts/installers/aliyun-cli.sh

@@ -4,15 +4,13 @@
 ##  Desc:  Installs Alibaba Cloud CLI
 ################################################################################
 
+# Source the helpers for use with the script
+source $HELPER_SCRIPTS/install.sh
+
 # Install Alibaba Cloud CLI
-URL=$(curl -s https://api.github.com/repos/aliyun/aliyun-cli/releases/latest | jq -r '.assets[].browser_download_url | select(contains("aliyun-cli-linux"))')
-wget -P /tmp $URL
-tar xzvf /tmp/aliyun-cli-linux-*-amd64.tgz
+URL=$(curl -s https://api.github.com/repos/aliyun/aliyun-cli/releases/latest | jq -r '.assets[].browser_download_url | select(contains("aliyun-cli-linux") and endswith("amd64.tgz"))')
+download_with_retries $URL "/tmp"
+tar xzf /tmp/aliyun-cli-linux-*-amd64.tgz
 mv aliyun /usr/local/bin
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v aliyun ; then
-    echo "aliyun was not installed"
-    exit 1
-fi
+invoke_tests "CLI.Tools" "Aliyun CLI"

images/linux/scripts/installers/android.sh

@@ -7,6 +7,7 @@
 # Source the helpers for use with the script
 source $HELPER_SCRIPTS/os.sh
 source $HELPER_SCRIPTS/install.sh
+source $HELPER_SCRIPTS/etc-environment.sh
 
 function filter_components_by_version {
     minimumVersion=$1
@@ -24,30 +25,40 @@ function filter_components_by_version {
     done
 }
 
+function get_full_ndk_version {
+    majorVersion=$1
+    ndkFullVersion=$($SDKMANAGER --list | grep "ndk;${majorVersion}.*" | awk '{gsub("ndk;", ""); print $1}' | sort -V | tail -n1)
+    echo "$ndkFullVersion"
+}
+
 # Set env variable for SDK Root (https://developer.android.com/studio/command-line/variables)
 ANDROID_ROOT=/usr/local/lib/android
 ANDROID_SDK_ROOT=${ANDROID_ROOT}/sdk
+ANDROID_NDK_ROOT=${ANDROID_SDK_ROOT}/ndk-bundle
+SDKMANAGER=${ANDROID_SDK_ROOT}/cmdline-tools/latest/bin/sdkmanager
 echo "ANDROID_SDK_ROOT=${ANDROID_SDK_ROOT}" | tee -a /etc/environment
 
 # ANDROID_HOME is deprecated, but older versions of Gradle rely on it
 echo "ANDROID_HOME=${ANDROID_SDK_ROOT}" | tee -a /etc/environment
 
+# Set env variables for NDK Root
+echo "ANDROID_NDK_HOME=${ANDROID_NDK_ROOT}" | tee -a /etc/environment
+echo "ANDROID_NDK_ROOT=${ANDROID_NDK_ROOT}" | tee -a /etc/environment
+
 # Create android sdk directory
 mkdir -p ${ANDROID_SDK_ROOT}
 
 # Download the latest command line tools so that we can accept all of the licenses.
 # See https://developer.android.com/studio/#command-tools
-wget -O android-sdk.zip https://dl.google.com/android/repository/sdk-tools-linux-4333796.zip
-unzip android-sdk.zip -d ${ANDROID_SDK_ROOT}
-rm -f android-sdk.zip
-
-if isUbuntu20 ; then
-    # Sdk manager doesn't work with Java > 8, set version 8 explicitly
-    sed -i "2i export JAVA_HOME=${JAVA_HOME_8_X64}" /usr/local/lib/android/sdk/tools/bin/sdkmanager
-fi
+cmdlineTools="android-cmdline-tools.zip"
+download_with_retries https://dl.google.com/android/repository/commandlinetools-linux-7302050_latest.zip "." $cmdlineTools
+unzip -qq $cmdlineTools -d ${ANDROID_SDK_ROOT}/cmdline-tools
+# Command line tools need to be placed in ${ANDROID_SDK_ROOT}/sdk/cmdline-tools/latest to determine SDK root
+mv ${ANDROID_SDK_ROOT}/cmdline-tools/cmdline-tools ${ANDROID_SDK_ROOT}/cmdline-tools/latest
+rm -f $cmdlineTools
 
 # Check sdk manager installation
-/usr/local/lib/android/sdk/tools/bin/sdkmanager --list 1>/dev/null
+${SDKMANAGER} --list 1>/dev/null
 if [ $? -eq 0 ]
 then
     echo "Android SDK manager was installed"
@@ -56,24 +67,47 @@ else
     exit 1
 fi
 
-toolset="$INSTALLER_SCRIPT_FOLDER/toolset.json"
-minimumBuildToolVersion=$(jq -r '.android.build_tools_min_version' $toolset)
-minimumPlatformVersion=$(jq -r '.android.platform_min_version' $toolset)
-extras=$(jq -r '.android.extra_list[]|"extras;" + .' $toolset)
-addons=$(jq -r '.android.addon_list[]|"add-ons;" + .' $toolset)
-additional=$(jq -r '.android.additional_tools[]' $toolset)
+minimumBuildToolVersion=$(get_toolset_value '.android.build_tools_min_version')
+minimumPlatformVersion=$(get_toolset_value '.android.platform_min_version')
+extras=$(get_toolset_value '.android.extra_list[]|"extras;" + .')
+addons=$(get_toolset_value '.android.addon_list[]|"add-ons;" + .')
+additional=$(get_toolset_value '.android.additional_tools[]')
+ANDROID_NDK_MAJOR_VERSIONS=($(get_toolset_value '.android.ndk.versions[]'))
+ANDROID_NDK_MAJOR_DEFAULT=$(get_toolset_value '.android.ndk.default')
+ndkDefaultFullVersion=$(get_full_ndk_version $ANDROID_NDK_MAJOR_DEFAULT)
 
-# Install the following SDKs and build tools, passing in "y" to accept licenses.
-components=( "${extras[@]}" "${addons[@]}" "${additional[@]}" )
+components=("${extras[@]}" "${addons[@]}" "${additional[@]}")
+for ndk_version in "${ANDROID_NDK_MAJOR_VERSIONS[@]}"
+do
+    ndk_full_version=$(get_full_ndk_version $ndk_version)
+    components+=("ndk;$ndk_full_version")
+done
 
-availablePlatforms=($(${ANDROID_SDK_ROOT}/tools/bin/sdkmanager --list | sed -n '/Available Packages:/,/^$/p' | grep "platforms;android-" | cut -d"|" -f 1))
-allBuildTools=($(${ANDROID_SDK_ROOT}/tools/bin/sdkmanager --list | grep "build-tools;" | cut -d"|" -f 1 | sort -u))
+# This changes were added due to incompatibility with android ndk-bundle (ndk;22.0.7026061).
+# Link issue virtual-environments: https://github.com/actions/virtual-environments/issues/2481
+# Link issue xamarin-android: https://github.com/xamarin/xamarin-android/issues/5526
+ln -s $ANDROID_SDK_ROOT/ndk/$ndkDefaultFullVersion $ANDROID_NDK_ROOT
+
+ANDROID_NDK_MAJOR_LATEST=(${ANDROID_NDK_MAJOR_VERSIONS[-1]})
+ndkLatestFullVersion=$(get_full_ndk_version $ANDROID_NDK_MAJOR_LATEST)
+echo "ANDROID_NDK_LATEST_HOME=$ANDROID_SDK_ROOT/ndk/$ndkLatestFullVersion" | tee -a /etc/environment
+
+availablePlatforms=($($SDKMANAGER --list | sed -n '/Available Packages:/,/^$/p' | grep "platforms;android-[0-9]" | cut -d"|" -f 1))
+allBuildTools=($($SDKMANAGER --list | grep "build-tools;" | cut -d"|" -f 1 | sort -u))
 availableBuildTools=$(echo ${allBuildTools[@]//*rc[0-9]/})
 
 filter_components_by_version $minimumPlatformVersion "${availablePlatforms[@]}"
 filter_components_by_version $minimumBuildToolVersion "${availableBuildTools[@]}"
 
-echo "y" | ${ANDROID_SDK_ROOT}/tools/bin/sdkmanager ${components[@]}
+echo "y" | $SDKMANAGER ${components[@]}
+
+# Old skdmanager from sdk tools doesn't work with Java > 8, set version 8 explicitly
+if isUbuntu20; then
+    sed -i "2i export JAVA_HOME=${JAVA_HOME_8_X64}" ${ANDROID_SDK_ROOT}/tools/bin/sdkmanager
+fi
 
 # Add required permissions
 chmod -R a+rwx ${ANDROID_SDK_ROOT}
+
+reloadEtcEnvironment
+invoke_tests "Android"

images/linux/scripts/installers/ansible.sh

@@ -1,24 +0,0 @@
-#!/bin/bash -e
-################################################################################
-##  File:  ansible.sh
-##  Desc:  Installs Ansible
-################################################################################
-
-# Source the helpers for use with the script
-source $HELPER_SCRIPTS/os.sh
-
-# ppa:ansible/ansible doesn't contain packages for Ubuntu20.04
-if isUbuntu16 || isUbuntu18 ; then
-    add-apt-repository ppa:ansible/ansible
-    apt-get update
-fi
-
-# Install latest Ansible
-apt-get install -y --no-install-recommends ansible
-
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v ansible; then
-    echo "Ansible was not installed or found on PATH"
-    exit 1
-fi

images/linux/scripts/installers/apache.sh

@@ -0,0 +1,14 @@
+#!/bin/bash -e
+################################################################################
+##  File:  apache.sh
+##  Desc:  Installs Apache HTTP Server
+################################################################################
+
+# Install Apache
+apt-get install apache2 -y
+
+# Disable apache2.service
+systemctl is-active --quiet apache2.service && systemctl stop apache2.service
+systemctl disable apache2.service
+
+invoke_tests "WebServers" "Apache"

images/linux/scripts/installers/aws-sam-cli.sh

@@ -1,30 +0,0 @@
-#!/bin/bash -e
-################################################################################
-##  File:  aws-sam-cli.sh
-##  Desc:  Installs AWS SAM CLI
-##         Requires Python >=3.6, must be run as non-root user after toolset installation
-################################################################################
-
-# Download latest aws sam cli sources
-TarballUrl=$(curl -s https://api.github.com/repos/aws/aws-sam-cli/releases/latest | jq -r '.tarball_url')
-TarballPath="/tmp/aws-sam-cli.tar.gz"
-wget $TarballUrl -O $TarballPath
-tar -xzvf $TarballPath -C /tmp
-cd /tmp/aws-aws-sam-cli*
-
-mkdir /opt/python-aws-sam-cli
-cp -r /opt/hostedtoolcache/Python/3.7* /opt/python-aws-sam-cli
-
-# Use copy of python 3.7 from toolcache to install aws sam, setuptools package required for the installation
-Python3Dir=$(echo /opt/python-aws-sam-cli/3.7*/x64)
-Python3BinDir="${Python3Dir}/bin"
-$Python3BinDir/python3 -m pip install setuptools
-$Python3BinDir/python3 setup.py install
-ln -sf ${Python3BinDir}/sam /usr/local/bin/sam
-
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! sam --version; then
-    echo "AWS SAM CLI was not installed"
-    exit 1
-fi

images/linux/scripts/installers/aws.sh

@@ -1,41 +1,35 @@
 #!/bin/bash -e
 ################################################################################
 ##  File:  aws.sh
-##  Desc:  Installs the AWS CLI
+##  Desc:  Installs the AWS CLI, Session Manager plugin for the AWS CLI, and AWS SAM CLI
 ################################################################################
 
+# Source the helpers for use with the script
 source $HELPER_SCRIPTS/os.sh
+source $HELPER_SCRIPTS/install.sh
 
-# Install the AWS CLI v1 on Ubuntu16 and Ubuntu18, and AWS CLI v2 on Ubuntu20
+# Install the AWS CLI v1 Ubuntu18 and AWS CLI v2 on Ubuntu20
 if isUbuntu20 ; then
-    curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
-    unzip awscliv2.zip
-    ./aws/install -i /usr/local/aws-cli -b /usr/local/bin
-    rm awscliv2.zip
-    rm -rf aws
+    download_with_retries "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" "/tmp" "awscliv2.zip"
+    unzip -qq /tmp/awscliv2.zip -d /tmp
+    /tmp/aws/install -i /usr/local/aws-cli -b /usr/local/bin
 fi
 
-if isUbuntu16 || isUbuntu18 ; then
-    curl "https://s3.amazonaws.com/aws-cli/awscli-bundle.zip" -o "awscli-bundle.zip"
-    unzip awscli-bundle.zip
-    ./awscli-bundle/install -i /usr/local/aws -b /usr/local/bin/aws
-    rm awscli-bundle.zip
-    rm -rf awscli-bundle
+# The installation should be run after python3 is installed as aws-cli V1 dropped python2 support
+if isUbuntu18 ; then
+    download_with_retries "https://s3.amazonaws.com/aws-cli/awscli-bundle.zip" "/tmp" "awscli-bundle.zip"
+    unzip -qq /tmp/awscli-bundle.zip -d /tmp
+    python3 /tmp/awscli-bundle/install -i /usr/local/aws -b /usr/local/bin/aws
 fi
 
-# Validate the installation
-echo "Validate the installation"
-if ! command -v aws; then
-    echo "aws was not installed"
-    exit 1
-fi
+download_with_retries "https://s3.amazonaws.com/session-manager-downloads/plugin/latest/ubuntu_64bit/session-manager-plugin.deb" "/tmp" "session-manager-plugin.deb"
+apt install /tmp/session-manager-plugin.deb
 
-curl "https://s3.amazonaws.com/session-manager-downloads/plugin/latest/ubuntu_64bit/session-manager-plugin.deb" -o "session-manager-plugin.deb"
-sudo dpkg -i session-manager-plugin.deb
+# Download & install the latest aws sam cli release
+zipName="aws-sam-cli-linux-x86_64.zip"
+zipUrl="https://github.com/aws/aws-sam-cli/releases/latest/download/${zipName}"
+download_with_retries $zipUrl "/tmp" $zipName
+unzip /tmp/${zipName} -d /tmp
+/tmp/install
 
-sessionPlugin=$(session-manager-plugin)
-echo "$sessionPlugin"
-if ! [[ $sessionPlugin == *"was installed successfully"* ]]
-then
-    exit 1
-fi
+invoke_tests "CLI.Tools" "AWS"

images/linux/scripts/installers/azcopy.sh

@@ -4,26 +4,14 @@
 ##  Desc:  Installs AzCopy
 ################################################################################
 
-# Install AzCopy7
-wget -O azcopy.tar.gz https://aka.ms/downloadazcopylinux64
-tar -xf azcopy.tar.gz
-rm azcopy.tar.gz
-./install.sh
+source $HELPER_SCRIPTS/install.sh
 
 # Install AzCopy10
-wget -O /tmp/azcopy.tar.gz https://aka.ms/downloadazcopy-v10-linux
-tar zxvf /tmp/azcopy.tar.gz --strip-components=1 -C /tmp
-mv /tmp/azcopy /usr/local/bin/azcopy10
-chmod +x /usr/local/bin/azcopy10
+download_with_retries "https://aka.ms/downloadazcopy-v10-linux" "/tmp" "azcopy.tar.gz"
+tar xzf /tmp/azcopy.tar.gz --strip-components=1 -C /tmp
+mv /tmp/azcopy /usr/local/bin/azcopy
+chmod +x /usr/local/bin/azcopy
+# Create azcopy 10 alias for backward compatibility
+ln -sf /usr/local/bin/azcopy /usr/local/bin/azcopy10
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v azcopy; then
-    echo "azcopy7 was not installed"
-    exit 1
-fi
-
-if ! command -v azcopy10; then
-    echo "azcopy10 was not installed"
-    exit 1
-fi
+invoke_tests "Tools" "azcopy"

images/linux/scripts/installers/azpowershell.sh

@@ -1,34 +0,0 @@
-#!/bin/bash -e
-################################################################################
-##  File:  azpowershell.sh
-##  Desc:  Installed Azure PowerShell
-################################################################################
-
-# List of versions
-toolset="$INSTALLER_SCRIPT_FOLDER/toolset.json"
-versions=$(jq -r '.azureModules[] | select(.name | contains("az")) | .versions[]' $toolset)
-
-# Try to install and update PowerShellGet before the actual installation
-pwsh -Command "Install-Module -Name PowerShellGet -Force"
-pwsh -Command "Update-Module -Name PowerShellGet -Force"
-
-# Install Azure CLI (instructions taken from https://docs.microsoft.com/en-us/cli/azure/install-azure-cli)
-for version in ${versions[@]}; do
-    pwsh -Command "Save-Module -Name Az -LiteralPath /usr/share/az_$version -RequiredVersion $version -Force -Verbose"
-done
-
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-for version in ${versions[@]}; do
-    modulePath="/usr/share/az_$version"
-    pwsh -Command "
-        \$env:PSModulePath = '${modulePath}:' + \$env:PSModulePath;
-        if ( -not (Get-Module -ListAvailable -Name Az.Accounts)) {
-            Write-Host 'Az Module was not installed'
-            exit 1
-        }"
-    if [ $? -ne 0 ]; then
-        echo "Az version $version is not installed"
-        exit 1
-    fi
-done

images/linux/scripts/installers/azure-cli.sh

@@ -6,10 +6,8 @@
 
 # Install Azure CLI (instructions taken from https://docs.microsoft.com/en-us/cli/azure/install-azure-cli)
 curl -sL https://aka.ms/InstallAzureCLIDeb | sudo bash
+echo "azure-cli https://docs.microsoft.com/en-us/cli/azure/install-azure-cli-linux?pivots=apt" >> $HELPER_SCRIPTS/apt-sources.txt
+rm -f /etc/apt/sources.list.d/azure-cli.list
+rm -f /etc/apt/sources.list.d/azure-cli.list.save
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v az; then
-    echo "azure-cli was not installed"
-    exit 1
-fi
+invoke_tests "CLI.Tools" "Azure CLI"

images/linux/scripts/installers/azure-devops-cli.sh

@@ -12,11 +12,4 @@ echo "AZURE_EXTENSION_DIR=$AZURE_EXTENSION_DIR" | tee -a /etc/environment
 # install azure devops Cli extension
 az extension add -n azure-devops
 
-# check to determine if extension was installed or not
-if [ $? -eq 0 ]
-then
-    echo "azure DevOps Cli extension was installed"
-else
-    echo "azure DevOps Cli extension was not installed"
-    exit 1
-fi
+invoke_tests "CLI.Tools" "Azure DevOps CLI"

images/linux/scripts/installers/basic.sh

@@ -3,20 +3,13 @@
 ##  File:  basic.sh
 ##  Desc:  Installs basic command line utilities and dev packages
 ################################################################################
+source $HELPER_SCRIPTS/install.sh
 
-toolset="$INSTALLER_SCRIPT_FOLDER/toolset.json"
-common_packages=$(jq -r ".apt.common_packages[]" $toolset)
-cmd_packages=$(jq -r ".apt.cmd_packages[]" $toolset)
+common_packages=$(get_toolset_value .apt.common_packages[])
+cmd_packages=$(get_toolset_value .apt.cmd_packages[])
 for package in $common_packages $cmd_packages; do
     echo "Install $package"
     apt-get install -y --no-install-recommends $package
 done
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-for cmd in $cmd_packages; do
-    if ! command -v $cmd; then
-        echo "$cmd was not installed"
-        exit 1
-    fi
-done
+invoke_tests "Apt"

images/linux/scripts/installers/bazel.sh

@@ -4,23 +4,12 @@
 ##  Desc:  Installs Bazel and Bazelisk (A user-friendly launcher for Bazel)
 ################################################################################
 
-# Install bazel
-curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add -
-echo "deb [arch=amd64] https://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list
-apt-get update -y
-apt-get install -y bazel
+source $HELPER_SCRIPTS/install.sh
 
 # Install bazelisk
 npm install -g @bazel/bazelisk
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v bazel; then
-    echo "Bazel was not installed"
-    exit 1
-fi
+# run bazelisk once in order to instal /usr/local/bin/bazel binary
+bazelisk
 
-if ! command -v bazelisk; then
-    echo "Bazelisk was not installed"
-    exit 1
-fi
+invoke_tests "Tools" "Bazel"

images/linux/scripts/installers/bicep.sh

@@ -0,0 +1,16 @@
+#!/bin/bash -e
+################################################################################
+##  File:  bicep.sh
+##  Desc:  Installs bicep cli
+################################################################################
+
+source $HELPER_SCRIPTS/install.sh
+
+# Install Bicep CLI
+download_with_retries "https://github.com/Azure/bicep/releases/latest/download/bicep-linux-x64" "." "bicep.bin"
+# Mark it as executable
+chmod +x ./bicep.bin
+# Add bicep to PATH (requires admin)
+sudo mv ./bicep.bin /usr/local/bin/bicep
+
+invoke_tests "Tools" "Bicep"

images/linux/scripts/installers/build-essential.sh

@@ -1,18 +0,0 @@
-#!/bin/bash -e
-################################################################################
-##  File:  build-essential.sh
-##  Desc:  Installs build-essential package
-################################################################################
-
-source $HELPER_SCRIPTS/install.sh
-
-PACKAGE=build-essential
-
-# Test to see if the software in question is already installed, if not install it
-echo "Checking to see if the installer script has already been run"
-if ! IsPackageInstalled $PACKAGE; then
-    echo "Installing $PACKAGE"
-    apt-get install -y --no-install-recommends $PACKAGE
-else
-    echo "$PACKAGE is already installed"
-fi

images/linux/scripts/installers/clang.sh

@@ -5,27 +5,13 @@
 ################################################################################
 
 # Source the helpers for use with the script
-source $HELPER_SCRIPTS/os.sh
+source $HELPER_SCRIPTS/install.sh
 
 function InstallClang {
     local version=$1
 
     echo "Installing clang-$version..."
-    if [[ $version =~ 9 ]] && isUbuntu16; then
-        ./llvm.sh $version
-        apt-get install -y "clang-format-$version"
-    else
-        apt-get install -y "clang-$version" "lldb-$version" "lld-$version" "clang-format-$version"
-    fi
-
-    # Run tests to determine that the software installed as expected
-    echo "Testing to make sure that script performed as expected, and basic scenarios work"
-    for cmd in clang-$version clang++-$version; do
-        if ! command -v $cmd; then
-            echo "$cmd was not installed"
-            exit 1
-        fi
-    done
+    apt-get install -y "clang-$version" "lldb-$version" "lld-$version" "clang-format-$version" 
 }
 
 function SetDefaultClang {
@@ -37,23 +23,16 @@ function SetDefaultClang {
     update-alternatives --install /usr/bin/clang-format clang-format /usr/bin/clang-format-${version} 100
 }
 
-# Download script for automatic installation
-wget https://apt.llvm.org/llvm.sh
-chmod +x llvm.sh
-
-if isUbuntu16 || isUbuntu18; then
-   versions=( "6.0" "8" "9" )
-   default_clang_version="9"
-fi
-
-if isUbuntu20 ; then
-    versions=( "8" "9" "10" )
-    default_clang_version="10"
-fi
+versions=$(get_toolset_value '.clang.versions[]')
+default_clang_version=$(get_toolset_value '.clang.default_version')
 
 for version in ${versions[*]}; do
-    InstallClang $version
+    if [[ $version != $default_clang_version ]]; then
+        InstallClang $version
+    fi
 done
 
+InstallClang $default_clang_version
 SetDefaultClang $default_clang_version
-rm llvm.sh
+
+invoke_tests "Tools" "clang"

images/linux/scripts/installers/cleanup.sh

@@ -7,6 +7,7 @@ before=$(df / -Pm | awk 'NR==2{print $4}')
 # It removes everything but the lock file from /var/cache/apt/archives/ and /var/cache/apt/archives/partial
 apt-get clean
 rm -rf /tmp/*
+rm -rf /root/.cache
 
 # journalctl
 if command -v journalctl; then
@@ -28,3 +29,6 @@ after=$(df / -Pm | awk 'NR==2{print $4}')
  echo "Before: $before MB"
  echo "After : $after MB"
  echo "Delta : $(($after-$before)) MB"
+
+# delete symlink for tests running
+rm -f /usr/local/bin/invoke_tests

images/linux/scripts/installers/cmake.sh

@@ -9,16 +9,13 @@ echo "Checking to see if the installer script has already been run"
 if command -v cmake; then
     echo "cmake is already installed"
 else
-	url=$(curl -s https://api.github.com/repos/Kitware/CMake/releases/latest | jq -r '.assets[].browser_download_url | select(contains("Linux-x86_64.sh"))')
-	curl -sL ${url} -o cmakeinstall.sh \
+	json=$(curl -s "https://api.github.com/repos/Kitware/CMake/releases")
+	latest_tag=$(echo $json | jq -r '.[] | select(.prerelease==false).tag_name' | sort --unique --version-sort | grep -v "rc" | tail -1)
+	sh_url=$(echo $json | jq -r ".[] | select(.tag_name==\"${latest_tag}\").assets[].browser_download_url | select(endswith(\"inux-x86_64.sh\"))")
+	curl -sL ${sh_url} -o cmakeinstall.sh \
 	&& chmod +x cmakeinstall.sh \
 	&& ./cmakeinstall.sh --prefix=/usr/local --exclude-subdir \
 	&& rm cmakeinstall.sh
 fi
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v cmake; then
-    echo "cmake was not installed"
-    exit 1
-fi
+invoke_tests "Tools" "Cmake"

images/linux/scripts/installers/codeql-bundle.sh

@@ -7,7 +7,7 @@
 source $HELPER_SCRIPTS/install.sh
 
 # Retrieve the name of the CodeQL bundle preferred by the Action (in the format codeql-bundle-YYYYMMDD).
-codeql_bundle_name="$(curl -sSL https://raw.githubusercontent.com/github/codeql-action/main/src/defaults.json | jq -r .bundleVersion)"
+codeql_bundle_name="$(curl -sSL https://raw.githubusercontent.com/github/codeql-action/v1/src/defaults.json | jq -r .bundleVersion)"
 # Convert the bundle name to a version number (0.0.0-YYYYMMDD).
 codeql_bundle_version="0.0.0-${codeql_bundle_name##*-}"
 
@@ -23,6 +23,3 @@ touch "$extraction_directory/pinned-version"
 
 # Touch a file to indicate to the toolcache that setting up CodeQL is complete.
 touch "$extraction_directory.complete"
-
-# Test that the tool has been extracted successfully.
-"$AGENT_TOOLSDIRECTORY/CodeQL/$codeql_bundle_version/x64/codeql/codeql" version

images/linux/scripts/installers/configure-environment.sh

@@ -1,12 +1,15 @@
 #!/bin/bash -e
 
-#Set ImageVersion and ImageOS env variables
+# Set ImageVersion and ImageOS env variables
 echo ImageVersion=$IMAGE_VERSION | tee -a /etc/environment
 echo ImageOS=$IMAGE_OS | tee -a /etc/environment
 
+# Set the ACCEPT_EULA variable to Y value to confirm your acceptance of the End-User Licensing Agreement
+echo ACCEPT_EULA=Y | tee -a /etc/environment
+
 # This directory is supposed to be created in $HOME and owned by user(https://github.com/actions/virtual-environments/issues/491)
 mkdir -p /etc/skel/.config/configstore
-echo 'export XDG_CONFIG_HOME=$HOME/.config' | tee -a /etc/skel/.bashrc
+echo 'XDG_CONFIG_HOME=$HOME/.config' | tee -a /etc/environment
 
 # Change waagent entries to use /mnt for swapfile
 sed -i 's/ResourceDisk.Format=n/ResourceDisk.Format=y/g' /etc/waagent.conf
@@ -25,3 +28,7 @@ chmod -R 777 $AGENT_TOOLSDIRECTORY
 # https://www.elastic.co/guide/en/elasticsearch/reference/current/vm-max-map-count.html
 # https://www.suse.com/support/kb/doc/?id=000016692
 echo 'vm.max_map_count=262144' | tee -a /etc/sysctl.conf
+
+# Create symlink for tests running
+chmod +x $HELPER_SCRIPTS/invoke-tests.sh
+ln -s $HELPER_SCRIPTS/invoke-tests.sh /usr/local/bin/invoke_tests

images/linux/scripts/installers/containers.sh

@@ -4,22 +4,25 @@
 ##  Desc:  Installs container tools: podman, buildah and skopeo onto the image
 ################################################################################
 
-# Install podman, buildah, scopeo container's tools
+source $HELPER_SCRIPTS/os.sh
+
 install_packages=(podman buildah skopeo)
+REPO_URL="https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable"
+
+# Install podman, buildah, scopeo container's tools (on Ubuntu20 these tools can be installed without adding new repository)
 source /etc/os-release
-sh -c "echo 'deb https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable/x${NAME}_${VERSION_ID}/ /' > /etc/apt/sources.list.d/devel:kubic:libcontainers:stable.list"
-wget -nv https://download.opensuse.org/repositories/devel:kubic:libcontainers:stable/x${NAME}_${VERSION_ID}/Release.key -O Release.key
+sh -c "echo 'deb ${REPO_URL}/x${NAME}_${VERSION_ID}/ /' > /etc/apt/sources.list.d/devel:kubic:libcontainers:stable.list"
+wget -qnv https://download.opensuse.org/repositories/devel:kubic:libcontainers:stable/x${NAME}_${VERSION_ID}/Release.key -O Release.key
 apt-key add Release.key
 apt-get update -qq
 apt-get -qq -y install ${install_packages[@]}
 mkdir -p /etc/containers
 echo -e "[registries.search]\nregistries = ['docker.io', 'quay.io']" | tee /etc/containers/registries.conf
 
-# Check that tools are installed properly
-echo "Testing to make sure that script performed as expected, and basic scenarios work" 
-for cmd in ${install_packages[@]}; do 
-    if ! command -v $cmd; then 
-        echo "$cmd was not installed" 
-        exit 1 
-    fi 
-done
+# Remove source repo
+rm /etc/apt/sources.list.d/devel:kubic:libcontainers:stable.list
+
+# Document source repo
+echo "containers $REPO_URL" >> $HELPER_SCRIPTS/apt-sources.txt
+
+invoke_tests "Tools" "Containers"

images/linux/scripts/installers/docker-compose.sh

@@ -4,15 +4,9 @@
 ##  Desc:  Installs Docker Compose
 ################################################################################
 
-URL=$(curl -s https://api.github.com/repos/docker/compose/releases/latest | jq -r '.assets[].browser_download_url | select(contains("docker-compose-Linux-x86_64"))' | head -1)
-
-# Install latest docker-compose from releases
+# Install docker-compose v1 from releases
+URL="https://github.com/docker/compose/releases/download/1.29.2/docker-compose-Linux-x86_64"
 curl -L $URL -o /usr/local/bin/docker-compose
 chmod +x /usr/local/bin/docker-compose
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-if ! command -v docker-compose; then
-    echo "docker-compose was not installed"
-    exit 1
-fi
+invoke_tests "Tools" "Docker-compose v1"

images/linux/scripts/installers/docker-moby.sh

@@ -16,6 +16,7 @@ if ! IsPackageInstalled $docker_package; then
     apt-get update
     apt-get install -y moby-engine moby-cli
     apt-get install --no-install-recommends -y moby-buildx
+    apt-get install -y moby-compose
 else
     echo "Docker ($docker_package) is already installed"
 fi
@@ -24,25 +25,25 @@ fi
 systemctl is-active --quiet docker.service || systemctl start docker.service
 systemctl is-enabled --quiet docker.service || systemctl enable docker.service
 
-# Run tests to determine that the software installed as expected
-echo "Testing to make sure that script performed as expected, and basic scenarios work"
-echo "Checking the docker-moby and moby-buildx"
-if ! command -v docker; then
-    echo "docker was not installed"
-    exit 1
-elif ! [[ $(docker buildx) ]]; then
-    echo "Docker-Buildx was not installed"
-    exit 1
-else
-    echo "Docker-moby and Docker-buildx checking the successfull"
-    # Docker daemon takes time to come up after installing
-    sleep 10
-    docker info
+# Docker daemon takes time to come up after installing
+sleep 10
+docker info
+
+# If credentials are provided, attempt to log into Docker Hub
+# with a paid account to avoid Docker Hub's rate limit.
+if [ "${DOCKERHUB_LOGIN}" ] && [ "${DOCKERHUB_PASSWORD}" ]; then
+  docker login --username "${DOCKERHUB_LOGIN}" --password "${DOCKERHUB_PASSWORD}"
 fi
 
 # Pull images
-toolset="$INSTALLER_SCRIPT_FOLDER/toolset.json"
-images=$(jq -r '.docker.images[]' $toolset)
+images=$(get_toolset_value '.docker.images[]')
 for image in $images; do
     docker pull "$image"
 done
+
+# Always attempt to logout so we do not leave our credentials on the built
+# image. Logout _should_ return a zero exit code even if no credentials were
+# stored from earlier.
+docker logout
+
+invoke_tests "Tools" "Docker"

images/linux/scripts/installers/dotnetcore-sdk.sh

@@ -9,25 +9,8 @@ source $HELPER_SCRIPTS/install.sh
 source $HELPER_SCRIPTS/os.sh
 
 # Ubuntu 20 doesn't support EOL versions
-toolset="$INSTALLER_SCRIPT_FOLDER/toolset.json"
-LATEST_DOTNET_PACKAGES=$(jq -r '.dotnet.aptPackages[]' $toolset)
-versions=$(jq -r '.dotnet.versions[]' $toolset)
-
-mksamples()
-{
-    sdk=$1
-    sample=$2
-    mkdir "$sdk"
-    cd "$sdk" || exit
-    dotnet help
-    dotnet new globaljson --sdk-version "$sdk"
-    dotnet new "$sample"
-    dotnet restore
-    dotnet build
-    set +e
-    cd .. || exit
-    rm -rf "$sdk"
-}
+LATEST_DOTNET_PACKAGES=$(get_toolset_value '.dotnet.aptPackages[]')
+DOTNET_VERSIONS=$(get_toolset_value '.dotnet.versions[]')
 
 # Disable telemetry
 export DOTNET_CLI_TELEMETRY_OPTOUT=1
@@ -44,7 +27,7 @@ done
 
 # Get list of all released SDKs from channels which are not end-of-life or preview
 sdks=()
-for version in ${versions[@]}; do
+for version in ${DOTNET_VERSIONS[@]}; do
     release_url="https://dotnetcli.blob.core.windows.net/dotnet/release-metadata/${version}/releases.json"
     download_with_retries "${release_url}" "." "${version}.json"
     releases=$(cat "./${version}.json")
@@ -53,7 +36,8 @@ for version in ${versions[@]}; do
     rm ./${version}.json
 done
 
-sortedSdks=$(echo ${sdks[@]} | tr ' ' '\n' | grep -v preview | grep -v rc | grep -v display | cut -d\" -f2 | sort -u -r)
+sortedSdks=$(echo ${sdks[@]} | tr ' ' '\n' | grep -v preview | grep -v rc | grep -v display | cut -d\" -f2 | sort -r | uniq -w 5)
+
 extract_dotnet_sdk() {
     local ARCHIVE_NAME="$1"
     set -e
@@ -76,20 +60,11 @@ parallel --jobs 0 --halt soon,fail=1 \
 
 find . -name "*.tar.gz" | parallel --halt soon,fail=1 'extract_dotnet_sdk {}'
 
-# Smoke test each SDK
-for sdk in $sortedSdks; do
-    mksamples "$sdk" "console"
-    mksamples "$sdk" "mstest"
-    mksamples "$sdk" "xunit"
-    mksamples "$sdk" "web"
-    mksamples "$sdk" "mvc"
-    mksamples "$sdk" "webapi"
-done
-
 # NuGetFallbackFolder at /usr/share/dotnet/sdk/NuGetFallbackFolder is warmed up by smoke test
 # Additional FTE will just copy to ~/.dotnet/NuGet which provides no benefit on a fungible machine
 setEtcEnvironmentVariable DOTNET_SKIP_FIRST_TIME_EXPERIENCE 1
 setEtcEnvironmentVariable DOTNET_NOLOGO 1
 setEtcEnvironmentVariable DOTNET_MULTILEVEL_LOOKUP 0
-prependEtcEnvironmentPath /home/runner/.dotnet/tools
-echo 'export PATH="$PATH:$HOME/.dotnet/tools"' | tee -a /etc/skel/.bashrc
+prependEtcEnvironmentPath '$HOME/.dotnet/tools'
+
+invoke_tests "DotnetSDK"