Skip to content

Reduce the number of build agents used by CI. #10221

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Kartik Raj (karrtikr) merged 7 commits into from
Feb 21, 2020
Merged

Reduce the number of build agents used by CI. #10221

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
ac915b5
Drop extra jobs from the PR-validation pipeline.
ericsnowcurrently Feb 19, 2020
725eec0
Drop extra jobs from the PR-merge pipeline.
ericsnowcurrently Feb 19, 2020
6152175
Limit # of parallel jobs in each job matrix in the PR-merge and night…
ericsnowcurrently Feb 19, 2020
f518f62
Add a "manual build" CI pipeline for faster turnaround.
ericsnowcurrently Feb 19, 2020
3c5c7f7
Do not test internal tools on lower than Python 3.7.
ericsnowcurrently Feb 19, 2020
5b4cfdd
Drop the temporary workaround jobs.
ericsnowcurrently Feb 19, 2020
118df0e
(again) Do not test internal tools on lower than Python 3.7.
ericsnowcurrently Feb 19, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Limit # of parallel jobs in each job matrix in the PR-merge and night… 
…ly pipelines.

This reduces the max number of agents used by the PR-merge pipeline to 8
(from 24).  For the nightly pipeline it goes down from 84 to 12.  Both
will take longer to complete, but that shouldn't be a major problem.
  • Loading branch information
@ericsnowcurrently
ericsnowcurrently committed Feb 19, 2020
commit 61521753dd19a8d011a9d0d6c78c2f142e9eb9a3
4 changes: 4 additions & 0 deletions build/ci/vscode-python-ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,7 @@ stages:
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
maxParallel: 2
pool:
vmImage: 'ubuntu-16.04'
steps:
Expand All @@ -94,6 +95,7 @@ stages:
PythonVersion: '3.5'
TestsToRun: 'testDebugger'
NeedsPythonTestReqs: true
maxParallel: 2
pool:
vmImage: 'ubuntu-16.04'
steps:
Expand Down Expand Up @@ -133,6 +135,7 @@ stages:
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
maxParallel: 2
pool:
vmImage: 'macos-10.13'
steps:
Expand Down Expand Up @@ -172,6 +175,7 @@ stages:
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
maxParallel: 2
pool:
vmImage: 'vs2017-win2016'
steps:
Expand Down
30 changes: 21 additions & 9 deletions build/ci/vscode-python-nightly-ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,9 +63,10 @@ stages:
# This is for the venvTests to use, not needed if you don't run venv tests...
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
'Smoke':
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
maxParallel: 1
pool:
vmImage: 'ubuntu-16.04'
steps:
Expand Down Expand Up @@ -104,6 +105,7 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'ubuntu-16.04'
steps:
Expand Down Expand Up @@ -142,6 +144,7 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'ubuntu-16.04'
steps:
Expand Down Expand Up @@ -176,6 +179,7 @@ stages:
NeedsPythonTestReqs: true
# Note: Virtual env tests use `venv` and won't currently work with Python 2.7
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'ubuntu-16.04'
steps:
Expand Down Expand Up @@ -212,9 +216,10 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
'Smoke':
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
maxParallel: 1
pool:
vmImage: 'macos-10.13'
steps:
Expand Down Expand Up @@ -253,6 +258,7 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'macos-10.13'
steps:
Expand Down Expand Up @@ -291,6 +297,7 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'macos-10.13'
steps:
Expand Down Expand Up @@ -325,6 +332,7 @@ stages:
NeedsPythonTestReqs: true
# Note: Virtual env tests use `venv` and won't currently work with Python 2.7
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'macos-10.13'
steps:
Expand Down Expand Up @@ -361,9 +369,10 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
'Smoke':
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
TestsToRun: 'testSmoke'
NeedsPythonTestReqs: true
NeedsIPythonReqs: true
maxParallel: 1
pool:
vmImage: 'vs2017-win2016'
steps:
Expand Down Expand Up @@ -402,6 +411,7 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'vs2017-win2016'
steps:
Expand Down Expand Up @@ -440,6 +450,7 @@ stages:
NeedsPythonTestReqs: true
PYTHON_VIRTUAL_ENVS_LOCATION: './src/tmp/envPaths.json'
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'vs2017-win2016'
steps:
Expand Down Expand Up @@ -474,6 +485,7 @@ stages:
NeedsPythonTestReqs: true
# Note: Virtual env tests use `venv` and won't currently work with Python 2.7
# Note: We only run the smoke tests with the latest Python release.
maxParallel: 1
pool:
vmImage: 'vs2017-win2016'
steps:
Expand Down