Add Stress Tests to CI #3558
Open
Add Stress Tests to CI #3558
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #3558 +/- ##
==========================================
+ Coverage 59.44% 67.16% +7.72%
==========================================
Files 268 274 +6
Lines 62160 62478 +318
==========================================
+ Hits 36950 41963 +5013
+ Misses 25210 20515 -4695
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
paulmedynski
force-pushed
the
dev/paul/stress-ci
branch
from
d129881 to
f5308b0
Compare
- Added config file path configuration via STRESS_CONFIG_FILE environment variable. - Added support for JSON config file. - Fixed process exit code to reflect success vs failure. - Added emission to console. - Added emission of data source. - Added EntraId password-based auth. - Added CI stage. - Added NuGet package version to MDS assembly. - Added dotnet build configuration pararmeter to CI entry points. - Added MDS package version configurability to stress tests. - Added all target frameworks that MDS supports. - Each test run now creates and drops its own database to avoid collisions. - Moved to 1ES images where possible. - Using a local SQL Server that we setup as part of CI.
paulmedynski
force-pushed
the
dev/paul/stress-ci
branch
from
b5b1a71 to
0188996
Compare
There was a problem hiding this comment.
Pull Request Overview
This PR adds stress test execution to the CI pipeline for Microsoft.Data.SqlClient. The stress tests will run against Azure SQL database using existing infrastructure with EntraId username/password authentication.
Key changes:
- Creates new CI pipeline stages and jobs to build and run stress tests across multiple platforms (Windows, Linux, macOS)
- Modernizes the stress test framework with JSON configuration support, multi-target framework builds, and dynamic database creation
- Implements comprehensive stress test automation that can run against both local SQL Server instances and cloud databases
Reviewed Changes
Copilot reviewed 29 out of 29 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| tools/targets/GenerateThisAssemblyCs.targets | Adds NuGetPackageVersion constant for version tracking |
| eng/pipelines/stages/stress-tests-ci-stage.yml | New CI stage template for orchestrating stress tests across platforms |
| eng/pipelines/jobs/stress-tests-ci-job.yml | New CI job template for building and running stress tests on specific platforms |
| eng/pipelines/dotnet-sqlclient-ci-*.yml | Updates core CI pipelines to include stress test stages |
| src/Microsoft.Data.SqlClient/tests/StressTests/SqlClient.Stress.*/*.csproj | Modernizes project files to use centralized configuration |
| src/Microsoft.Data.SqlClient/tests/StressTests/SqlClient.Stress.Framework/StressConfigReader.cs | Adds JSON configuration file support alongside existing XML |
| src/Microsoft.Data.SqlClient/tests/StressTests/SqlClient.Stress.Tests/SqlClientStressFactory.cs | Implements database creation/deletion and EntraId authentication support |
| src/Microsoft.Data.SqlClient/tests/StressTests/SqlClient.Stress.Runner/Program.cs | Enhances CLI with console output option and MDS version reporting |
| src/Microsoft.Data.SqlClient/tests/StressTests/Directory.*.props | Adds centralized build configuration for all stress test projects |
| src/Microsoft.Data.SqlClient/tests/StressTests/Readme.md | Updates documentation with current framework support and usage instructions |
You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.
src/Microsoft.Data.SqlClient/tests/StressTests/SqlClient.Stress.Tests/SqlClientStressFactory.cs
Outdated
Show resolved
Hide resolved
- Added top-level pipeline flag to enable stress tests, deafult is false until tests are reliably passing.
paulmedynski
force-pushed
the
dev/paul/stress-ci
branch
from
d015909 to
2fe032a
Compare
- Addressed Copilot suggestions.
|
/azp run |
|
Azure Pipelines successfully started running 2 pipeline(s). |
|
The latest CI-SqlClient run for this PR is all green: This PR can be merged once approved. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adding stress tests runs to CI. These will use 1ES images for Windows and Linux, and Azure Pipelines macos-latest for macOS. All tests run against a locally installed SQL Server using SQL auth.
CI pipelines disable stress tests by default. You can manually run the pipelines with stress tests enabled.