Skip to content

feat(benches): forge test --isolate #11037

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Jul 23, 2025
Merged

feat(benches): forge test --isolate #11037

merged 9 commits into from
Jul 23, 2025

Conversation

yash-atreya
Copy link
Member

Motivation

Ref #11014

Solution

  • Adds the forge test --isolate bench

PR Checklist

  • Added Tests
  • Added Documentation
  • Breaking changes

Copy link
Contributor

📊 Foundry Benchmark Results

Generated at: 2025-07-18 09:47:02 UTC

Forge Test

Repositories Tested

  1. ithacaxyz/account
  2. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (5eb910c 2025-07-18)
Repository stable nightly
ithacaxyz-account 5.84 s 6.44 s
solady 6.90 s 6.98 s

Forge Fuzz Test

Repository stable nightly
ithacaxyz-account 6.13 s 6.58 s
solady 7.72 s 7.27 s
📈 View all benchmark results

Forge Build

Repositories Tested

  1. ithacaxyz/account
  2. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (5eb910c 2025-07-18)

No Cache

Repository stable nightly
ithacaxyz-account 2.59 s 2.82 s
solady 4.03 s 4.06 s

With Cache

Repository stable nightly
ithacaxyz-account 2.59 s 2.83 s
solady 4.10 s 3.99 s

Forge Coverage

Repositories Tested

  1. ithacaxyz/account

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (5eb910c 2025-07-18)
Repository stable nightly
ithacaxyz-account 20.54 s 21.97 s

Forge Test (Isolated)

Repositories Tested

  1. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (5eb910c 2025-07-18)
Repository stable nightly
solady 3.24 s 3.03 s

System Information

  • OS: linux
  • CPU: 8
  • Rustc: unknown

🤖 This comment was automatically generated by the Foundry Benchmarks workflow.

To run benchmarks manually: Go to Actions → "Run workflow"

@yash-atreya yash-atreya self-assigned this Jul 22, 2025
@yash-atreya yash-atreya moved this to Ready For Review in Foundry Jul 22, 2025
Copy link
Contributor

📊 Foundry Benchmark Results

Generated at: 2025-07-23 08:26:14 UTC

Forge Test

Repositories Tested

  1. ithacaxyz/account
  2. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)
Repository stable nightly
ithacaxyz-account 5.05 s 5.01 s
solady 2.86 s 2.72 s

Forge Fuzz Test

Repository stable nightly
ithacaxyz-account 5.53 s 4.94 s
solady 2.92 s 2.77 s
📈 View all benchmark results

Forge Build

Repositories Tested

  1. ithacaxyz/account
  2. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)

No Cache

Repository stable nightly
ithacaxyz-account 2.59 s 2.86 s
solady 3.83 s 3.97 s

With Cache

Repository stable nightly
ithacaxyz-account 0.197 s 0.423 s
solady 0.089 s 0.189 s

Forge Coverage

Repositories Tested

  1. ithacaxyz/account

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)
Repository stable nightly
ithacaxyz-account 21.90 s 21.59 s

Forge Test (Isolated)

Repositories Tested

  1. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)
Repository stable nightly
solady 3.03 s 2.81 s

System Information

  • OS: linux
  • CPU: 8
  • Rustc: rustc 1.88.0 (6b00bc388 2025-06-23)

🤖 This comment was automatically generated by the Foundry Benchmarks workflow.

To run benchmarks manually: Go to Actions → "Run workflow"

Copy link
Contributor

📊 Foundry Benchmark Results

Generated at: 2025-07-23 09:01:16 UTC

Forge Test

Repositories Tested

  1. ithacaxyz/account
  2. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)
Repository stable nightly
ithacaxyz-account 5.44 s 4.91 s
solady 3.02 s 2.76 s

Forge Fuzz Test

Repository stable nightly
ithacaxyz-account 5.27 s 4.90 s
solady 2.89 s 2.82 s

Forge Test (Isolated)

Repositories Tested

  1. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)
Repository stable nightly
solady 3.21 s 2.88 s
📈 View all benchmark results

Forge Build

Repositories Tested

  1. ithacaxyz/account
  2. Vectorized/solady

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)

No Cache

Repository stable nightly
ithacaxyz-account 2.58 s 2.79 s
solady 3.79 s 3.89 s

With Cache

Repository stable nightly
ithacaxyz-account 0.209 s 0.458 s
solady 0.096 s 0.226 s

Forge Coverage

Repositories Tested

  1. ithacaxyz/account

Foundry Versions

  • stable: forge Version: 1.2.3-stable (a813a2c 2025-06-08)
  • nightly: forge Version: 1.3.0-nightly (cb8f3bf 2025-07-23)
Repository stable nightly
ithacaxyz-account 21.88 s 22.52 s

System Information

  • OS: linux
  • CPU: 8
  • Rustc: rustc 1.88.0 (6b00bc388 2025-06-23)

🤖 This comment was automatically generated by the Foundry Benchmarks workflow.

To run benchmarks manually: Go to Actions → "Run workflow"

@yash-atreya yash-atreya marked this pull request as ready for review July 23, 2025 09:45
@yash-atreya yash-atreya merged commit 450f2c7 into master Jul 23, 2025
22 checks passed
@yash-atreya yash-atreya deleted the yash/isolate-bench branch July 23, 2025 13:49
@github-project-automation github-project-automation bot moved this from Ready For Review to Done in Foundry Jul 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants