Start Benchmark

This page creates a benchmark request issue in GitHub.

Need a new target first? Use the target onboarding skill at skills/target-onboarding/SKILL.md and follow its workflow.

The request moves through GitHub labels:

benchmark/01-pending: added by the issue template on creation.
benchmark/02-validated: added by the bot after JSON validation passes.
benchmark/03-approved: added manually by a maintainer.

Use the preconfigured target selector to fill the repository, immutable commit, and properties path from the target manifest.

Every target is a fork under the scfuzzbench GitHub org: main holds upstream code plus the harness, and pre-target holds the pristine upstream baseline. Compare pre-target...main in the target repo to inspect the harness; use the manifest's pinned commit for a reproducible run.

Preconfigured target

Target repo URL

Target commit / tag / branch

Benchmark type

EC2 instance type

Instances per fuzzer (1 to 20)

Timeout (hours, 0.25 to 72)

Preliminary updates (minutes; 0 turns them off)

Fuzzers

echidnamedusafoundryrecon-fuzzer

Open GitHub request issue

~$ 9.79

Request JSON preview

{
  "target_repo_url": "https://github.com/scfuzzbench/aave-v4-scfuzzbench",
  "target_commit": "459b020058f4a65d18eb1481083b75c766340124",
  "benchmark_type": "property",
  "instance_type": "c6a.4xlarge",
  "instances_per_fuzzer": 4,
  "timeout_hours": 1,
  "preliminary_interval_minutes": 60,
  "fuzzers": [
    "echidna",
    "medusa",
    "foundry",
    "recon-fuzzer"
  ],
  "foundry_git_repo": "",
  "foundry_git_ref": "",
  "echidna_version": "",
  "echidna_ci_repo": "",
  "echidna_ci_run_id": "",
  "echidna_ci_artifact_name": "",
  "echidna_ci_artifact_sha256": "",
  "echidna_ci_commit": "",
  "echidna_ci_token_ssm_parameter_name": "",
  "echidna_ci_token_kms_key_arn": "",
  "medusa_version": "",
  "medusa_git_repo": "",
  "medusa_git_ref": "",
  "medusa_git_commit": "",
  "medusa_go_version": "1.24.0",
  "medusa_go_sha256": "dea9ca38a0b852a74e81c26134671af7c0fbe65d81b0dc1c5bfe22cf7d4c8858",
  "recon_version": "",
  "git_token_ssm_parameter_name": "/scfuzzbench/recon/github_token",
  "properties_path": "tests/recon/Properties.sol",
  "fuzzer_env_json": ""
}

WARNING

Do not put secrets in the issue body. The request is intentionally public/auditable. For Echidna CI artifact mode, enter only the SSM SecureString parameter name; never paste its GitHub token.

Start Benchmark ​

Start Benchmark