Benchmark · run 2026-11-21 · 10 runs per task per setup
Round 0 v2: adding Selenium, Firefox and WebKit
The same 10 tasks as Round 0, run as two separate comparisons so that only one thing changes at a time.
Short answer: libraries — Playwright 100/100, Puppeteer 100/100, Selenium (WebDriver BiDi) 100/100 passed; lowest median per task: Playwright 3, Puppeteer 7, Selenium (WebDriver BiDi) 0. Engines — Chromium 100/100, Firefox 100/100, WebKit 100/100 passed; lowest median per task: Chromium 7, Firefox 2, WebKit 1. Totals: in A, Puppeteer had the lowest sum of per-task medians; Playwright was 1.7% higher, Selenium (WebDriver BiDi) was 3.2% higher; in B, Chromium had the lowest sum of per-task medians; Firefox was 8.7% higher, WebKit was 16.1% higher. Page loads over a real network are a large share of every task, so check the per-task min–max ranges before reading much into small gaps.
How the comparison is controlled
- Comparison A — libraries: Playwright 1.65.1, Puppeteer 25.18.1 and selenium-webdriver 4.53.0 all drive the same browser binary (Chrome for Testing 153.0.8010.12 (headless shell)), headless, on the host directly. Selenium goes through chromedriver 153.0.8010.12 with WebDriver BiDi enabled (
webSocketUrlcapability confirmed on); its scripts use explicit waits, which is idiomatic Selenium. - Comparison B — engines: Playwright 1.65.1 drives its own bundled Chromium 159.0.8154.6, Firefox 159.0 and WebKit 27.2, all inside the official
mcr.microsoft.com/playwright:v1.65.1-noble (Docker, same host)image, with identical scripts. WebKit needs system libraries our host lacks, so the whole engine comparison runs in the container to keep the three engines on equal footing. Numbers from A and B should not be compared with each other. - Common to both: fresh browser process and context per task; the order of setups rotates every run; timing starts after launch and stops when the success check returns; 45 s timeout; same machine (AMD Ryzen 9 9950X3D 16-Core Processor) and network, run back to back on 2026-11-21.
A. Libraries on the same Chromium
| Task | Playwright pass · median ms (min–max) | Puppeteer pass · median ms (min–max) | Selenium (WebDriver BiDi) pass · median ms (min–max) |
|---|---|---|---|
quotes-login | 10/10 · 1,241 1,203–1,337 | 10/10 · 1,167 1,142–1,320 | 10/10 · 1,239 1,163–1,364 |
quotes-paginate | 10/10 · 3,176 3,035–3,261 | 10/10 · 3,294 3,115–3,376 | 10/10 · 3,360 3,238–3,546 |
quotes-js-render | 10/10 · 935 878–1,016 | 10/10 · 876 838–1,001 | 10/10 · 1,013 885–1,116 |
quotes-infinite-scroll | 10/10 · 1,806 1,675–2,089 | 10/10 · 1,973 1,704–2,104 | 10/10 · 1,823 1,489–2,094 |
books-category | 10/10 · 928 897–989 | 10/10 · 905 864–1,070 | 10/10 · 973 871–1,002 |
books-detail | 10/10 · 1,247 1,178–1,348 | 10/10 · 1,161 1,113–1,219 | 10/10 · 1,260 1,166–1,351 |
internet-dropdown | 10/10 · 1,092 1,005–1,117 | 10/10 · 1,050 975–1,109 | 10/10 · 1,101 1,024–1,150 |
internet-dynamic-loading | 10/10 · 6,356 6,311–6,457 | 10/10 · 6,110 5,994–6,132 | 10/10 · 6,234 6,099–6,321 |
internet-checkboxes | 10/10 · 1,133 1,060–1,177 | 10/10 · 1,061 1,008–1,147 | 10/10 · 1,147 1,045–1,262 |
internet-table | 10/10 · 1,001 990–1,019 | 10/10 · 1,003 981–1,021 | 10/10 · 1,045 1,012–1,079 |
| Sum of medians | 18,915 ms | 18,600 ms | 19,195 ms |
| Median launch | 26 ms | 46 ms | 116 ms |
B. Playwright on three engines
| Task | Chromium pass · median ms (min–max) | Firefox pass · median ms (min–max) | WebKit pass · median ms (min–max) |
|---|---|---|---|
quotes-login | 10/10 · 1,301 1,239–1,420 | 10/10 · 1,486 1,413–1,628 | 10/10 · 1,606 1,557–2,142 |
quotes-paginate | 10/10 · 3,332 3,261–3,584 | 10/10 · 4,442 4,283–4,714 | 10/10 · 4,172 4,007–4,420 |
quotes-js-render | 10/10 · 984 898–1,084 | 10/10 · 958 906–1,173 | 10/10 · 1,082 966–1,192 |
quotes-infinite-scroll | 10/10 · 2,036 1,487–2,224 | 10/10 · 2,027 1,668–2,226 | 10/10 · 3,768 3,200–4,117 |
books-category | 10/10 · 1,005 890–1,133 | 10/10 · 1,006 949–1,152 | 10/10 · 982 963–1,051 |
books-detail | 10/10 · 1,349 1,263–1,478 | 10/10 · 1,480 1,405–1,536 | 10/10 · 1,403 1,348–1,484 |
internet-dropdown | 10/10 · 1,103 1,015–1,179 | 10/10 · 1,176 1,045–2,318 | 10/10 · 1,127 1,012–1,229 |
internet-dynamic-loading | 10/10 · 6,408 6,311–6,448 | 10/10 · 6,465 6,414–6,661 | 10/10 · 6,495 6,374–6,564 |
internet-checkboxes | 10/10 · 1,161 1,062–1,205 | 10/10 · 1,244 1,155–1,393 | 10/10 · 1,184 1,081–1,259 |
internet-table | 10/10 · 1,008 991–1,025 | 10/10 · 1,112 1,022–1,235 | 10/10 · 1,039 1,011–1,119 |
| Sum of medians | 19,687 ms | 21,396 ms | 22,858 ms |
| Median launch | 17 ms | 170 ms | 24 ms |
What this does and doesn't tell you
- Launch time for Selenium includes starting chromedriver and negotiating a WebDriver session, which is part of real Selenium usage; it is not the browser alone.
- Engine results describe Playwright's patched builds of Firefox and WebKit, not stock Firefox or Safari.
- Simple pages, one machine, one network, one day. Re-run it and tell us if your numbers differ.
Download and re-run
Scripts (round0/tasks.mjs, round0/tasks-selenium.mjs, round0/run-v2.mjs) and every run's raw record are in github.com/RichardDu1/browsebench-harness (MIT).