Challenge
Manual regression for a wallet-integrated product experience was slow and hard to audit, especially around wallet flows, transaction-driven state changes, and release evidence.
Approach
- Built a Playwright framework with multi-environment targeting and browser projects.
- Implemented cookie-based auth to bypass flaky OAuth flows.
- Integrated Xray to generate BDD-style tests and upload results.
- Added evidence capture: logs, traces, screenshots, and videos on failure.
- Enabled CI parameterization for browser, env, and test scope selection.
Results
- Deterministic automation made releases faster and more predictable.
- Evidence-first debugging reduced triage time and context switching.
- Jira/Xray traceability improved cross-team release confidence.
Key metrics
| Metric | Before | After |
|---|---|---|
| Regression coverage | Manual runs | Deterministic Playwright runs |
| Traceability | Disconnected reports | Jira/Xray-linked results |
| Triage effort | Manual log collection | Auto evidence capture |
- Cookie-based auth kept tests stable across environments.
- Evidence-first debugging cut triage time dramatically.
- Traceable automation built confidence outside engineering.