Reports & Output
Every UI test run produces structured output beyond just test code — professional reports, structured data, and documentation for different audiences.
Output Structure
playwright_tests/
├── .roost/
│ └── metadata.json # Run metadata — workflows, scenarios, token usage
├── scenarios/
│ ├── WF001_login_flow.json # Scenario JSON per workflow
│ ├── summaries/
│ │ └── WF001_login_flow.md # Markdown summary per scenario
│ └── reports/
│ └── WF001_login_flow.pdf # PDF report with screenshots
├── tests/
│ ├── login_analysis.spec.js # Login test
│ └── *.spec.js # Standard Playwright tests
├── pom_tests/
│ ├── pom/*.js # Page Object Model classes
│ ├── *.spec.js # POM-based test files
│ └── playwright.config.js
├── playwright.config.js
└── package.json
Output Formats
| Format | Location | Audience |
|---|---|---|
| Playwright tests | tests/*.spec.js | Developers, CI/CD pipelines |
| POM tests | pom_tests/*.spec.js + pom_tests/pom/*.js | Developers, test engineers |
| PDF reports | scenarios/reports/*.pdf | Stakeholders, QA managers, clients |
| Markdown summaries | scenarios/summaries/*.md | Team wikis, PR descriptions |
| Scenario JSON | scenarios/*.json | Automation tools, version control |
| Metadata | .roost/metadata.json | Run tracking, self-heal, retrigger |
PDF Reports
Professional, formatted reports per workflow with:
- Screenshots — captured at each step of the discovered workflow
- Step-by-step visualizations — visual walkthrough of what was tested
- AI-generated summaries — plain-language descriptions of what each test covers
PDF reports are ready to share with non-technical stakeholders, attach to sprint reviews, or include in client deliverables.
Multi-Language Reports
Reports render correctly in 21+ languages, including right-to-left scripts (Arabic, Hebrew, Farsi, Urdu). Configure the report language via USER_LANGUAGE in your .env file.
Supported languages include English, Spanish, French, German, Portuguese, Italian, Dutch, Russian, Chinese, Japanese, Korean, Arabic, Hebrew, Hindi, Turkish, Polish, Swedish, Norwegian, Danish, Finnish, Thai, and more.
Structured Scenario Data
Version-controllable JSON scenario files per workflow — you can edit them and regenerate tests without re-running exploration:
{
"test_name": "WF001_user_login",
"workflow_id": "WF001",
"proposed_scenarios": [
{
"scenario_name": "Successful login",
"detailed_steps": [
{ "action": "navigate", "description": "Go to login page" },
{ "action": "fill", "description": "Enter email address" },
{ "action": "click", "description": "Click Log In button" }
]
}
]
}
Next Steps
- Page Object Model — How the POM output is structured
- CI/CD Integration — Using reports in your pipeline
- Configuration Reference — Report and output settings