Skip to main content

Reports & Output

Every UI test run produces structured output beyond just test code — professional reports, structured data, and documentation for different audiences.

Output Structure

playwright_tests/
├── .roost/
│ └── metadata.json # Run metadata — workflows, scenarios, token usage
├── scenarios/
│ ├── WF001_login_flow.json # Scenario JSON per workflow
│ ├── summaries/
│ │ └── WF001_login_flow.md # Markdown summary per scenario
│ └── reports/
│ └── WF001_login_flow.pdf # PDF report with screenshots
├── tests/
│ ├── login_analysis.spec.js # Login test
│ └── *.spec.js # Standard Playwright tests
├── pom_tests/
│ ├── pom/*.js # Page Object Model classes
│ ├── *.spec.js # POM-based test files
│ └── playwright.config.js
├── playwright.config.js
└── package.json

Output Formats

FormatLocationAudience
Playwright teststests/*.spec.jsDevelopers, CI/CD pipelines
POM testspom_tests/*.spec.js + pom_tests/pom/*.jsDevelopers, test engineers
PDF reportsscenarios/reports/*.pdfStakeholders, QA managers, clients
Markdown summariesscenarios/summaries/*.mdTeam wikis, PR descriptions
Scenario JSONscenarios/*.jsonAutomation tools, version control
Metadata.roost/metadata.jsonRun tracking, self-heal, retrigger

PDF Reports

Professional, formatted reports per workflow with:

  • Screenshots — captured at each step of the discovered workflow
  • Step-by-step visualizations — visual walkthrough of what was tested
  • AI-generated summaries — plain-language descriptions of what each test covers

PDF reports are ready to share with non-technical stakeholders, attach to sprint reviews, or include in client deliverables.

Multi-Language Reports

Reports render correctly in 21+ languages, including right-to-left scripts (Arabic, Hebrew, Farsi, Urdu). Configure the report language via USER_LANGUAGE in your .env file.

Supported languages include English, Spanish, French, German, Portuguese, Italian, Dutch, Russian, Chinese, Japanese, Korean, Arabic, Hebrew, Hindi, Turkish, Polish, Swedish, Norwegian, Danish, Finnish, Thai, and more.

Structured Scenario Data

Version-controllable JSON scenario files per workflow — you can edit them and regenerate tests without re-running exploration:

{
"test_name": "WF001_user_login",
"workflow_id": "WF001",
"proposed_scenarios": [
{
"scenario_name": "Successful login",
"detailed_steps": [
{ "action": "navigate", "description": "Go to login page" },
{ "action": "fill", "description": "Enter email address" },
{ "action": "click", "description": "Click Log In button" }
]
}
]
}

Next Steps