Skip to content

📊 Dashboard / Reports

Logs, The Dashboard, and Reports

đŸ”ĩ During test failures, logs and screenshots from the most recent test run will get saved to the latest_logs/ folder. If --archive-logs is specified (or if ARCHIVE_EXISTING_LOGS is set to True in, test logs will also get archived to the archived_logs/ folder. Otherwise, the log files will be cleaned out when the next test run begins (by default).


(Log files in SeleniumBase/examples/example_logs were generated when ran and failed.)

Examples of expected log files generated during failures:

In addition to log files, you can also generate dashboards and test reports.

The SeleniumBase Dashboard:

đŸ”ĩ The --dashboard option for pytest generates a SeleniumBase Dashboard located at dashboard.html, which updates automatically as tests run and produce results. Example:

pytest --dashboard --rs --headless

The SeleniumBase Dashboard

đŸ”ĩ Additionally, you can host your own SeleniumBase Dashboard Server on a port of your choice. Here's an example of that using Python 3's http.server:

python -m http.server 1948

đŸ”ĩ Now you can navigate to http://localhost:1948/dashboard.html in order to view the dashboard as a web app. This requires two different terminal windows: one for running the server, and another for running the tests, which should be run from the same directory. (Use Ctrl+C to stop the http server.)

đŸ”ĩ Here's a full example of what the SeleniumBase Dashboard may look like:

pytest --dashboard --rs --headless

The SeleniumBase Dashboard

Pytest Reports:

đŸ”ĩ Using --html=report.html gives you a fancy report of the name specified after your test suite completes.

pytest --html=report.html

Example Pytest Report

đŸ”ĩ When combining pytest html reports with SeleniumBase Dashboard usage, the pie chart from the Dashboard will get added to the html report. Additionally, if you set the html report URL to be the same as the Dashboard URL when also using the dashboard, (example: --dashboard --html=dashboard.html), then the Dashboard will become an advanced html report when all the tests complete.

đŸ”ĩ Here's an example of an upgraded html report:

pytest --dashboard --html=report.html

Dashboard Pytest HTML Report

If viewing pytest-html reports in Jenkins, you may need to configure Jenkins settings for the HTML to render correctly. This is due to Jenkins CSP changes. That setting can be changed from Manage Jenkins > Script Console by running:

System.setProperty("hudson.model.DirectoryBrowserSupport.CSP", "")

You can also use --junit-xml=report.xml to get an xml report instead. Jenkins can use this file to display better reporting for your tests.

pytest --junit-xml=report.xml

pynose Test Reports:

The pynose --report option gives you a fancy report after your tests complete.

pynose --report

Example pynose Test Report

(NOTE: You can add --show-report to immediately display pynose reports after the test suite completes. Only use --show-report when running tests locally because it pauses the test run.)

🐝âšĒ Behave Dashboard & Reports:

(The behave_bdd/ folder can be found in the examples/ folder.)

behave behave_bdd/features/ -D dashboard -D headless

You can also use --junit to get .xml reports for each Behave feature. Jenkins can use these files to display better reporting for your tests.

behave behave_bdd/features/ --junit -D rs -D headless