[Checkins] [zopefoundation/zope.testrunner] 96ff9b: Fix failure counting across layers

Colin Watson noreply at github.com
Fri Oct 18 11:41:59 CEST 2019


  Branch: refs/heads/master
  Home:   https://github.com/zopefoundation/zope.testrunner
  Commit: 96ff9bf56378170f08392c01c12f0032ddaf585d
      https://github.com/zopefoundation/zope.testrunner/commit/96ff9bf56378170f08392c01c12f0032ddaf585d
  Author: Colin Watson <cjwatson at debian.org>
  Date:   2019-10-18 (Fri, 18 Oct 2019)

  Changed paths:
    M CHANGES.rst
    M src/zope/testrunner/runner.py
    M src/zope/testrunner/tests/testrunner-stops-when-stop-on-error.rst

  Log Message:
  -----------
  Fix failure counting across layers

When tests in multiple layers are being run, zope.testrunner outputs a
per-layer summary after each layer, and an overall summary at the end.
The addition of support for unexpected successes in 4.0.1 caused the
per-layer summary to report incorrect failure counts: rather than
reporting the number of failures in the current layer (as for errors and
skips), it reported the cumulative number of failures so far in the
whole test run.  This was confusing, since it could result in per-layer
summaries that appeared to report failures in the layer when none
existed.

Restore the pre-4.0.1 behaviour of having the per-layer summary report
only the number of failures in that layer.


  Commit: bb1f439cb0917dce260ed5f368d3331ed5f065b8
      https://github.com/zopefoundation/zope.testrunner/commit/bb1f439cb0917dce260ed5f368d3331ed5f065b8
  Author: Colin Watson <cjwatson at ubuntu.com>
  Date:   2019-10-18 (Fri, 18 Oct 2019)

  Changed paths:
    M CHANGES.rst
    M src/zope/testrunner/runner.py
    M src/zope/testrunner/tests/testrunner-stops-when-stop-on-error.rst

  Log Message:
  -----------
  Merge pull request #99 from cjwatson/fix-layer-failure-counting

Fix failure counting across layers


Compare: https://github.com/zopefoundation/zope.testrunner/compare/15667b8c916a...bb1f439cb091


More information about the checkins mailing list