Test coverage results available online
Harri Porten
porten at froglogic.com
Fri Apr 24 21:06:06 AEST 2015
Dear OpenSHH developers,
in case this helps with your testing efforts:
At
http://www.opencoverage.net/projects/openssh/index_html/sources.html
you'll find an overview of the condition/decision code coverage as
achieved through a run of the test suite. The state last used is from the
git master branch commit 70860b6.
You might find the total coverage 27.8% to be much lower than what you've
seen before. Main reason is the use of the condition/decision metric which
is more ambitious than plain branch or line coverage. It requires testing
of more input combinations to achieve a higher level. On the positive side
chances of missing out a bug decrease.
Known and potential issues:
- Some statements are flagged as dead (unreachable) code which might be
fine according to the project's coding style. Like a 'break' after a
'goto'.
- The code configuration or test execution setup might be non-optimal and
have some features or tests disabled.
Todos:
- Improve the test execution name to be more meaningful than just 'ssh
(33)'.
- Filter out false negatives like above cases of dead code.
If you have any questions about the results, see a problem, or have a
suggestion just let me know. While the analysis of Open Source projects
started as an internal dogfooding project for our company's tool Squish
Coco we also hope to contribute something back to the quality of software
we all rely on.
Harri.
More information about the openssh-unix-dev
mailing list