Skip to main content

Glossary: testing terms, defined by implementation

Every term below is defined the way MC Testing actually implements it — with the formula, the threshold or the safety rule from the platform's own code, not a generic dictionary meaning. If a report from this platform uses one of these words, this is precisely what it means.

Flaky Test

A test whose result flips between pass and fail across runs without the product changing — measured from result history, never guessed, and never silently deleted.

How MC Testing implements “Flaky Test”

Waiver

A recorded, owner-owned decision to accept a known risk — visible in every report, time-boxed by a review date, and never a way to make a critical blocker disappear.

How MC Testing implements “Waiver”

Why definitions matter here

A readiness report is only as trustworthy as the meanings behind its words. When MC Testing says a product is “not ready”, that is a gate outcome — an open critical finding, a confirmed exposure, a failing P0 case — not a mood. When it says coverage is 40%, that is a counted ratio of executed to planned cases, shown separately from the pass rate so thin evidence cannot hide behind green ticks. Pinning these definitions publicly, next to the profiles and packs that produce the evidence, is part of how the platform stays honest: anyone can check a report against the rules that produced it.