Codecov overall coverage aggregation when a defined flag is omitted
0 reputation · 11 Jan 2024, 12:33 UTC
Codecov overall coverage aggregation when a defined flag is omitted
Goal: determine how Codecov recalculates overall project coverage when a coverage upload includes only a subset of the flags defined in codecov.yml, leaving other flags absent from that build.
Assumption: current Codecov SaaS flag implementation as described in public documentation. Public docs state that missing per-flag thresholds fall back to the global threshold and that flag coverage is reported separately, but they do not explicitly define the overall-coverage aggregation rule when some flags are omitted. Whether omitted flags count as zero, are excluded from the denominator, or retain a prior value is an unresolved implementation detail and may differ by plan tier.
- Does Codecov treat omitted flags as zero coverage in the overall percentage for that build?
- Is the overall coverage denominator based on all defined flags or only flags present in the upload?
- Does this aggregation behavior differ between free and paid Codecov tiers?