Product Quality Metrics (Product) Efficiency

Bug Escape Rate

Bug Escape Rate: Share of bugs found in production rather than caught in testing.

Formula

Bug Escape Rate = Production bugs / (Production bugs + Bugs caught in QA) × 100

Computable definition

The canonical formula in the GASP formula grammar. The MCP server compiles it to SQL over the datasets listed below.

count_distinct(field.issue_id where field.issue_type = 'bug' and field.issue_environment = 'production') / count_distinct(field.issue_id where field.issue_type = 'bug')

Unit: percent (the formula yields an unscaled ratio)

Notes: Production bugs divided by production bugs plus bugs caught in QA. stage is 'production' or 'qa'.

Data requirements

Grain: Per event, aggregate monthly · Frequency: Daily · Aggregation: aggregate (month) · Staged: no · Main source: Product Analytics.

Field	Dataset	Type
`created_at`	issue	timestamp
`issue_environment`	issue	string
`issue_id`	issue	string
`issue_type`	issue	string

Example SQL (Postgres)

SELECT (CAST((SELECT COUNT(DISTINCT issue_id) FROM issue WHERE created_at >= :period_start AND created_at < (:period_end + INTERVAL '1 day') AND (issue_type = 'bug' AND issue_environment = 'production')) AS DOUBLE PRECISION) / NULLIF((SELECT COUNT(DISTINCT issue_id) FROM issue WHERE created_at >= :period_start AND created_at < (:period_end + INTERVAL '1 day') AND issue_type = 'bug'), 0)) AS bug_escape_rate

From an agent: with the GASP MCP server, call lookup_metric({ "name": "Bug Escape Rate" }) or generate_query({ "metric": "Bug Escape Rate", "adapter": "<your adapter JSON>" }).

← Back to Product metrics