Complete guide
1 Proportion Test Guide
Use the calculator above to test whether your observed pass or fail rate is genuinely above or below a benchmark. The 1 proportion z-test is the simplest hypothesis test for binary quality data and is the first check before claiming an improvement or flagging a supplier.
What it is
What is the 1 proportion test?
The 1 proportion z-test asks: could my observed proportion (p̂ = x/n) have come from a population where the true rate equals p₀? You compare the observed rate to a benchmark using a z-statistic. A significant result tells you the rate has genuinely shifted away from the target — either an improvement to claim or a problem to investigate.
Calculation logic
How the calculation works
This test asks whether your observed rate (defectives divided by total) is genuinely different from a target rate. It measures how many standard errors your observed proportion sits away from the target — the z-score — and converts that into a p-value. A p-value below 0.05 means the difference from target is real, not just sampling variation. The Wilson confidence interval gives a sensible range for the true rate, and it stays reliable even with small samples or very low defect counts.
Worked example
Worked example: has the defect rate actually improved?
Before a process change: 18 defects from 200 units (9%). After the change: 9 defects from 200 units (4.5%). That looks like an improvement — but with only 200 units, could it be luck?
The 1 Proportion Test gives p = 0.03. The improvement is real, not random variation in a small sample.
What to do with this: Lock in the process change — you have statistical evidence it works. Pair the p-value with the before/after numbers when making the business case to management.
Why it matters
Operational impact
Claiming an improvement without statistical evidence is one of the most common errors in quality management. The 1 proportion test stops teams from declaring victory based on a small favourable sample, and prevents rejecting a supplier based on a handful of defectives that could easily be sampling variation.
Decision making
When to use it
Use the 1 proportion test in the Control phase to verify that an improvement has genuinely moved the defect rate below the target. Also use it in supplier qualification to test whether a batch sample's defect rate meets the specification limit, and in audit sampling to confirm compliance with a maximum defect rate.
Lean Six Sigma
Link to Six Sigma
The 1 proportion test is the simplest entry point to hypothesis testing with attribute (binary) data in DMAIC. It feeds into the Analyse and Control phases, where you need to confirm that a baseline rate differs from a target and that improvements have been statistically verified before closing a project.
Industry examples
Where the 1 proportion test is used
ManufacturingTest whether a batch's observed defect rate is significantly below the contractual 2% limit before releasing to the customer.
HealthcareVerify whether an observed infection rate is significantly below the target threshold after a hand hygiene improvement programme.
Product & R&DCheck whether a prototype's pass rate in testing is significantly above the historical baseline for the product category.
Software & servicesTest whether an observed first-contact resolution rate has significantly exceeded the 80% KPI target after a training intervention.
Common mistakes
Common 1 Proportion Test mistakes
- Testing against a baseline that was set with very different sample sizes — the comparison is valid only if both proportions are based on meaningful sample sizes.
- Using a proportion test when counts are very small (fewer than 5 events) — use Fisher's Exact Test instead for rare events.
- Ignoring practical significance — a drop from 9% to 8.5% might be statistically significant with a large sample but completely irrelevant to the business.
- Forgetting to check whether the baseline is still current — if the process has changed since the baseline was set, the comparison is meaningless.
- Treating a single time period as representative — if defect rates vary by season, shift, or material batch, one snapshot may not reflect true process performance.
What to do next
After the test
If the test is significant and your rate is below the target, document the result in your control plan as evidence of verified improvement. If not significant, calculate the sample size needed to achieve 80% power for the expected difference — then collect that sample before drawing conclusions. If the rate is above the target, investigate and escalate through the DMAIC Analyse phase to find the root cause.
Resources
Templates, videos and learning
Combine the 1 proportion test with sample size planning, control charts, and DMAIC project structure to verify and sustain defect-rate improvements.
Frequently asked questions
When should I use the 1 proportion test?
Use the 1 proportion test when you have a single sample of pass/fail data and want to test whether the observed proportion is significantly different from a target or historical value (p₀). Examples: testing whether a process defect rate has genuinely fallen below the 5% target, whether a supplier's sample meets the 2% maximum defect rate, or whether an improvement has moved pass rates above 95%.
What is the p₀ (hypothesised proportion) and how do I choose it?
p₀ is the value you are testing against — the benchmark, target, or historical rate. Choose it based on your quality standard (e.g. a contractual defect limit), a historical baseline (e.g. last quarter's defect rate), or an industry benchmark. The test answers: 'Is our observed rate significantly different from p₀?'
What is the 95% confidence interval telling me?
The 95% Wilson confidence interval gives a range of plausible values for the true proportion. If the interval lies entirely below p₀, you can be confident the true rate is below the target. If it overlaps p₀, you cannot rule out that the true rate equals the target — possibly because the sample is too small to detect the difference with certainty.
Why is Wilson's interval preferred over a simple z-interval?
Wilson's confidence interval (also called the score interval) has better coverage than the standard formula p̂ ± z√(p̂(1−p̂)/n), especially when p is close to 0 or 1 or the sample is small. The standard interval can produce impossible values below 0 or above 1, or have poor coverage with small samples. Wilson's interval is the modern recommended default for proportions.