Z-Score

A z-score, also known as a standard score, is a dimensionless quantity that expresses how many standard deviations a data point lies above or below the mean of its distribution. It is calculated by subtracting the population mean from the individual value and dividing the result by the population standard deviation. Z-scores allow researchers to compare observations from different distributions on a common scale.

The z-score is one of the most fundamental concepts in inferential statistics. It underpins hypothesis testing, confidence interval construction, and effect size interpretation. In meta analysis, z-scores are used to combine results across studies and test for overall significance. In clinical research, z-scores standardize growth measurements, laboratory values, and cognitive test results against reference populations. Understanding z-scores is essential for interpreting normal distributions, assessing statistical significance, and communicating how extreme an observation is relative to its reference group. Misreading z-scores has real consequences: a percentile read from the normal table for a skewed variable, or a cut off treated as a diagnosis, can misclassify individuals.

The z-score formula is z = (X - mu) / sigma, where X is the individual observation, mu is the population mean, and sigma is the population standard deviation. When these population values are unknown, the sample mean and sample standard deviation are used instead, as when values are standardized within a study's own data.

A z-score of 0 indicates the observation equals the mean. Positive z-scores indicate values above the mean, and negative z-scores indicate values below. Under a standard normal distribution, approximately 68% of observations fall within one standard deviation (z between -1 and 1), 95% within 1.96 standard deviations (roughly two), and 99.7% within three. Standardizing changes the units, not the shape: z-scores computed from a skewed variable are just as skewed as the original values, so these percentages, and percentiles read from the normal table, apply only when the variable is approximately normal.

In hypothesis testing, the z-test compares a sample statistic with a hypothesized population value when the population variance is known, or, as an approximation, when the sample is large. The z-statistic is the difference between the statistic and that value divided by the statistic's standard error, not by the standard deviation of individual observations. The resulting z-statistic is compared to critical values from the standard normal distribution to determine statistical significance.

Use z-scores when standardizing variables measured on different scales to enable direct comparison, when performing hypothesis tests with a known population variance or, approximately, with large samples, when interpreting individual observations relative to a reference population (such as pediatric growth charts or standardized test scores), and when combining effect sizes in meta analysis. Z-scores also serve as the basis for computing p values in many common statistical tests.

Reading percentiles or tail areas from the normal table for z-scores of a substantially nonnormal variable produces misleading results, because standardizing changes the units but not the shape of the distribution. The central limit theorem can make a z-test of a mean approximately valid in a large sample, but it does not make individual values normal. Confusing the z statistic with the t statistic leads to incorrect critical values and p values when the population standard deviation is estimated from the sample. Interpreting a high z-score as practically meaningful without considering the context and effect size overstates the importance of statistically significant but trivially small differences. Treating a cut off such as |z| greater than 2 or 3 as proof that a value is abnormal or an error is another mistake: such cut offs are conventions for flagging values for a closer look, and an extreme value also inflates the standard deviation used to compute its own z-score, which can hide it.

A pediatrician measures a child's height at 112 cm. The reference population for children of the same age and sex has a mean of 105 cm and a standard deviation of 4.5 cm. The z-score is (112 - 105) / 4.5 = 1.56, indicating the child is approximately 1.56 standard deviations taller than the average. This z-score lies inside the band from −2 to 2 that growth assessment commonly uses as a screening convention. Values outside such cut offs prompt further assessment rather than settling the question: in the WHO Child Growth Standards, for example, a height for age z-score below −2 defines stunting, but whether an individual child needs follow up depends on clinical judgment, not on the z-score alone. If the reference heights are approximately normal, a z-score of 1.56 corresponds to about the 94th percentile.