Outlier

Jump to navigation Jump to search
Error creating thumbnail: File missing
Figure 1. Box plot of data from the Michelson-Morley Experiment displaying outliers in the middle column.

WikiDoc Resources for Outlier

Articles

Most recent articles on Outlier

Most cited articles on Outlier

Review articles on Outlier

Articles on Outlier in N Eng J Med, Lancet, BMJ

Media

Powerpoint slides on Outlier

Images of Outlier

Photos of Outlier

Podcasts & MP3s on Outlier

Videos on Outlier

Evidence Based Medicine

Cochrane Collaboration on Outlier

Bandolier on Outlier

TRIP on Outlier

Clinical Trials

Ongoing Trials on Outlier at Clinical Trials.gov

Trial results on Outlier

Clinical Trials on Outlier at Google

Guidelines / Policies / Govt

US National Guidelines Clearinghouse on Outlier

NICE Guidance on Outlier

NHS PRODIGY Guidance

FDA on Outlier

CDC on Outlier

Books

Books on Outlier

News

Outlier in the news

Be alerted to news on Outlier

News trends on Outlier

Commentary

Blogs on Outlier

Definitions

Definitions of Outlier

Patient Resources / Community

Patient resources on Outlier

Discussion groups on Outlier

Patient Handouts on Outlier

Directions to Hospitals Treating Outlier

Risk calculators and risk factors for Outlier

Healthcare Provider Resources

Symptoms of Outlier

Causes & Risk Factors for Outlier

Diagnostic studies for Outlier

Treatment of Outlier

Continuing Medical Education (CME)

CME Programs on Outlier

International

Outlier en Espanol

Outlier en Francais

Business

Outlier in the Marketplace

Patents on Outlier

Experimental / Informatics

List of terms related to Outlier

Overview

In statistics such as stratified samples, an outlier is an observation that is numerically distant from the rest of the data. Statistics derived from data sets that include outliers will often be misleading. For example, if one is calculating the average temperature of 10 objects in a room, and most are between 20-25° Celsius, but an oven is at 350° C, the median of the data may be 23 but the mean temperature will be 55. In this case, the median better reflects the temperature of a randomly sampled object than the mean. Outliers may be indicative of data points that belong to a different population than the rest of the sample set.

In most samplings of data, some data points will be further away from their expected values than what is deemed reasonable. This can be due to systematic error, faults in the theory that generated the expected values, or it can simply be the case that some observations happen to be a long way from the center of the data. Outlier points can therefore indicate faulty data, erroneous procedures, or areas where a certain theory might not be valid. However, a small number of outliers is expected in normal distributions.

Estimators not sensitive to outliers are said to be robust.

Deletion of outlier data is a controversial practice frowned on by many scientists and science instructors; while mathematical criteria provides an objective and quantitiative method for data rejection, it does not make the practice more scientifically or methodologically sound, especially in small sets or where a normal distribution cannot be assumed. Rejection of outliers is more acceptable in areas of practice where the underlying model of the process being measured and the usual distribution of measurement error are confidently known. When practiced, rejection of outliers usually is based on some rule such as the quartile rules given below, Chauvenet's Criterion, or Grubbs Test.

Mathematical definitions

Mild outliers

Defining <math>Q_1</math> and <math>Q_3</math> to be first and third quartiles, and <math>IQR</math> to be the interquartile range (<math>Q_3-Q_1</math>), one possible definition of being "far away" in this context is:

<math>< Q_1 - 1.5\cdot \mathrm{IQR},</math>

or

<math>> Q_3 + 1.5\cdot \mathrm{IQR}.</math>

<math>Q_1</math> and <math>Q_3</math> define the so-called inner fences, beyond which an observation would be labeled a mild outlier.

Extreme outliers

Extreme outliers are observations that are beyond the outer fences:

<math>< Q_1 - 3\cdot \mathrm{IQR},</math>

or

<math>> Q_3 + 3\cdot \mathrm{IQR}.</math>

Occurrence and causes

In the case of normally distributed data, using the above definitions, only about 1 in 150 observations will be a mild outlier, and only about 1 in 425,000 an extreme outlier. Because of this, outliers usually demand special attention, since they may indicate problems in sampling or data collection or transcription.

Alternatively, an outlier could be the result of a flaw in the assumed theory, calling for further investigation by the researcher.

Non-normal distributions

Even when a normal distribution model is appropriate to the data being analyzed, outliers are expected for large sample sizes and should not automatically be discarded if that is the case. Also, the possibility should be considered that the underlying distribution of the data is not approximately normal, having "fat tails". For instance, when sampling from a Cauchy distribution, the sample variance increases with the sample size, the sample mean fails to converge as the sample size increases, and outliers are expected at far larger rates than for a normal distribution. Outliers play an important role in statistics.

See also

External links

  • Definition of outlier from MathWorld.
  • [1] Grubbs test described by NIST manual
  • Fahy, Tom (2006). "Arcadia Financial: The Impact of Outliers on Absolute Returns in Trend Following Trading Systems". Retrieved 2006-10-29.

de:Ausreißer nl:Uitbijter

Template:WH Template:WikiDoc Sources