Datasaurus dozen

Thirteen data sets with the same descriptive statistics, yet very different distributions From Wikipedia, the free encyclopedia

The Datasaurus dozen comprises thirteen data sets that have nearly identical simple descriptive statistics to two decimal places, yet have very different distributions and appear very different when graphed.[1] It was inspired by the smaller Anscombe's quartet that was created in 1973.

Data

Summarize
Perspective

The following table contains summary statistics for all thirteen data sets.

More information of the linear regression: ...
Property Value Accuracy
Number of elements 142 exact
Mean of x 54.26 to 2 decimal places
Sample variance of x: s2
x
16.76 to 2 decimal places
Mean of y 47.83 to 2 decimal places
Sample variance of y: s2
y
26.93 to 2 decimal places
Correlation between x and y −0.06 to 3 decimal places
Linear regression line y = 53  0.1x to 0 and 1 decimal places, respectively
Coefficient of determination of the linear regression: 0.004 to 3 decimal places
Close
thirteen graphs of the datasets in the Datasaurus Dozen, visualized graphically and also summarized numerically to show their statistical summaries are similar, while their graphical representations are not similar
The thirteen data sets in the Datasaurus Dozen, visualized and summarized

The thirteen data sets were labeled as the following:

  • away
  • bullseye
  • circle
  • dino
  • dots
  • h_lines
  • high_lines
  • slant_down
  • slant_up
  • star
  • v_line
  • wide_lines
  • x_shape

Similar to the Anscombe's quartet, the Datasaurus dozen was designed to further illustrate the importance of looking at a set of data graphically before starting to analyze according to a particular type of relationship, and the inadequacy of basic statistic properties for describing realistic data sets.[2][3][4][5][1][6]

Creation

Summarize
Perspective
Thumb
The dinosaur data set created by Alberto Cairo that inspired the creation of the Datasaurus Dozen

The first data set, in the shape of a Tyrannosaurus, that inspired the rest of the "datasaurus" data set was constructed in 2016 by Alberto Cairo.[7][8] It was proposed by Maarten Lambrechts that this data set also be called "Anscombosaurus".[7]

This data set was then accompanied by twelve other data sets that were created by Justin Matejka and George Fitzmaurice at Autodesk. Unlike the Anscombe's quartet, where it is not known how the data set was generated,[9] the authors used simulated annealing to make these data sets. They made small, random, and biased changes to each point towards the desired shape. Each shape took 200,000 iterations of perturbations to complete.[1]

The pseudocode for this algorithm is as follows:

current_ds ← initial_ds
for x iterations, do:
    test_ds ← perturb(current_ds, temp)
    if similar_enough(test_ds, initial_ds):
        current_ds ← test_ds

function perturb(ds, temp):
    loop:
        test ← move_random_points(ds)
        if fit(test) > fit(ds) or temp > random():
            return test

where

  • initial_ds is the seed data set
  • current_ds is the latest version of the data set
  • fit() is a function used to check whether moving the points gets closer to the desired shape
  • temp is the temperature of the simulated annealing algorithm
  • similar_enough() is a function that checks whether the statistics for the two given data sets are similar enough
  • move_random_points() is a function that randomly moves data points

See also

References

Loading related searches...

Wikiwand - on

Seamless Wikipedia browsing. On steroids.