diff --git a/book/_build/.doctrees/environment.pickle b/book/_build/.doctrees/environment.pickle index 26d8923..9ca0962 100644 Binary files a/book/_build/.doctrees/environment.pickle and b/book/_build/.doctrees/environment.pickle differ diff --git a/book/_build/.doctrees/sampling.doctree b/book/_build/.doctrees/sampling.doctree index 64bb8d2..63269e4 100644 Binary files a/book/_build/.doctrees/sampling.doctree and b/book/_build/.doctrees/sampling.doctree differ diff --git a/book/_build/html/_sources/sampling.md b/book/_build/html/_sources/sampling.md index 0cd4c93..3bcfa0d 100644 --- a/book/_build/html/_sources/sampling.md +++ b/book/_build/html/_sources/sampling.md @@ -24,6 +24,27 @@ One important type of bias is **selection bias**, which occurs when the sample s The pollster might have a smarter colleague who assembles a list of names that is truly representative of all voters. The next hurlde is getting responses. If a phone survey is used, there will be many who don't answer. This is a problem *if* those who don't respond are systematically different than those who do respond. In fact, old people are usually more available and willing to answer the phone, potentially leading to bias. A systematic difference between respondents and non-respondents is called **non-response bias**. +The specific problem of an unrepresentative distribution of ages in a sample can be solved by using **quota sampling**. In quota sampling, the sample is constructed to resemble the population of interest with respect to key characteristics. This can help, but it doesn't guarantee representativeness because not all important characteristics can be understood. + +**Example**: Imagine we want to estimate the public's satisfaction with the US Postal Service. Opinions differ by age and by their curmudgeonliness. Perhaps older people like USPS more, but curmudgeons will not like USPS regardless of age *and* curmudgeons will not respond. It's easy to quota sample based on age, and a quota sample will result in an average satisfaction rating of 9 based on {numref}`age-curmudg-table`. This is better than not using quota sampling and constructing a sample that overrepresents older non-curmudgeons. However, the true average rating is 7. Quota sampling can't give a good estimate of the actual population parameter because quotas for old or young people will systematically exclude curmudgeons. + +```{list-table} Average USPS Satisfaction by Age and Curmudgeonliness +:header-rows: 1 +:name: age-curmudg-table + +* - + - Bottom 50% Age + - Top 50% Age +* - Bottom 50% Curmudgeon + - 8 + - 10 +* - Top 50% Curmudgeon + - 5 + - 5 +``` + + +### Non-response in the American Time Use Survey {cite}`abraham2006nonresponse` reports different response rates for the American Time Use Survey, partially reproduced in {numref}`atusresprates`. The differing response rates present a mine field for researchers. diff --git a/book/_build/html/objects.inv b/book/_build/html/objects.inv index da5457b..c17cf71 100644 Binary files a/book/_build/html/objects.inv and b/book/_build/html/objects.inv differ diff --git a/book/_build/html/sampling.html b/book/_build/html/sampling.html index bbff990..76edad2 100644 --- a/book/_build/html/sampling.html +++ b/book/_build/html/sampling.html @@ -417,7 +417,10 @@

Contents

@@ -450,9 +453,32 @@

Sample Surveys[AMB06] reports different response rates for the American Time Use Survey, partially reproduced in Table 11. The differing response rates present a mine field for researchers.

+

The specific problem of an unrepresentative distribution of ages in a sample can be solved by using quota sampling. In quota sampling, the sample is constructed to resemble the population of interest with respect to key characteristics. This can help, but it doesn’t guarantee representativeness because not all important characteristics can be understood.

+

Example: Imagine we want to estimate the public’s satisfaction with the US Postal Service. Opinions differ by age and by their curmudgeonliness. Perhaps older people like USPS more, but curmudgeons will not like USPS regardless of age and curmudgeons will not respond. It’s easy to quota sample based on age, and a quota sample will result in an average satisfaction rating of 9 based on Table 11. This is better than not using quota sampling and constructing a sample that overrepresents older non-curmudgeons. However, the true average rating is 7. Quota sampling can’t give a good estimate of the actual population parameter because quotas for old or young people will systematically exclude curmudgeons.

+ + + + + + + + + + + + + + + + + + +
Table 11 Average USPS Satisfaction by Age and Curmudgeonliness#

Bottom 50% Age

Top 50% Age

Bottom 50% Curmudgeon

8

10

Top 50% Curmudgeon

5

5

+
+

Non-response in the American Time Use Survey#

+

[AMB06] reports different response rates for the American Time Use Survey, partially reproduced in Table 12. The differing response rates present a mine field for researchers.

- + @@ -546,6 +572,7 @@

Sample Surveys @@ -611,7 +638,10 @@

Sample Surveys diff --git a/book/_build/html/searchindex.js b/book/_build/html/searchindex.js index f22d005..568e292 100644 --- a/book/_build/html/searchindex.js +++ b/book/_build/html/searchindex.js @@ -1 +1 @@ -Search.setIndex({"docnames": ["Homework05lab", "Rbasics", "bayes", "bibliography", "centerspread", "chancevar", "chancevary", "correlation", "correlation2", "experiments", "gettingstarted", "ghistogram", "gregression", "gsheets", "histograms", "intro", "lawofaverages", "natural", "normal", "normal0", "observational", "other", "probability", "probability1", "probtree", "pycalculator", "pylibs", "python", "regression", "sampling", "solutions", "statwrap", "statwrap0", "statwrapregression", "thehistogram"], "filenames": ["Homework05lab.ipynb", "Rbasics.ipynb", "bayes.md", "bibliography.md", "centerspread.md", "chancevar.md", "chancevary.ipynb", "correlation.ipynb", "correlation2.md", "experiments.md", "gettingstarted.md", "ghistogram.md", "gregression.md", "gsheets.md", "histograms.ipynb", "intro.md", "lawofaverages.md", "natural.md", "normal.ipynb", "normal0.md", "observational.md", "other.md", "probability.md", "probability1.md", "probtree.md", "pycalculator.ipynb", "pylibs.ipynb", "python.md", "regression.ipynb", "sampling.md", "solutions.md", "statwrap.md", "statwrap0.ipynb", "statwrapregression.ipynb", "thehistogram.md"], "titles": ["Homework 5", "Overview", "Probability II", "Bibliography", "Center and Spread", "Chance Error", "Chance Variability", "Correlation", "Correlation", "Experiments", "Getting Started", "Histograms", "Regression", "Overview", "Histograms", "Welcome to Intro Stats", "Law of Averages", "Natural Experiments", "Normal Distribution", "Normal Distribution", "Observational Studies", "Other", "Probability", "Probability", "Probability Trees", "Basics", "Libraries", "Overview", "Regression", "Sampling", "Selected Solutions", "StatWrap", "StatWrap", "Regression", "The Histogram"], "terms": {"copi": [0, 12], "differ": [0, 2, 4, 5, 6, 9, 10, 13, 17, 20, 27, 28, 29, 30, 33, 34], "text": [0, 2, 4, 5, 6, 7, 10, 13, 18, 21, 22, 25, 27, 28, 30, 31, 34], "exampl": [0, 2, 4, 5, 6, 9, 11, 13, 15, 18, 22, 27, 28, 29, 30], "you": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 13, 15, 17, 18, 20, 21, 22, 25, 26, 28, 29, 30, 31, 32, 33, 34], "receiv": [0, 2, 7, 17, 28], "small": [0, 2, 9, 17, 34], "data": [0, 3, 4, 5, 6, 9, 10, 11, 12, 13, 14, 15, 17, 18, 20, 22, 25, 27, 28, 29, 30, 33], "set": [0, 6, 7, 9, 10, 17, 18, 20, 28, 29, 30, 34], "call": [0, 4, 5, 6, 7, 8, 9, 17, 18, 20, 22, 25, 28, 29, 30, 33, 34], "cps_coupl": 0, "csv": [0, 28], "built": [0, 28], "from": [0, 2, 3, 4, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 22, 25, 26, 27, 28, 30, 31, 32, 34], "current": [0, 7, 9, 22], "popul": [0, 2, 3, 17, 20, 29, 30, 34], "survei": [0, 3, 18, 34], "each": [0, 2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 28, 29, 30, 34], "row": [0, 12, 13, 18, 22, 30, 33, 34], "describ": [0, 4, 5, 6, 9, 20, 22, 27, 28, 34], "marri": [0, 6], "coupl": [0, 28, 30], "The": [0, 1, 2, 3, 5, 6, 7, 8, 10, 11, 12, 15, 17, 20, 22, 25, 26, 27, 29, 30], "alreadi": [0, 2, 7, 20, 22, 26, 28, 31, 32], "clean": 0, "There": [0, 2, 5, 6, 7, 8, 9, 13, 17, 20, 22, 25, 27, 29, 30, 34], "ar": [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 32, 33, 34], "flag": [0, 22, 34], "valu": [0, 1, 4, 6, 7, 10, 12, 13, 18, 22, 25, 26, 27, 28, 30, 34], "need": [0, 1, 2, 7, 8, 10, 13, 17, 25, 27, 34], "drop": [0, 9, 28], "review": [0, 2, 3, 7, 9, 30, 34], "condens": 0, "document": [0, 10, 11, 31, 32, 34], "more": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 20, 22, 25, 27, 28, 29, 30, 31, 32, 33, 34], "inform": [0, 2, 9, 10, 22, 28, 34], "column": [0, 10, 12, 13, 18, 20, 30, 34], "e": [0, 2, 3, 9, 10, 22, 28, 31, 32], "g": [0, 3, 9, 10, 12, 31, 32], "an": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 13, 15, 17, 18, 20, 21, 22, 27, 28, 29, 30, 34], "educ": [0, 17, 20], "46": [0, 29], "correspond": [0, 9, 11, 22, 26, 28, 34], "phd": 0, "variabl": [0, 5, 7, 8, 15, 18, 20, 27, 28, 29, 30], "name": [0, 9, 13, 17, 25, 27, 29, 31, 32, 34], "tucaseid": 0, "identifi": [0, 2, 17, 22], "prernwa": 0, "partner": [0, 28, 30], "earn": [0, 7, 8], "peeduca": 0, "prtage": 0, "ag": [0, 9, 17, 20, 29, 30, 34], "pesex": 0, "sex": [0, 3, 17, 20, 29, 30], "ptdtrace": 0, "race": [0, 3, 29], "submit": 0, "your": [0, 1, 2, 4, 5, 6, 9, 12, 13, 15, 18, 20, 22, 25, 27, 28, 30, 34], "work": [0, 1, 3, 9, 10, 21, 22, 25, 27, 28, 29, 32], "two": [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 20, 22, 28, 30, 33, 34], "file": 0, "1": [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 14, 18, 20, 22, 25, 26, 27, 28, 29, 31, 32, 34], "main": [0, 2, 24, 28, 33, 34], "pdf": 0, "doc": 0, "answer": [0, 2, 4, 9, 18, 22, 29, 30, 34], "question": [0, 2, 5, 6, 10, 15, 22, 27, 30], "provid": [0, 2, 6, 9, 15, 28, 30, 34], "statist": [0, 2, 3, 4, 6, 9, 10, 15, 18, 20, 27, 29, 31, 32, 33, 34], "reason": [0, 3, 9, 10, 18, 20, 22], "actual": [0, 1, 2, 5, 6, 7, 9, 10, 12, 17, 22, 25, 27, 28, 34], "calcul": [0, 4, 5, 6, 10, 12, 13, 18, 26, 27, 28, 29, 30, 31, 32, 33, 34], "2": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 14, 18, 20, 22, 25, 27, 28, 30, 31, 32, 34], "supplementari": 0, "either": [0, 2, 4, 7, 8, 15, 17, 18, 22, 30, 34], "xlsx": 0, "code": [0, 1, 25, 26, 27, 31, 32, 34], "thi": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 21, 22, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34], "proof": 0, "replic": [0, 3, 9], "creat": [0, 7, 9, 11, 25, 30, 33, 34], "scatter": [0, 20, 28, 30, 34], "diagram": [0, 7, 22, 28], "relat": [0, 7, 15, 17, 28, 30, 31, 32], "choos": [0, 1, 2, 7, 8, 9, 10, 20, 22, 34], "among": [0, 9, 20, 22, 28, 34], "quantit": [0, 7, 8, 10, 18, 28, 30, 34], "onli": [0, 2, 5, 6, 7, 9, 10, 13, 15, 17, 20, 22, 27, 28, 30, 34], "us": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 33, 34], "follow": [0, 2, 4, 5, 6, 7, 8, 9, 10, 15, 18, 20, 22, 25, 30, 34], "find": [0, 1, 2, 3, 7, 8, 9, 10, 17, 20, 21, 22, 26, 29, 30, 31, 32, 34], "regress": [0, 13, 15, 34], "line": [0, 4, 7, 8, 20, 22, 25, 26, 27, 31, 32, 33, 34], "equat": [0, 5, 6, 10, 12, 25, 28], "let": [0, 7, 8, 20, 22, 27, 28, 30, 33], "independ": [0, 2, 5, 6, 7, 8, 20, 28, 30], "3": [0, 1, 2, 4, 5, 6, 7, 8, 9, 12, 14, 18, 20, 22, 26, 28, 29, 30, 31, 32, 33, 34], "interpret": [0, 10, 15, 28, 30, 34], "context": [0, 9, 10, 13, 15, 30], "what": [0, 2, 3, 5, 6, 7, 9, 10, 15, 17, 18, 20, 22, 25, 26, 28, 30, 31, 32, 34], "do": [0, 1, 2, 4, 5, 6, 9, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32], "coeffici": [0, 12, 28, 30, 33, 34], "mean": [0, 2, 5, 6, 7, 9, 10, 12, 13, 18, 20, 22, 27, 28, 30, 34], "4": [0, 3, 4, 7, 9, 12, 14, 18, 20, 22, 25, 27, 28, 29, 33, 34], "discuss": [0, 9, 20, 22, 28, 34], "linear": [0, 7, 8, 15, 30, 33], "appropri": [0, 2, 7, 8, 27, 28, 30], "root": [0, 5, 6, 12, 28], "squar": [0, 5, 6, 12, 28], "error": [0, 4, 7, 12, 13, 21, 27], "assum": [0, 2, 7, 17, 18, 22, 30], "residu": [0, 33], "normal": [0, 1, 4, 7, 15, 25, 26], "curv": [0, 5, 6, 7, 26, 34], "6": [0, 2, 5, 6, 7, 17, 19, 20, 22, 24, 28, 29, 34], "plot": [0, 20, 30, 33, 34], "detect": [0, 30], "ani": [0, 2, 4, 6, 7, 9, 10, 17, 18, 20, 22, 27, 28, 30, 34], "non": [0, 2, 7, 9, 20, 29, 34], "pattern": [0, 7, 18, 28], "heteroscedast": [0, 28], "7": [0, 2, 18, 28, 29, 34], "empir": [0, 9], "probabl": [0, 3, 5, 6, 10, 15, 34], "abov": [0, 2, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 25, 26, 28, 30, 31, 32, 34], "averag": [0, 2, 5, 6, 7, 9, 10, 12, 13, 18, 20, 28, 29, 30, 33], "condit": [0, 2, 5, 6, 17, 30, 34], "posit": [0, 2, 5, 6, 7, 8, 9, 18, 20, 28, 30, 34], "doe": [0, 2, 3, 4, 7, 9, 10, 17, 18, 20, 22, 25, 27, 28, 30, 33, 34], "support": [0, 4, 9, 34], "previou": [0, 2, 9, 17, 22, 30, 34], "8": [0, 1, 2, 7, 8, 22, 26, 28, 29, 33, 34], "label": [0, 2, 4, 22, 30], "parter": 0, "within": [0, 4, 5, 6, 18, 20, 26, 28], "somewhat": 0, "arbitrari": [0, 34], "reorgan": 0, "wai": [0, 1, 2, 4, 7, 8, 9, 10, 17, 20, 25, 26, 27, 30, 34], "doesn": [0, 2, 4, 5, 6, 7, 9, 20, 22, 25, 27, 30, 33, 34], "t": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34], "split": [0, 4, 18, 34], "simpli": [0, 18, 22, 25, 26, 30], "relabel": [0, 30], "everi": [0, 1, 2, 9, 13, 17, 20, 29, 31, 32], "vice": [0, 22], "versa": 0, "some": [0, 1, 2, 4, 5, 6, 7, 9, 10, 17, 18, 20, 22, 25, 27, 28, 29, 32], "x": [0, 1, 4, 7, 8, 12, 13, 18, 20, 23, 25, 28, 30, 33], "y": [0, 7, 8, 12, 20, 25, 28, 30, 33, 34], "pair": [0, 7, 8, 9, 28, 30], "stai": [0, 2], "same": [0, 2, 5, 6, 7, 9, 13, 17, 18, 20, 22, 25, 26, 28, 30, 34], "other": [0, 2, 4, 7, 8, 9, 10, 12, 13, 17, 22, 26, 28, 29, 30, 31, 32, 34], "flip": [0, 5, 6, 7, 22], "how": [0, 2, 4, 5, 6, 7, 9, 10, 15, 17, 18, 20, 22, 28, 29, 30, 34], "did": [0, 9, 20, 27], "new": [0, 2, 3, 7, 9, 31, 32], "comment": [0, 4, 9, 15, 20], "chang": [0, 1, 2, 3, 4, 7, 8, 9, 12, 18, 20, 22, 27, 30, 34], "popular": [1, 10, 27, 30], "industri": 1, "It": [1, 2, 4, 5, 6, 7, 9, 17, 20, 22, 25, 26, 28, 30, 33, 34], "s": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15, 17, 22, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34], "academia": 1, "i": [1, 2, 3, 4, 5, 6, 7, 9, 15, 22, 27, 28, 31, 32, 34], "ll": [1, 2, 4, 5, 6, 9, 15, 20, 22, 26, 29, 30, 31, 32, 34], "occasion": [1, 27], "myself": 1, "leav": [1, 2, 24, 30], "python": [1, 13, 25, 26, 31, 32, 33], "someth": [1, 2, 4, 9, 10, 17, 20, 22, 25, 27, 28, 33, 34], "advanc": [1, 20, 30, 31, 32], "notebook": [1, 27, 33], "done": [1, 9, 10, 12, 13, 17, 22, 25, 30], "first": [1, 2, 4, 5, 6, 7, 8, 9, 10, 17, 20, 22, 25, 27, 28, 30, 33, 34], "cell": [1, 12, 18, 27, 34], "below": [1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 17, 18, 20, 22, 25, 26, 28, 30, 32, 34], "ad": [1, 7], "command": [1, 27, 33], "open": [1, 2, 27, 34], "googl": [1, 4, 5, 6, 10, 11, 13, 27, 30, 31, 32, 33, 34], "colab": [1, 27, 31, 32, 33, 34], "runtim": 1, "type": [1, 2, 10, 13, 15, 20, 25, 27, 29, 30], "go": [1, 2, 5, 6, 7, 8, 9, 10, 15, 20, 27, 30, 34], "menu": 1, "top": [1, 7, 30, 34], "page": [1, 3, 17, 18, 27, 34], "select": [1, 2, 9, 13, 15, 17, 29], "under": [1, 5, 6, 26, 30], "click": 1, "save": 1, "list": [1, 4, 5, 6, 25, 28, 29, 30, 31, 32], "typic": [1, 4, 5, 6, 17, 25, 26, 28, 33, 34], "oper": [1, 25], "descript": [1, 9, 15, 25, 28, 34], "addit": [1, 9, 17, 25, 28], "subtract": [1, 25, 34], "multipl": [1, 2, 15, 22, 25], "float": [1, 25], "point": [1, 4, 7, 8, 11, 13, 17, 18, 20, 22, 25, 27, 28, 30, 33, 34], "divis": [1, 25], "exponenti": [1, 25], "we": [1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 22, 24, 25, 26, 27, 28, 29, 30, 33, 34], "can": [1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 17, 18, 20, 21, 22, 25, 26, 27, 28, 29, 30, 32, 34], "parenthesi": [1, 25], "readabl": [1, 25, 27], "order": [1, 2, 4, 5, 6, 22, 25, 27, 28, 30, 33, 34], "usual": [1, 9, 17, 25, 27, 29, 34], "pip": [1, 28, 31, 32, 33], "instal": [1, 26, 28, 31, 32, 33], "rpy2": 1, "load_ext": 1, "ipython": [1, 28], "0": [1, 2, 4, 7, 8, 12, 13, 14, 18, 20, 22, 25, 26, 27, 28, 29, 30, 32, 33, 34], "assign": [1, 9, 17, 20, 25, 30], "help": [1, 2, 4, 9, 10, 12, 15, 20, 21, 22, 25, 30, 34], "care": [1, 9, 20, 25, 27, 28], "about": [1, 2, 3, 4, 5, 6, 7, 9, 10, 18, 20, 22, 24, 25, 27, 28, 30, 34], "colleagu": [1, 25, 29, 34], "futur": [1, 25], "self": [1, 3, 9, 15, 25, 34], "should": [1, 2, 5, 6, 7, 8, 9, 12, 13, 15, 20, 22, 25, 28, 30, 34], "add": [1, 15, 17, 22, 25, 28, 33], "clariti": [1, 25], "intent": [1, 7, 25], "A": [1, 2, 3, 5, 6, 7, 8, 9, 10, 12, 15, 17, 18, 20, 24, 25, 26, 27, 28, 29, 30, 34], "piec": [1, 25, 34], "isn": [1, 2, 9, 10, 17, 20, 25, 27, 31, 32], "execut": [1, 25, 27], "left": [1, 2, 7, 10, 12, 13, 18, 25, 26, 28, 34], "reader": [1, 22, 25, 34], "person": [1, 2, 17, 20, 22, 25, 27, 28, 29, 34], "who": [1, 2, 7, 9, 10, 13, 17, 20, 25, 27, 28, 29, 30, 34], "inherit": [1, 25], "modifi": [1, 22, 25], "everyth": [1, 4, 9, 20, 22, 25, 27], "after": [1, 2, 5, 6, 10, 17, 20, 22, 25, 28, 34], "ignor": [1, 4, 17, 22, 25, 32], "1000": [1, 5, 6, 20, 30], "becaus": [1, 2, 4, 5, 6, 7, 9, 13, 17, 18, 20, 22, 25, 26, 27, 28, 30, 33, 34], "out": [1, 2, 3, 5, 6, 7, 9, 18, 20, 22, 25, 27, 28, 30], "9": [1, 2, 6, 7, 8, 18, 22, 28, 29, 30, 33, 34], "10": [1, 2, 3, 5, 6, 10, 18, 20, 25, 28, 33, 34], "90": [1, 2, 3, 20, 22, 25, 30], "tij12": [2, 3, 24], "chapter": [2, 4, 5, 6, 7, 8, 9, 10, 15, 17, 18, 19, 20, 22, 24, 28, 29, 34], "str10": [2, 3, 24], "In": [2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17, 18, 20, 22, 24, 25, 26, 27, 28, 29, 30, 34], "section": [2, 6, 9, 15, 17, 20, 30], "textbook": [2, 10, 15, 22, 24, 28], "learn": [2, 7, 8, 9, 13, 15, 17, 24, 30, 34], "foundat": [2, 6], "further": [2, 9, 26], "coursework": 2, "bayesian": 2, "just": [2, 4, 5, 6, 7, 8, 10, 15, 17, 18, 22, 26, 28, 29, 30, 34], "interact": [2, 28], "nerdi": 2, "peopl": [2, 5, 6, 7, 9, 17, 18, 20, 22, 29, 30, 34], "talk": [2, 4, 22], "updat": [2, 34], "respons": [2, 7, 34], "solv": [2, 9, 10, 22, 27, 28, 30], "mathbb": [2, 5, 6, 22, 30], "p": [2, 3, 5, 6, 12, 22, 30], "mid": [2, 22, 30], "b": [2, 3, 4, 9, 10, 12, 13, 18, 20, 25, 27, 28, 30], "given": [2, 7, 8, 9, 22, 27, 28, 30, 34], "involv": [2, 9, 17, 22, 27, 34], "observ": [2, 3, 4, 5, 6, 7, 9, 12, 15, 17, 18, 22, 28, 34], "uncondit": [2, 22, 30], "prior": [2, 9, 17, 22], "belief": [2, 9, 22], "posterior": 2, "kind": [2, 4, 5, 6, 9, 10, 17, 20, 22, 25, 27, 28, 29, 30, 34], "environ": 2, "where": [2, 4, 5, 6, 7, 9, 12, 13, 17, 18, 20, 22, 25, 27, 30, 34], "gather": 2, "For": [2, 4, 5, 6, 7, 8, 9, 12, 13, 17, 20, 22, 27, 28, 29, 30, 34], "medic": [2, 9, 34], "doctor": [2, 9], "assess": 2, "diseas": [2, 9, 30], "particular": [2, 4, 5, 6, 7, 28], "test": [2, 3, 7, 8, 9, 12, 15, 17, 23, 24, 30, 34], "result": [2, 5, 6, 7, 9, 17, 20, 22, 27, 29, 30], "noth": [2, 7, 9, 10, 20, 22, 30], "requir": [2, 5, 6, 9, 10, 13, 17, 27, 29, 34], "event": [2, 18, 22, 30], "organ": [2, 3, 10, 12, 15, 29, 34], "regard": [2, 10, 20, 29], "almost": 2, "anyth": [2, 7, 9, 10, 27, 34], "gener": [2, 3, 5, 6, 10, 17, 20, 22, 27, 28, 29, 30, 34], "rule": [2, 4, 5, 6, 7, 9, 20, 27, 34], "And": [2, 9, 18, 22, 28, 34], "here": [2, 9, 10, 15, 22, 27, 28, 30, 31, 32, 34], "concret": [2, 20], "english": 2, "word": [2, 4, 28, 30, 34], "latin": 2, "french": 2, "origin": [2, 4, 9, 22, 34], "letter": [2, 13], "q": 2, "alwai": [2, 4, 12, 22, 28, 30, 34], "u": [2, 9, 18], "know": [2, 5, 6, 7, 9, 17, 20, 22, 26, 28, 29, 30, 34], "start": [2, 5, 6, 9, 15, 17, 22, 25, 27, 31, 32], "second": [2, 5, 6, 10, 12, 20, 22, 25, 27, 28, 30], "being": [2, 7, 8, 9, 17, 20, 22, 25, 27, 30], "100": [2, 5, 6, 9, 10, 14, 17, 18, 20, 22, 25, 28, 30, 34], "howev": [2, 5, 6, 7, 8, 18, 20, 28, 29], "veri": [2, 3, 5, 6, 17, 22, 34], "like": [2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 17, 18, 20, 22, 25, 26, 28, 30, 31, 32, 33, 34], "If": [2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32, 34], "drawn": [2, 4, 11, 22, 30], "randomli": [2, 9, 17, 30], "would": [2, 4, 5, 6, 7, 8, 9, 10, 13, 17, 20, 22, 26, 28, 30, 34], "26": [2, 7], "also": [2, 4, 7, 8, 9, 11, 18, 20, 21, 22, 25, 27, 28, 30, 34], "simplic": [2, 4], "especi": [2, 7, 8, 9, 13, 22, 27], "when": [2, 4, 5, 6, 7, 8, 9, 13, 17, 18, 20, 22, 25, 27, 28, 29, 34], "depend": [2, 4, 5, 6, 7, 8, 22, 28, 30, 34], "see": [6, 7, 9, 17, 20, 26, 28, 30, 34], "abe12": [3, 10], "robert": 3, "abelson": 3, "principl": [3, 9, 10, 34], "argument": [3, 10, 17], "psycholog": 3, "press": 3, "2012": 3, "ap14": [3, 9], "joshua": 3, "d": [2, 3, 4, 12, 18, 20, 22, 30, 34], "angrist": 3, "j": 3, "\u00f6": 3, "rn": 3, "steffen": 3, "pischk": 3, "master": [3, 27], "metric": 3, "path": [2, 3], "caus": [3, 7, 8, 9, 17, 20, 27, 29], "effect": [3, 7, 8, 9, 17, 20, 28, 30, 34], "princeton": 3, "univers": [3, 9, 17, 28], "2014": 3, "url": [3, 28, 33], "http": [3, 18, 28, 33], "clio": 3, "columbia": [3, 9, 22, 34], "edu": 3, "catalog": [3, 10, 15, 34], "11221502": 3, "bhoconnell75": [3, 20], "bickel": 3, "hammel": 3, "w": 3, "o": [3, 20], "connel": 3, "bia": [3, 9, 17, 20, 29], "graduat": [3, 9, 20], "admiss": [3, 18, 20, 22, 30], "berkelei": [3, 20], "scienc": [3, 9, 20, 34], "187": 3, "4175": 3, "398": 3, "404": 3, "1975": 3, "www": 3, "jstor": 3, "org": 3, "stabl": 3, "1739581": 3, "visit": [3, 9], "2024": 3, "01": [2, 3, 30], "03": 3, "blm22": [3, 17], "luca": [3, 7], "braghieri": 3, "ro": 3, "ee": 3, "levi": 3, "alexei": 3, "makarin": 3, "social": [3, 4, 9, 17, 22], "media": [3, 17], "mental": [3, 7, 17], "health": [3, 7, 9, 10, 17, 30], "american": [3, 18, 28, 29], "econom": 3, "112": 3, "11": [3, 5, 6, 22, 27, 28, 29, 30, 34], "3660": 3, "3693": 3, "2022": 3, "cc65": [3, 20], "william": [3, 20], "cochran": [3, 20], "paul": 3, "chamber": [3, 34], "plan": [3, 9], "studi": [2, 3, 7, 9, 10, 15, 17, 28, 29, 31, 32, 34], "human": [3, 34], "journal": [3, 7, 20], "royal": 3, "societi": [3, 7, 8], "seri": [3, 33], "128": 3, "234": 3, "266": 3, "1965": [3, 20], "2344179": 3, "dvvb19": [3, 10, 34], "richard": [3, 9], "de": 3, "veaux": 3, "f": [2, 3, 12, 28, 33], "velleman": 3, "bock": 3, "stat": [3, 9, 26, 27, 33], "model": [3, 5, 6, 33, 34], "5th": 3, "edit": 3, "pearson": [3, 13, 28, 33], "addison": 3, "weslei": 3, "boston": 3, "2019": [3, 18], "dc18": [3, 9], "angu": 3, "deaton": 3, "nanci": 3, "cartwright": 3, "understand": [3, 9, 10, 15, 17, 20, 22, 27], "misunderstand": 3, "random": [3, 4, 5, 6, 7, 9, 17, 18, 20, 28, 30, 34], "control": [3, 7, 9, 17, 20, 30], "trial": [3, 5, 6, 7, 9, 13, 22], "medicin": [3, 20], "210": 3, "21": [3, 33], "2018": 3, "fr99": [3, 9], "r": [3, 4, 7, 13, 27, 28, 30], "feynman": [3, 9], "robbin": 3, "pleasur": 3, "Of": [2, 3, 9, 29, 30], "thing": [3, 7, 9, 10, 18, 20, 22, 25, 26, 28, 33, 34], "best": [2, 3, 5, 6, 9, 22, 26, 28], "short": [3, 9, 17, 26, 34], "helix": 3, "book": [3, 15, 31, 32], "basic": [3, 9, 15, 20, 33], "1999": 3, "isbn": 3, "9780738201085": 3, "2450053": 3, "fpp07": [3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 18, 19, 20, 22, 28, 29, 31, 32, 34], "david": 3, "freedman": 3, "pisani": 3, "roger": 3, "purv": 3, "ww": 3, "norton": 3, "compani": [3, 17, 27, 34], "2007": 3, "6285515": 3, "fre91": [3, 17], "shoe": 3, "leather": 3, "sociolog": 3, "methodolog": 3, "291": 3, "313": 3, "1991": 3, "gal06": [3, 9], "galenson": 3, "old": [2, 3, 20, 22, 29], "young": [3, 20], "genius": 3, "life": [3, 9], "cycl": [3, 7, 8, 9], "artist": [3, 9, 10, 30, 34], "creativ": [3, 9, 27], "2006": 3, "9780691121093": 3, "14140122": 3, "gel18": [3, 9], "andrew": 3, "gelman": 3, "benefit": [3, 9, 20, 34], "limit": [3, 5, 6, 7, 17, 20, 34], "commentari": 3, "1982": 3, "48": [3, 22], "49": [3, 34], "gv21": [3, 34], "aki": 3, "vehtari": 3, "most": [3, 9, 10, 17, 28, 30, 34], "import": [3, 14, 15, 25, 26, 27, 30, 31, 32], "idea": [3, 9, 15, 27, 28, 34], "past": [3, 7, 12, 20, 27, 34], "50": [2, 3, 5, 6, 14, 18, 20, 22, 30, 33, 34], "year": [2, 3, 7, 9, 20, 22, 28, 34], "associ": [3, 7, 8, 10, 20], "116": 3, "536": 3, "2087": 3, "2097": 3, "2021": [3, 34], "han08": [3, 10], "hand": [3, 20, 22], "introduct": [3, 17], "oxford": 3, "usa": 3, "2008": 3, "14180088": 3, "her09": [3, 34], "cedric": 3, "her": [3, 4, 9, 22, 34], "divers": [3, 34], "pai": [3, 9, 10, 13, 22, 30], "gender": [3, 17, 34], "busi": [3, 7, 9, 34], "case": [3, 4, 9, 10, 17, 20, 22, 25, 27, 28, 30, 34], "74": [3, 29], "208": 3, "224": 3, "2009": 3, "her17": [3, 34], "Is": [2, 3, 4, 7, 17, 18, 20, 22, 27], "still": [2, 3, 7, 8, 9, 15, 17, 20, 25, 30, 34], "good": [2, 3, 9, 10, 15, 17, 22, 25, 27, 28, 29, 30, 31, 32, 34], "82": [3, 7, 30], "868": 3, "877": 3, "2017": [3, 34], "kkm01": [3, 34], "arn": 3, "l": [2, 3], "kalleberg": 3, "knoke": 3, "peter": [3, 27], "v": 3, "marsden": 3, "nation": [3, 7, 34], "NOS": 3, "1996": [3, 34], "1997": [3, 34], "inter": 3, "consortium": 3, "polit": [3, 29], "research": [3, 7, 9, 17, 20, 29, 30, 34], "ann": 3, "arbor": 3, "mi": 3, "2001": 3, "kna15": [3, 34], "cole": 3, "nussbaum": 3, "knaflic": 3, "storytel": [3, 9], "visual": [3, 4, 18], "guid": 3, "profession": [3, 7, 27, 28], "john": [3, 17, 34], "wilei": 3, "son": [3, 12, 28, 33], "2015": 3, "ktx20": [3, 9], "ron": 3, "kohavi": 3, "dian": 3, "tang": 3, "ya": 3, "xu": 3, "trustworthi": [3, 28], "onlin": [3, 26], "experi": [3, 7, 8, 15, 20, 22, 34], "practic": [3, 9, 20, 27, 29], "cambridg": 3, "2020": [3, 7], "mb72": [3, 20], "mai": [3, 9, 27], "karl": 3, "bemesderf": 3, "inquiri": 3, "duxburi": 3, "1972": 3, "mjel21": [3, 7, 8], "elli": 3, "monk": 3, "jr": 3, "michael": [3, 7, 9], "h": [2, 3, 5, 6, 22, 30], "esposito": 3, "hedwig": 3, "lee": 3, "behold": 3, "inequ": [3, 34], "return": [3, 4, 5, 6, 7, 8, 27], "physic": [3, 7, 8, 17], "attract": [3, 7, 8], "unit": [3, 4, 6, 7, 10, 28, 34], "state": [3, 5, 6, 7, 9, 10, 17, 20, 34], "127": 3, "194": 3, "241": 3, "doi": 3, "1086": 3, "715141": 3, "ros17": [3, 17], "rosenbaum": 3, "causal": [3, 7, 8, 9, 20, 22, 30], "infer": [3, 6, 20, 30, 33], "harvard": [3, 7, 17], "15176619": 3, "sch21": [3, 34], "jonathan": 3, "schwabish": 3, "better": [2, 3, 4, 9, 10, 17, 20, 22, 25, 26, 27, 28, 34], "scholar": 3, "wonk": 3, "15473733": 3, "smg": [3, 34], "12": [2, 3, 9, 27, 28, 29, 33, 34], "lisa": [3, 9], "shu": 3, "nina": 3, "mazar": 3, "francesca": 3, "gino": 3, "dan": 3, "ari": 3, "max": [3, 33], "bazerman": 3, "sign": [2, 3, 4, 7, 13, 22, 25, 28, 34], "begin": [3, 6, 9, 20, 22, 30, 34], "make": [2, 3, 4, 5, 6, 9, 10, 13, 17, 20, 25, 27, 28, 30, 31, 32, 34], "ethic": [3, 20, 34], "salient": [3, 34], "decreas": [3, 4, 7, 34], "dishonest": [3, 34], "report": [3, 9, 10, 20, 29, 30, 34], "comparison": [3, 9, 17, 20, 30, 34], "end": [3, 9, 25, 30, 34], "proceed": 3, "academi": 3, "109": 3, "38": 3, "15197": 3, "15200": 3, "sns21": [3, 34], "uri": 3, "simonsohn": 3, "leif": 3, "nelson": 3, "joe": 3, "simmon": 3, "98": [3, 30], "evid": [3, 10, 17, 34], "fraud": [3, 22], "influenti": [3, 34], "field": [3, 15, 29, 31, 32, 34], "dishonesti": 3, "colada": [3, 22], "datacolada": 3, "sno49": [3, 17], "snow": [3, 17], "On": [3, 20, 28], "mode": 3, "commun": [3, 10, 34], "cholera": [3, 17], "churchil": 3, "1849": 3, "ste23": [3, 9], "megan": 3, "stevenson": [3, 9], "structur": [2, 3, 28, 30, 34], "world": [2, 3, 10, 22, 25, 34], "law": [3, 5, 6, 9, 17], "2023": [3, 20], "sbl17": [3, 34], "dragana": 3, "stojmenovska": 3, "thij": 3, "bol": 3, "thoma": 3, "leopold": 3, "857": 3, "867": 3, "steven": 3, "strogatz": 3, "chanc": [3, 10, 15, 22, 30], "york": [3, 9], "time": [2, 3, 5, 6, 7, 10, 12, 15, 18, 20, 22, 27, 28, 29, 30], "2010": 3, "archiv": 3, "nytim": 3, "com": [3, 18, 28, 33], "opinion": [3, 9], "blog": 3, "04": 3, "25": [2, 3, 4, 18, 20, 22, 30, 34], "tijm": 3, "9781107658561": 3, "id": 34, "fjprjj65hwic": [], "tk83": [3, 22], "amo": 3, "tverski": 3, "daniel": 3, "kahneman": 3, "extension": 3, "versu": [3, 9], "intuit": 3, "conjunct": 3, "fallaci": 3, "judgment": [3, 10], "293": 3, "1983": 3, "yul99": [3, 7, 8], "udni": [3, 7, 8], "yule": [3, 7, 8], "investig": [3, 7, 8, 9, 22, 34], "pauper": [3, 7, 8], "england": [3, 7, 8], "chiefli": 3, "dure": 3, "last": [3, 9, 20, 30, 34], "intercens": 3, "decad": 3, "part": [3, 10, 22, 30, 34], "62": [3, 29, 33], "249": 3, "295": 3, "1899": 3, "previous": [4, 7], "summar": [2, 4, 28], "histogram": [4, 5, 6, 15, 18, 30, 32], "represent": [4, 22], "sometim": [4, 7, 9, 22, 26, 28, 34], "lack": [2, 4, 9, 20, 30, 34], "precis": [4, 5, 6, 27, 34], "so": [4, 7, 9, 12, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32, 34], "now": [2, 4, 7, 18, 27, 28, 30, 33, 34], "distribut": [4, 5, 6, 7, 15, 22, 28], "number": [4, 5, 6, 9, 10, 13, 20, 22, 25, 26, 27, 29, 30, 31, 32, 34], "its": [2, 4, 5, 6, 7, 9, 10, 13, 17, 22], "altern": [4, 7, 9, 17, 22], "includ": [2, 4, 9, 10, 11, 15, 17, 22, 26, 28, 30, 31, 32, 34], "median": [4, 13], "interquartil": 4, "rang": [4, 5, 6, 28], "respect": [4, 22, 28], "n": [4, 5, 6, 7, 22, 28, 30], "sum": [2, 4, 13, 22, 30, 34], "divid": [4, 17, 20, 22], "notat": [4, 15, 22, 28, 30], "bar": [4, 34], "mu": 4, "prefer": [4, 17, 22, 25, 27, 30], "summat": 4, "frac": [2, 4, 5, 6, 7, 22, 28, 30], "sum_": [4, 7, 28], "x_i": [4, 7], "middl": 4, "even": [4, 5, 6, 9, 20, 22, 25, 29, 30], "less": [2, 4, 5, 6, 7, 9, 17, 22, 27, 28, 29, 30], "affect": [2, 4, 9, 34], "extrem": [4, 7, 18, 28, 34], "have": [2, 4, 5, 6, 7, 8, 9, 10, 11, 13, 17, 18, 20, 22, 26, 27, 28, 29, 30, 31, 32, 33, 34], "both": [4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 30, 34], "similar": [2, 4, 5, 6, 7, 9, 20, 22, 28, 30, 34], "symmetr": [4, 18, 34], "extend": [4, 18], "94": 4, "increas": [4, 5, 6, 7, 8, 9, 22, 28, 30, 34], "5": [2, 4, 5, 6, 10, 13, 18, 20, 22, 28, 29, 33, 34], "repres": [4, 5, 6, 7, 22, 29, 30, 34], "might": [4, 5, 6, 7, 8, 9, 10, 13, 17, 20, 22, 25, 27, 28, 29, 30, 31, 32, 34], "often": [2, 4, 7, 9, 13, 20, 22, 27, 28, 29, 34], "avoid": [4, 9, 20, 34], "influenc": [4, 7, 8, 9], "fig": [2, 4, 7, 20, 22, 28, 34], "15": [4, 18, 22, 29, 34], "show": [2, 4, 5, 6, 7, 8, 9, 11, 14, 18, 20, 22, 28, 33, 34], "skew": [4, 18, 34], "vertic": [4, 28, 34], "which": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 26, 28, 29, 30, 31, 32, 34], "mark": [4, 7, 15, 30], "heavier": 4, "orang": [2, 4, 7, 8, 9], "white": [4, 9, 34], "while": [4, 25, 28, 29], "equal": [2, 4, 10, 11, 13, 20, 22, 25, 28, 30, 34], "area": [4, 6, 11, 20, 22, 26, 34], "side": [2, 4, 9, 17, 22], "balanc": [4, 5, 6], "imagin": [2, 4, 9, 17, 20, 22, 28, 29], "tip": [4, 34], "toward": [4, 22, 34], "long": [4, 5, 6, 9, 13, 22, 34], "tail": [4, 5, 6, 13, 18, 22, 34], "leverag": [4, 13, 17], "exert": 4, "size": [4, 5, 6, 7, 10, 11, 17, 28, 30, 34], "aka": 4, "entri": 4, "sqrt": [4, 5, 6, 7, 22, 28], "m": [4, 22, 28], "absolut": [4, 5, 6, 11, 12, 13], "fit": [4, 28, 30, 33, 34], "algebra": [4, 15, 28], "statistician": [4, 7, 8, 10, 28, 34], "get": [4, 5, 6, 7, 8, 9, 13, 15, 17, 20, 22, 25, 27, 29, 33], "notion": [4, 10], "take": [2, 4, 6, 7, 8, 9, 10, 15, 17, 20, 22, 27, 30], "measur": [4, 7, 8, 9, 10, 20, 28, 30, 34], "refer": [4, 10, 12, 22, 25, 30, 34], "singl": [2, 4, 6, 9, 13, 17, 18, 22, 28, 29, 30, 34], "rm": [4, 28], "tabl": [2, 4, 7, 8, 20, 26, 28, 30, 34], "complic": [4, 9, 25, 27, 31, 32], "our": [4, 5, 6, 9, 10, 22, 26, 27, 28, 30], "technic": [4, 34], "oppos": 4, "These": [4, 9, 10, 12, 15, 18, 22, 30, 34], "slightli": 4, "instead": [4, 5, 6, 7, 9, 11, 15, 20, 22, 27, 28, 29, 34], "appreci": [4, 7, 28], "sheet": [4, 5, 6, 11, 13, 27, 30, 31, 32, 33, 34], "stdevp": [4, 13, 31, 32], "cover": [4, 9, 18, 28, 34], "subset": [4, 13, 20, 22, 29], "larger": [4, 5, 6, 22, 29, 34], "later": [4, 9, 13, 17, 18, 27, 30, 33], "cours": [4, 9, 15, 17, 18, 20, 27, 29, 31, 32, 33], "entir": [4, 9, 10, 13, 15, 28], "think": [2, 4, 9, 10, 18, 20, 22], "term": [2, 4, 5, 6, 28, 29, 30, 34], "predict": [4, 7, 8, 9, 28, 33], "algorithm": 4, "guess": [4, 5, 6, 22, 27, 28], "expect": [2, 4, 5, 6, 7, 8, 9, 10, 13, 18, 20, 30, 34], "keep": [4, 33], "vagu": 4, "68": [4, 5, 6, 28], "95": [4, 5, 6, 28], "thumb": [4, 34], "explain": [2, 4, 9, 20, 22, 27, 28, 30, 34], "yardstick": 4, "roughli": [4, 27], "one": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 25, 27, 28, 29, 30, 34], "true": [2, 4, 5, 6, 9, 12, 20], "between": [4, 5, 6, 7, 8, 9, 11, 17, 18, 20, 22, 28, 29, 34], "fals": [2, 4, 9, 20, 30, 33], "justifi": [4, 5, 6, 7, 8, 18], "suppos": [2, 4, 5, 6, 9, 12, 17, 20, 22, 26, 28, 29, 30, 34], "taylor": [4, 34], "swift": [4, 34], "launch": 4, "own": [4, 9, 17, 20, 27, 30, 34], "network": 4, "member": [4, 9, 20, 22], "nobodi": [4, 22, 34], "els": [4, 10, 22, 25, 27], "As": [4, 9, 17, 18, 20, 22], "courtesi": 4, "everyon": [4, 10, 20, 28], "back": [2, 4, 13, 22, 27, 28], "illustr": [4, 6, 30], "possibl": [4, 9, 13, 17, 18, 20, 22, 25, 28, 30, 34], "three": [2, 4, 7, 8, 9, 12, 13, 17, 22, 29, 30, 33, 34], "seven": 4, "twelv": 4, "yellow": 4, "circl": [4, 22], "greater": [4, 7, 11, 18, 22, 28, 30], "than": [2, 4, 5, 6, 7, 9, 10, 17, 18, 20, 22, 26, 27, 28, 29, 30, 33, 34], "c": [2, 4, 9, 12, 13, 18, 22, 30], "ever": 4, "exce": [4, 22], "ha": [2, 4, 5, 6, 7, 10, 17, 18, 20, 22, 28, 29, 30, 34], "13": [4, 20, 22, 30, 34], "hold": [4, 18, 25], "1989": 4, "formula": [4, 5, 6, 12, 28, 30, 33], "euclidean": 4, "distanc": [4, 28], "coordin": [4, 13, 22], "system": 4, "without": [2, 4, 7, 8, 9, 10, 12, 13, 17, 22, 30, 34], "relationship": [7, 8, 9, 20, 22, 28, 30], "explor": [7, 8, 17, 34], "notic": [7, 8, 28], "trend": [7, 8, 20, 28, 34], "shape": [6, 7, 8, 18, 28, 30, 34], "inch": [7, 8], "65": [7, 8, 29, 33], "59": [7, 8, 33, 34], "63": [7, 8, 30, 33], "slope": [7, 8, 12, 30, 33], "upward": [7, 8], "downward": [7, 8], "neg": [2, 5, 6, 7, 8, 9, 17, 18, 20, 28, 34], "strong": [7, 8], "indic": [2, 7, 8, 17, 20, 22, 30], "hi": [2, 7, 8, 9, 12, 17, 20], "shown": [7, 8, 13, 18, 30], "axi": [7, 8, 18, 28, 30, 34], "thought": [2, 5, 6, 7, 8, 9], "languag": [7, 8, 13, 20, 22, 27], "suggest": [7, 8, 17, 18, 22, 33, 34], "direct": [7, 8, 15, 33], "hypothes": [7, 8, 34], "class": [7, 8, 11, 13, 17, 30, 34], "cautiou": [7, 8], "claim": [7, 8, 17, 20], "ahead": [7, 8, 9], "too": [2, 7, 8, 9, 17, 27, 30], "much": [7, 8, 9, 10, 13, 18, 28, 30, 34], "angst": [7, 8], "hesit": [7, 8], "readi": [7, 8, 17], "humbl": [7, 8], "ultim": [7, 8, 30, 34], "backward": [7, 8, 9], "hour": [7, 8, 18, 28], "sleep": [7, 8, 18, 28], "perform": [7, 8, 9, 28], "dai": [7, 8, 22, 28, 30], "public": [7, 8], "assist": [7, 8], "welfar": [7, 8], "poverti": [7, 8], "incom": [7, 8, 9, 20, 28, 29, 30, 34], "tempor": [7, 8], "preced": [7, 8], "choic": [2, 7, 8, 9, 17, 20, 22, 28, 30, 33], "consid": [2, 7, 8, 9, 10, 18, 20, 30, 34], "don": [2, 7, 8, 9, 17, 20, 22, 25, 27, 29, 31, 32, 34], "stanc": [7, 8], "spend": [7, 8, 28], "believ": [7, 8, 9, 20], "promot": [7, 8, 20], "break": [7, 8, 9, 27], "lead": [2, 7, 8, 9, 29], "compat": [7, 8], "recogn": [7, 8], "respond": [7, 8, 20, 29, 34], "level": [7, 8, 9, 20, 22, 28, 34], "examin": [7, 8, 9, 18], "figur": [2, 6, 7, 8, 9, 18, 27, 34], "denot": [7, 30], "free": [7, 13, 17, 20], "cluster": [7, 8], "around": [7, 8, 28], "fall": [5, 6, 7, 8], "matter": [2, 7, 9, 10, 22, 27, 28], "shouldn": [7, 9, 20], "confus": [7, 30], "tight": 7, "perfectli": [7, 30], "linearli": [7, 28], "200": [2, 5, 6, 7, 17, 30, 34], "moder": 7, "lower": [7, 9, 18, 20, 30], "drag": [7, 28], "delet": 7, "individu": [2, 7, 9, 17, 22, 29, 30, 34], "twice": [7, 30], "natur": [5, 6, 7, 9, 15, 22, 28, 33, 34], "sens": [7, 10, 28], "correlaton": 7, "80": [2, 5, 6, 7, 20, 34], "sai": [5, 6, 7, 10, 17, 20, 22, 27, 28, 34], "deeper": [7, 15], "stronger": [7, 20], "adjust": [7, 20, 22, 34], "nois": [5, 6, 7, 28], "paramet": [7, 29], "few": [2, 7, 10, 15, 18, 25, 27, 28, 34], "tend": [7, 9, 22], "unless": [7, 27], "underscor": [7, 20], "product": [2, 7, 20, 30, 34], "standard": [5, 6, 7, 10, 20, 26, 27, 28, 31, 32], "_x": [7, 28], "sd": [5, 6, 7, 13, 18, 28, 30, 31, 32, 33], "y_i": 7, "_y": [7, 28], "move": [7, 9, 34], "togeth": [7, 22, 30], "opposit": [7, 30], "goe": [7, 9, 20, 30, 34], "up": [2, 5, 6, 7, 9, 18, 22, 27, 29, 30, 34], "down": [2, 5, 6, 7, 10, 12, 17, 20, 28, 34], "quadrant": 7, "push": [7, 30], "right": [2, 5, 6, 7, 9, 12, 13, 20, 22, 27, 28, 34], "eight": [2, 7, 22], "must": [2, 7, 9, 17, 18, 22, 30], "zero": [5, 6, 7, 12, 18, 20, 22, 28, 34], "cdot": [2, 5, 6, 7, 22, 30], "Then": [5, 6, 7, 17, 22, 28, 30, 32], "dfrac": [7, 18, 30], "prime": 7, "unchang": 7, "per": [7, 10, 13, 28], "corrrel": 7, "footbal": [7, 28], "meant": [7, 15, 29, 34], "obvious": 7, "surprisingli": 7, "precic": 7, "aris": [7, 18, 20, 22, 28], "bell": [6, 7, 18, 34], "taper": 7, "come": [5, 6, 7, 9, 10, 17, 18, 20, 22, 28, 34], "fewer": [7, 9, 17, 25, 28, 34], "anscomb": 7, "quartet": 7, "four": [7, 22, 30], "demonstr": [5, 6, 7, 18, 20, 22, 28, 30], "panel": [7, 20, 34], "obviou": [7, 17, 27], "rate": [7, 18, 20, 30, 34], "phrase": [2, 7], "impli": [7, 18, 20, 34], "utter": [7, 9], "recognit": 7, "quantifi": [5, 6, 7, 20], "highli": 7, "spuriou": 7, "confound": [7, 9, 17, 20, 30], "third": [7, 30, 31, 32], "give": [2, 7, 12, 17, 18, 22, 30], "misinterpret": [7, 28], "articl": [7, 34], "leader": 7, "stop": 7, "One": [5, 6, 7, 9, 22, 29, 30], "classic": [7, 17], "economist": 7, "ebai": 7, "analyz": [7, 10, 17, 20], "conduct": 7, "found": [2, 5, 6, 7, 12, 18, 20, 22, 28, 34], "were": [2, 7, 9, 10, 12, 17, 20, 22, 30, 34], "larg": [5, 6, 7, 9, 10, 15, 17, 22, 34], "wast": 7, "despit": [7, 9, 20, 34], "market": 7, "team": [2, 7], "advertis": 7, "target": 7, "shop": [5, 6, 7, 29, 34], "custom": [5, 6, 7, 11, 17, 20, 34], "pre": [7, 9, 15, 34], "exist": [7, 9], "purchas": 7, "decis": [7, 20], "made": [2, 5, 6, 7, 10, 12, 17, 20, 22, 34], "mistak": [7, 12, 34], "underappreci": 7, "factor": [5, 6, 7, 9, 13, 30], "wa": [7, 9, 10, 17, 20, 22, 26, 27, 28, 34], "higher": [7, 17, 18, 20, 28, 30, 34], "sale": 7, "interest": [2, 7, 9, 13, 20, 22, 28, 29, 30, 33, 34], "spent": 7, "regardless": [2, 7, 20], "polic": [7, 30], "crime": [7, 30], "highlight": [7, 20, 34], "chicken": [7, 30, 34], "egg": [7, 27, 30], "problem": [2, 7, 9, 17, 22, 27, 29, 30], "washington": 7, "post": [7, 9, 20], "conclud": [7, 30], "local": [7, 29], "over": [5, 6, 7, 9, 10, 17, 18, 20, 22, 25, 27, 29, 30, 34], "60": [5, 6, 7, 28, 29, 34], "mislead": [7, 20], "driver": 7, "scenario": [7, 9, 28], "fact": [2, 5, 6, 7, 10, 18, 20, 29], "reduct": [7, 10], "1800": 7, "naiv": [7, 20], "itself": [7, 13], "movi": 7, "theater": 7, "clerk": 7, "want": [2, 7, 9, 12, 15, 22, 26, 27, 28, 29, 30, 33], "daili": [7, 9], "ticket": [2, 5, 6, 7, 22, 30], "matt": [7, 30], "damon": [7, 30], "wahlberg": [7, 30], "he": [7, 9, 17, 20, 22], "record": [7, 34], "week": [7, 30], "mondai": [7, 30], "tuesdai": [7, 30], "wednesdai": [7, 30], "mix": [7, 9, 13, 34], "oop": 7, "mess": [7, 27], "again": [2, 7, 9, 18, 20, 22, 30, 31, 32, 33], "turn": [2, 7, 20, 28], "initi": [7, 9, 22, 30], "correct": [7, 10, 22, 25, 27, 29], "journalist": 7, "bloat": 7, "colleg": [7, 17, 18], "hire": [7, 9, 28], "faculti": [7, 9], "employe": [7, 28], "focus": [7, 30, 33, 34], "thei": [2, 5, 6, 7, 9, 10, 15, 17, 20, 22, 27, 28, 29, 30, 34], "mani": [2, 5, 6, 7, 9, 15, 17, 18, 20, 22, 26, 28, 29, 30, 34], "campus": [7, 17], "monei": [7, 20, 28, 30], "trust": 7, "write": [2, 5, 6, 7, 20, 25, 27, 28, 30, 31, 32], "accus": 7, "school": [7, 9, 15, 17, 18, 20, 30], "award": [7, 30], "driven": [7, 10, 34], "merit": [7, 30], "why": [7, 9, 10, 20, 22, 28, 34], "befor": [2, 9, 15, 17, 20, 22, 27, 30, 34], "continu": [9, 18, 20, 30, 34], "next": [2, 9, 12, 22, 26, 27, 28, 29, 34], "vaccin": 9, "prevent": [9, 31, 32], "excus": 9, "charter": [9, 17], "produc": [9, 15, 27, 32, 34], "outcom": [2, 5, 6, 9, 17, 22], "Will": 9, "my": [2, 9, 20, 22, 27, 30, 34], "cuni": 9, "At": [9, 20, 28], "peak": [9, 34], "seek": 9, "impact": [9, 17, 22, 34], "intervent": 9, "guidanc": 9, "polici": [9, 17], "similarli": [9, 13, 28], "attribut": [9, 20], "student": [9, 15, 17, 18, 22, 30], "success": [5, 6, 9, 13, 34], "attend": [9, 17, 20], "mere": [9, 17, 34], "manag": 9, "degre": [9, 13], "predictor": 9, "qualif": 9, "job": [9, 13, 27, 28], "intellig": 9, "easi": [9, 17, 20, 27, 28], "train": 9, "those": [9, 10, 17, 20, 22, 27, 28, 29, 30, 31, 32], "qualiti": [2, 9, 17, 29, 30, 34], "purpos": [9, 10, 13, 26, 27, 28, 34], "possess": 9, "arriv": [9, 22, 28], "campu": 9, "could": [2, 9, 17, 20, 22, 27, 28, 29, 30, 34], "resum": 9, "perhap": [9, 25, 34], "genet": 9, "water": [9, 17, 34], "hometown": 9, "format": 9, "preschool": 9, "valuabl": 9, "signal": 9, "remain": [2, 9, 20, 22], "shock": 9, "scandal": 9, "prestig": 9, "thu": [5, 6, 9, 28, 30, 34], "fun": 9, "marvel": 9, "jordan": 9, "basketbal": [2, 9, 28], "career": 9, "shakespear": 9, "categor": [9, 34], "earli": [9, 17, 30], "surfac": 9, "explicit": [9, 22, 27], "propos": [9, 20], "theori": [9, 17, 34], "theoriz": [9, 28], "creep": 9, "territori": 9, "themselv": 9, "tell": [2, 9, 20, 22, 27, 30, 33], "challeng": 9, "simplist": 9, "reliabl": [9, 10, 17, 20], "practition": 9, "speak": [9, 22, 27], "hiearchi": 9, "simpl": [9, 27, 28, 33, 34], "hierarchi": 9, "base": [2, 5, 6, 9, 10, 15, 20, 22, 28, 30, 34], "systemat": [9, 28, 29], "meta": 9, "analysi": [9, 10, 13, 15, 17, 20, 28], "anecdot": 9, "expert": [9, 29], "vitamin": [9, 20], "improv": [9, 20, 28, 30], "progress": [9, 17, 21], "method": [9, 20, 22, 34], "treatment": [9, 15, 17, 20, 30], "treat": [9, 20, 27], "group": [5, 6, 9, 17, 20, 22, 29, 30, 34], "Their": [9, 13], "compar": [5, 6, 9, 17, 20, 25, 34], "clip": 9, "simpson": 9, "sell": 9, "tiger": 9, "repel": 9, "rock": 9, "father": [9, 12, 28, 33], "she": [2, 9, 20, 22], "abl": [9, 17, 27, 34], "appeal": 9, "homer": 9, "presenc": 9, "suffer": [9, 13], "attack": 9, "prowl": 9, "springfield": 9, "courtroom": 9, "pose": 9, "But": [5, 6, 9, 10, 17, 20, 22, 30, 34], "defend": 9, "action": 9, "harm": 9, "occur": [9, 20, 22, 29, 30], "onc": [9, 22, 26], "anoth": [2, 5, 6, 9, 10, 13, 17, 22, 25, 30, 34], "Not": [9, 10, 30, 34], "yet": [5, 6, 9], "relev": [9, 10, 17, 28, 30], "With": [9, 20, 22, 30], "dissimilar": 9, "fulli": [9, 29], "afford": 9, "baselin": [9, 34], "behavior": [9, 22], "To": [5, 6, 9, 13, 20, 26, 28, 30, 31, 32], "understood": [9, 28, 30], "bad": [2, 9, 17, 22, 25, 27, 28, 30, 34], "exactli": [9, 22, 28, 34], "chosen": [2, 9, 17, 25, 34], "express": [2, 5, 6, 9], "wouldn": [9, 29], "ensur": [9, 12, 27, 30], "them": [2, 5, 6, 9, 20, 27, 34], "eat": [9, 20], "healthier": [9, 20, 34], "said": [9, 20, 22], "contemporan": 9, "enlist": 9, "navi": 9, "18th": 9, "centuri": 9, "sailor": 9, "ate": 9, "hardtack": 9, "interven": 9, "regimen": 9, "closer": [9, 20, 33, 34], "period": [9, 10, 30], "threaten": 9, "valid": [9, 30], "black": [9, 29, 33], "account": [5, 6, 9, 18, 29, 30], "demograph": [9, 29, 34], "bone": 9, "procedur": 9, "femur": 9, "hard": [9, 22, 27, 28, 34], "dramat": 9, "socioeconom": 9, "statu": [9, 17], "unlik": [5, 6, 9, 20, 29], "biolog": 9, "process": [5, 6, 9, 18, 22, 28, 34], "heal": 9, "ai": 9, "task": [9, 26], "worth": [5, 6, 9, 22, 34], "run": [5, 6, 9, 20, 22, 25, 26, 27, 28, 31, 32, 33], "invol": 9, "lot": [9, 13, 20, 28, 32, 34], "try": [2, 9, 20, 22, 30], "stuff": [9, 33], "happen": [9, 13, 20, 22, 25, 26, 28], "placebo": 9, "particip": [9, 22], "pain": 9, "blind": [9, 30], "doubl": [9, 22, 30], "someon": [9, 10, 13, 18, 20, 27, 28, 29, 30], "evalu": 9, "shan": 9, "carri": [5, 6, 9, 22], "awai": [2, 9, 22, 34], "caution": [9, 22], "literatur": [9, 17], "full": 9, "paper": [9, 22], "rigor": 9, "somehow": [9, 22], "suffus": 9, "through": [2, 9, 15, 20, 28, 34], "folli": 9, "overst": 9, "facebook": [9, 17], "notif": 9, "reduc": [9, 33, 34], "activ": [9, 22, 34], "crimin": 9, "legal": 9, "space": [9, 34], "scale": [9, 11, 17, 28, 34], "expans": [2, 9, 17], "program": [9, 20, 25, 27], "tough": 9, "scare": [9, 13], "straight": 9, "ones": 9, "barack": 9, "obama": 9, "brother": 9, "keeper": 9, "note": [2, 5, 6, 9, 13, 15, 18, 22, 25, 26, 27, 30, 33, 34], "engin": 9, "cautious": 9, "jame": 9, "lind": 9, "scurvi": 9, "debilit": 9, "defici": 9, "scourg": 9, "british": 9, "1742": 9, "surgeon": [9, 10, 20], "hm": 9, "salisburi": 9, "cure": 9, "chose": 9, "seamen": 9, "ident": [5, 6, 9, 17, 22], "diet": [9, 20, 28], "form": [2, 9, 10, 27, 34], "six": [9, 27, 28], "supplement": [9, 15], "food": [9, 28], "ration": 9, "extra": 9, "lemon": 9, "acid": 9, "though": [9, 10, 17, 18, 20, 25, 28], "sampl": [2, 9, 10, 12, 13, 15, 18], "pioneer": 9, "citru": 9, "eater": 9, "britain": 9, "limei": 9, "quickli": [9, 26], "incontrovert": 9, "emerg": [9, 18], "wrong": [2, 9, 20, 22, 27, 30], "approach": [5, 6, 9, 30], "didn": [2, 9, 20, 27], "role": [9, 20, 34], "got": [2, 5, 6, 9, 20, 28], "essenti": [9, 17, 20, 30], "recommend": [9, 15, 34], "disciplin": [9, 10], "indulg": 9, "chain": 9, "cider": 9, "therefor": [2, 5, 6, 9, 17, 18, 22, 30], "luckili": [9, 17, 27], "otherwis": [5, 6, 9, 17, 34], "attempt": [9, 15, 17, 30, 34], "scientif": 9, "integr": 9, "beyond": [9, 15, 18, 30, 33, 34], "ly": 9, "put": [2, 9, 22, 30], "famou": [9, 34], "cargo": 9, "cult": 9, "address": 9, "honesti": [9, 34], "lean": 9, "re": [2, 9, 10, 12, 22, 27, 34], "invalid": 9, "ve": [9, 20, 22, 31, 32, 34], "elimin": [9, 17], "sure": [9, 27], "fellow": 9, "been": [9, 17, 20, 34], "detail": [9, 17, 34], "throw": [9, 22], "doubt": 9, "all": [2, 5, 6, 9, 10, 11, 13, 17, 18, 22, 26, 27, 28, 29, 30, 34], "final": [9, 10, 22, 29], "forget": [9, 27], "mostli": [9, 10, 28], "look": [9, 10, 12, 20, 22, 28, 29], "conundrum": 9, "zealot": 9, "st": 9, "joseph": 9, "mari": 9, "classroom": 9, "innov": 9, "adopt": 9, "judg": [9, 10], "failur": 9, "dismiss": 9, "ask": [2, 9, 22, 27, 29, 34], "known": [2, 9, 29, 33], "pupil": 9, "curriculum": 9, "academ": 9, "stand": [9, 25, 28], "teacher": 9, "governor": 9, "mechan": [9, 17], "whether": [9, 20, 22, 28, 34], "appli": [2, 5, 6, 9, 15, 20, 22, 28, 30], "adapt": 9, "successfulli": 9, "sentenc": [9, 10, 27], "easili": 9, "comfort": [9, 10, 15, 20], "ambigu": [9, 10, 27, 28], "toler": [9, 29], "slow": 9, "build": 9, "000": [2, 9, 20, 29, 30, 34], "20": [2, 5, 6, 9, 20, 22, 28, 29, 33, 34], "electr": [9, 30], "toothbrush": [9, 30], "vs": [9, 28, 30, 31, 32], "fail": [9, 10, 30, 34], "lotteri": [9, 17], "due": [9, 30], "intern": 9, "revenu": [9, 34], "servic": 9, "audit": 9, "taxpay": 9, "high": [2, 9, 15, 17, 18, 20, 28, 34], "fat": 9, "low": [2, 9, 13, 20, 28], "rand": [9, 20], "insur": [9, 20, 34], "util": 9, "hypothesi": [9, 15, 34], "comprehens": 9, "coverag": 9, "overus": 9, "cost": [9, 20], "simplif": [9, 20], "partial": [9, 29], "potenti": [9, 17, 29], "attrit": 9, "remov": [9, 22, 34], "substanti": 9, "across": [9, 13, 17, 34], "problemat": 9, "intens": 9, "specul": 9, "deliv": 9, "caltech": 9, "1974": 9, "commenc": 9, "defin": [10, 17, 20, 26, 27, 30], "definit": [10, 17, 30], "broader": 10, "collect": [10, 18, 22, 28, 34], "imag": 10, "smell": 10, "audio": 10, "nsa": 10, "troubl": [2, 10], "machineri": 10, "disori": 10, "jumbl": 10, "technolog": 10, "extract": 10, "tool": 10, "art": [10, 20], "numer": [2, 10, 22, 26, 29], "conjectur": 10, "puzzl": 10, "concern": [10, 22, 29, 34], "wikipedia": 10, "present": [10, 29, 34], "well": [10, 20, 22, 28, 33, 34], "emphas": [10, 28, 34], "endeavor": 10, "summari": [10, 33], "map": [10, 22], "simplifi": [10, 22, 30, 31, 32], "spatial": 10, "oversimplifi": [10, 34], "applic": [2, 10, 13, 15, 22, 27, 33, 34], "inde": [5, 6, 10, 20], "logic": [10, 27], "rhetor": 10, "brain": 10, "forward": 10, "gambl": 10, "win": [5, 6, 10, 17, 22, 25], "million": [2, 10, 20], "89": [10, 12], "39": [5, 6, 10, 29, 34], "accord": [5, 6, 10, 18, 22, 30], "insist": [10, 27], "risk": [2, 5, 6, 10], "decid": [10, 20, 30], "comput": [10, 26, 27], "worst": [5, 6, 10, 30], "won": [10, 13, 22, 34], "sensit": 10, "lost": 10, "implicit": [10, 27], "disappoint": [10, 20], "resolv": 10, "slowli": [5, 6, 10], "1890": 10, "publish": [10, 17], "smoke": [10, 20], "lung": 10, "cancer": [2, 10, 20, 30], "until": 10, "1964": [10, 20], "wasn": [10, 17], "adequ": 10, "captur": [10, 28], "rather": [10, 17], "certain": [10, 17, 18], "met": 10, "spotifi": [10, 30, 34], "song": [2, 10, 22, 30, 34], "total": [2, 10, 20, 22, 30, 34], "plai": [2, 10, 20], "track": 10, "had": [10, 17, 18, 20, 28], "recent": [10, 17, 30], "deriv": [10, 34], "inher": [5, 6, 10], "develop": [10, 15, 28, 34], "rank": [10, 17], "briefli": 10, "caveat": [10, 30], "hint": 10, "garth": 10, "brook": 10, "biggest": 10, "hit": [10, 22, 26], "wonder": 10, "plural": 10, "datum": 10, "That": [10, 20, 22, 30], "grammat": 10, "puppi": 10, "chart": [11, 34], "editor": [11, 34], "default": [11, 31, 32], "densiti": [11, 34], "height": [11, 12, 28, 33, 34], "block": [11, 25, 34], "reflect": [5, 6, 11], "frequenc": [5, 6, 11, 30], "interv": [11, 28, 34], "width": [11, 34], "bucket": 11, "option": 11, "rightarrow": 11, "draw": [2, 5, 6, 11, 30, 34], "distinct": [11, 28, 30], "taller": 11, "linest": [12, 28, 33], "usag": [12, 13], "a2": 12, "a10": [12, 13], "b2": [12, 22], "b10": [12, 13], "verbos": 12, "output": [12, 25, 28, 32], "signific": [12, 20], "galton": [12, 18], "170": 12, "hat": [12, 28, 33], "mx": [12, 28], "spreadsheet": [2, 12, 34], "store": [12, 27, 34], "a1079": 12, "b1079": 12, "51": [2, 12, 29], "33": [12, 14, 22, 28, 33], "intercept": [12, 28, 33], "furthest": 12, "75": [12, 29, 30], "tallest": 12, "approx": [2, 5, 6, 12], "72": 12, "separ": [12, 28, 34], "tab": [12, 13, 34], "g2": 12, "f2": 12, "referenc": [12, 13], "frozen": 12, "replac": [2, 5, 6, 12, 22, 25, 30], "a3": 12, "c2": 12, "enter": [12, 13], "d2": 12, "rest": [12, 28, 34], "saniti": 12, "check": [12, 27, 34], "f14": 12, "64884635": 12, "round": [12, 20, 34], "excel": [13, 27, 31, 32, 33], "avail": [13, 17, 22, 26, 29], "internet": 13, "browser": [13, 27], "microsoft": 13, "bit": [13, 34], "advantag": [13, 22], "toolpak": 13, "plugin": 13, "abil": 13, "alon": [13, 28], "manipul": [13, 17, 34], "invest": 13, "arithmet": 13, "workbook": 13, "syntax": [13, 25, 26, 27, 31, 32], "mous": 13, "specifi": [13, 17, 20], "rectangular": 13, "b1": 13, "c1": [13, 28], "entireti": 13, "2x2": 13, "cannot": [2, 13, 17, 20, 22], "insert": 13, "power": [13, 15], "behav": 13, "plain": [13, 27], "rel": 13, "dollar": [13, 20, 28, 34], "front": [13, 20, 22], "offer": [13, 17, 27], "hundr": [5, 6, 13, 17], "sever": [13, 22], "categori": 13, "math": [13, 15, 22, 30], "commonli": 13, "appar": [13, 34], "correl": [13, 15, 22, 28, 33, 34], "covar": 13, "percentil": [13, 26], "var": 13, "varp": 13, "stdev": 13, "normdist": 13, "std": 13, "dev": 13, "cumul": [5, 6, 13, 18], "binomdist": [5, 6, 13], "num": 13, "chidist": 13, "freedom": 13, "chisq": 13, "dist": 13, "tdist": 13, "norminv": 13, "tinv": 13, "invers": 13, "IF": 13, "logical_express": 13, "value_if_tru": 13, "value_if_fals": 13, "AND": 13, "OR": 13, "averageif": 13, "criteria_rang": 13, "criterion": 13, "average_rang": 13, "sumif": 13, "sum_rang": 13, "taxi": 13, "xlookup": 13, "search_kei": 13, "lookup_rang": 13, "range_result": 13, "missing_valu": 13, "match_mod": 13, "search_mod": 13, "shaq": 13, "matplotlib": [14, 33], "pyplot": 14, "plt": [14, 33], "hist": 14, "bin": 14, "99": [2, 14, 18, 30, 34], "102": 14, "contain": [2, 15, 17, 22, 30, 34], "read": 15, "companion": 15, "primari": [15, 30], "primarili": 15, "content": [5, 6, 15, 28, 34], "real": 15, "author": 15, "materi": [15, 20], "skip": [2, 15, 27], "topic": [15, 34], "brief": [15, 34], "mention": [2, 15, 30, 34], "exploratori": 15, "bay": [15, 24, 30], "theorem": [5, 6, 15, 24, 30, 34], "tree": [15, 30], "allow": [15, 17, 20, 22, 30], "extens": 15, "subject": [15, 20, 34], "broaden": 15, "exercis": 15, "drill": 15, "concept": 15, "argu": [15, 17, 28, 34], "imper": 15, "halmo": 15, "introductori": 15, "analys": 15, "taken": 15, "major": [2, 15, 20, 22, 34], "design": [15, 20], "requisit": 15, "calculu": [15, 17], "pursu": [15, 31, 32], "center": [15, 18, 34], "spread": [5, 6, 15, 28], "ii": [5, 6, 15], "bibliographi": 15, "overview": 15, "librari": [15, 33], "statwrap": [15, 28], "solut": [5, 6, 15], "irrat": 16, "voter": [16, 29], "108": 17, "skeptic": 17, "nuanc": [17, 29], "indirectli": 17, "compel": [17, 30], "broadli": 17, "absenc": 17, "seat": 17, "alloc": 17, "implement": [17, 27], "concert": 17, "instanc": [17, 20], "bounti": 17, "unconfound": [17, 20], "featur": [17, 20, 29, 30, 34], "fancier": 17, "exogen": 17, "outbreak": 17, "london": 17, "discov": [17, 28, 34], "contamin": 17, "suppli": [17, 34], "prevail": 17, "air": 17, "southwark": 17, "vauxhal": 17, "serv": [17, 34], "lambeth": 17, "purer": 17, "drove": [17, 34], "intak": [17, 20], "sewag": 17, "discharg": 17, "downstream": 17, "plausibl": [17, 20, 28], "hous": 17, "rich": [17, 20], "poor": 17, "occup": 17, "whatev": 17, "surround": 17, "devis": 17, "thoroughli": 17, "circumst": 17, "place": [2, 17, 31, 32, 34], "grandest": 17, "No": [2, 17, 20, 22, 30, 34], "thousand": 17, "station": 17, "gentlefolk": 17, "knowledg": [17, 29], "amongst": 17, "patient": [2, 17], "quit": 17, "impur": 17, "neighborhood": 17, "focu": [5, 6, 17], "determin": [17, 28, 30, 34], "haphazard": 17, "spectrum": 17, "geograph": 17, "region": [17, 18, 28, 34], "104": 17, "105": [17, 18], "grant": 17, "dutch": [17, 27], "famin": 17, "uniqu": 17, "stagger": 17, "proce": 17, "confid": [17, 22, 28, 29, 30], "rollout": 17, "prestigi": 17, "sat": [17, 18, 30], "score": [17, 18, 26, 30], "smart": 17, "decent": 17, "wider": [17, 34], "issu": [17, 22], "fair": [5, 6, 17, 22, 30], "california": 17, "tax": 17, "south": [17, 22, 34], "dakota": 17, "gdp": 17, "growth": [17, 34], "specif": [17, 20, 22, 26, 27, 28, 34], "8am": [17, 30], "1pm": [17, 30], "taught": 17, "instructor": 17, "cap": 17, "switch": [17, 30, 31, 32, 34], "trade": 17, "morn": [17, 30], "debunk": 17, "hurrican": 17, "femal": [17, 29, 30], "deadli": 17, "serious": 17, "male": [17, 29, 30], "landfal": 17, "1900": 17, "date": 17, "death": [17, 20, 30], "toll": 17, "tropic": 17, "storm": 17, "season": [17, 28], "1979": 17, "ideal": [18, 22], "enorm": 18, "necessarili": [18, 22, 29, 34], "deviat": [5, 6, 18, 28, 31, 32], "infin": 18, "neglig": 18, "underneath": 18, "convert": [6, 18, 22, 28, 33], "z": [18, 26], "iq": 18, "130": 18, "ax": 18, "rescal": 18, "maintain": [18, 30], "far": [18, 34], "rare": [2, 5, 6, 18, 30, 34], "recal": [18, 27], "percentag": [5, 6, 18, 22, 25, 28, 29, 30, 34], "evenli": 18, "enough": [18, 20, 22, 27, 31, 32], "varieti": 18, "interior": 18, "fraction": [18, 22], "pm": [5, 6, 18], "nice": 18, "properti": [18, 28], "aren": [18, 27, 34], "Its": 18, "inclus": 18, "close": [5, 6, 18, 28, 34], "sneak": 18, "video": [18, 30], "bounc": 18, "bead": 18, "beauti": [18, 27], "mathemat": [18, 25, 34], "board": 18, "co": [18, 22, 30], "wptsnf1aln": 18, "pic": 18, "twitter": [18, 21], "lxohk72poz": 18, "mdash": 18, "lionel": 18, "page_eco": 18, "septemb": 18, "highest": [18, 34], "16": [5, 6, 18, 22, 34], "il": 18, "84": 18, "verifi": 18, "compet": 18, "admit": 18, "threshold": 18, "construct": [18, 28], "overstat": 20, "prohibit": 20, "taker": 20, "wealthier": 20, "wealth": 20, "homogen": 20, "panacea": 20, "never": [20, 22, 27, 29, 31, 32], "hyperbol": 20, "testabl": 20, "weak": [20, 30], "richer": 20, "seem": [20, 22, 27], "Or": [2, 20, 34], "cooki": 20, "counter": [20, 22], "gadfli": 20, "characterist": [20, 34], "object": [20, 26, 34], "elucid": 20, "feasibl": 20, "experiment": 20, "neither": [20, 22, 30], "wrote": [20, 34], "mind": [2, 20, 22], "imposs": [20, 30, 34], "lab": 20, "govern": 20, "forc": [20, 22], "expens": [20, 28], "400": 20, "fund": [20, 30], "revers": 20, "uc": 20, "appear": [2, 20, 28, 34], "women": [2, 20, 30], "overal": 20, "against": 20, "whole": 20, "seemingli": [2, 20], "clash": [20, 27, 31, 32], "120": [5, 6, 20], "men": 20, "70": [2, 20, 34], "150": 20, "240": 20, "40": [2, 20, 22, 29, 33, 34], "30": [5, 6, 20, 29, 33, 34], "seen": [2, 5, 6, 20, 34], "distort": 20, "flat": [20, 27], "dosag": 20, "obscur": 20, "truth": [2, 20, 30], "counterfactu": 20, "flu": 20, "shot": [2, 20, 22, 30], "happi": 20, "nonetheless": 20, "sick": 20, "pocket": 20, "big": [5, 6, 20, 25, 27], "pharma": 20, "wors": 20, "off": [20, 34], "elementari": 20, "door": [2, 20, 27], "flyer": 20, "told": 20, "anna": [20, 22], "bori": [20, 22], "chad": 20, "dori": 20, "salari": 20, "none": [2, 20, 26], "boost": 20, "erma": 20, "fred": 20, "gina": 20, "harri": 20, "cut": 20, "half": [20, 22, 30], "55": [20, 29], "overestim": 20, "accur": [2, 20, 28], "yourself": [20, 27, 28], "happier": 20, "tourist": 20, "romano": 20, "tour": 20, "snl": 20, "skit": 20, "adam": [20, 22], "sandler": 20, "salesman": 20, "listen": 20, "temper": 20, "encount": 20, "honest": 20, "quot": [20, 25, 27], "sad": 20, "plane": 20, "italian": 20, "riviera": 20, "feel": 20, "bath": 20, "suit": [20, 26, 28], "favor": [20, 30, 34], "editori": 20, "breast": [2, 20, 30], "constant": [20, 28, 33], "35": [20, 22, 34], "constanc": 20, "obtain": 20, "fatal": 20, "45": [2, 20, 29], "1940": 20, "1945": 20, "1950": 20, "1955": 20, "1960": 20, "1970": 20, "extent": [20, 27], "maladi": 20, "factual": 20, "premis": 20, "standup": 20, "comedian": [20, 30], "joke": [20, 27, 30], "version": [20, 30], "gaug": 20, "audienc": [20, 30, 34], "reaction": [20, 30], "loudest": 20, "laugh": 20, "crowd": [20, 34], "email": 21, "me": 21, "ac4725": 21, "troubleshoot": 21, "star": [21, 34], "watch": [21, 34], "project": 21, "github": 21, "linkedin": [21, 34], "14": [22, 29, 30, 34], "tendenc": 22, "rain": 22, "tomorrow": 22, "repeat": [5, 6, 22, 30], "proport": [5, 6, 22, 34], "frequentist": 22, "philosophi": 22, "scope": 22, "coin": [5, 6, 22], "toss": [2, 5, 6, 22, 28], "head": [5, 6, 22, 33], "weight": [22, 34], "leq": 22, "outer": 22, "91": [22, 25], "insid": 22, "guarante": [22, 29], "land": [2, 5, 6, 22], "36": 22, "drew": [22, 28], "akin": 22, "lose": 22, "hh": 22, "ht": 22, "th": [22, 34], "tt": 22, "weather": 22, "devot": 22, "farmer": 22, "almanac": 22, "color": [22, 28, 33, 34], "sky": 22, "written": [22, 27, 31, 32, 33], "red": [22, 34], "textit": 22, "34": [22, 26], "37": [22, 34], "eyebal": 22, "shade": 22, "enclos": 22, "overlap": [22, 34], "exam": 22, "pressur": [22, 34], "clue": 22, "certainli": 22, "game": [22, 28], "stori": 22, "multipli": [2, 22, 30], "invent": 22, "neq": [22, 30], "mayor": 22, "umbrella": 22, "indirect": 22, "live": [22, 28], "nyc": 22, "tote": 22, "powerbal": 22, "correctli": [2, 22, 28], "connect": 22, "mayb": [2, 22, 28, 29, 30, 34], "horoscop": 22, "lucki": [22, 28], "sequenti": 22, "mutut": 22, "exclus": 22, "eath": 22, "cake": 22, "todai": [5, 6, 22], "special": [22, 27, 34], "mutual": 22, "count": [2, 22, 27, 30, 34], "brute": 22, "routin": 22, "sequenc": [22, 27], "hhh": 22, "denomin": [2, 22], "trick": 22, "hth": 22, "tht": 22, "81": [22, 30], "htt": 22, "tth": 22, "ttt": 22, "five": [22, 33], "hunt": 22, "treasur": [22, 28], "sea": 22, "north": 22, "island": 22, "bear": 22, "adjac": 22, "search": 22, "clockwis": 22, "strategi": 22, "maxim": 22, "steer": 22, "binom": [5, 6, 22, 30], "k": [22, 30], "element": 22, "glee": 22, "club": 22, "presid": [22, 30], "pascal": 22, "triangl": 22, "arrang": [22, 30], "horizont": 22, "item": [22, 30], "rememb": [22, 27, 34], "hero": 22, "preliminari": [22, 34], "step": [22, 34], "substitut": [2, 22, 26], "iid": 22, "24": 22, "27": 22, "alic": [22, 30], "battleship": 22, "grandmast": 22, "secret": 22, "spot": 22, "b3": 22, "e12": 22, "carniv": 22, "player": [2, 22, 28, 30], "111": 22, "request": 22, "nor": [22, 30], "cent": 22, "linda": 22, "31": [22, 28, 29], "outspoken": 22, "bright": 22, "deepli": 22, "discrimin": 22, "justic": 22, "anti": 22, "nuclear": 22, "bank": [22, 34], "teller": [2, 22, 30], "feminist": 22, "movement": 22, "leap": 22, "birthdai": 22, "365": 22, "born": 22, "june": 22, "1st": 22, "share": 22, "string": [25, 27], "greet": 25, "integ": 25, "my_favorite_numb": 25, "hello": 25, "print": [25, 33], "function": [25, 26, 27, 31, 32], "displai": [25, 28], "nonsens": 25, "asid": 25, "shorter": 25, "deal": [5, 6, 25, 27, 34], "perfect": [5, 6, 25, 30], "techniqu": 25, "loss": 25, "winning_percentag": 25, "becom": [25, 27, 28, 30], "longer": [25, 30], "collabor": 25, "charact": 25, "golf": 25, "recreat": 25, "tri": 25, "Being": 25, "golfer": 25, "coder": 25, "ceil": [26, 34], "extern": 26, "pi": 26, "ti": 26, "button": 26, "numpi": [26, 33], "access": 26, "141592653589793": 26, "prefix": 26, "cumbersom": 26, "alias": 26, "abbrevi": 26, "np": [26, 33], "alia": 26, "scipi": 26, "capabl": 26, "norm": 26, "cdf": 26, "submodul": 26, "9640696808870742": 26, "shorten": 26, "clearli": 26, "convent": [26, 31, 32, 34], "cool": 27, "lesser": 27, "easier": [27, 30, 31, 32], "pick": [2, 27], "sting": 27, "critiqu": 27, "interview": 27, "scientist": 27, "common": [27, 34], "machin": [27, 33], "packag": [27, 31, 32, 33], "implic": 27, "mainli": 27, "coher": 27, "graph": [27, 28, 34], "colaboratori": 27, "mirror": 27, "jupyt": [27, 33], "setup": 27, "intro": 27, "profici": 27, "sql": 27, "wait": 27, "tech": 27, "intend": 27, "conform": 27, "zen": 27, "elsewher": 27, "tim": 27, "ugli": 27, "complex": 27, "nest": 27, "spars": 27, "dens": 27, "although": 27, "beat": 27, "puriti": 27, "pass": [2, 27, 28, 30], "silent": 27, "explicitli": [27, 33], "silenc": 27, "face": 27, "refus": [27, 34], "temptat": 27, "namespac": 27, "honk": 27, "great": 27, "endlessli": 27, "fluent": 27, "012": 27, "aspir": 27, "fluenci": 27, "bui": 27, "loaf": 27, "bread": 27, "dozen": [2, 27], "loav": 27, "liter": 27, "frustrat": 27, "couldn": 27, "belliger": 27, "friend": 27, "chunk": 27, "messag": 27, "typo": 27, "ran": [27, 28], "chatgpt": 27, "explan": [17, 27], "persist": 27, "scratch": 27, "overwrit": 27, "unexpect": 27, "datafram": [27, 28, 33], "odd": 27, "former": [5, 6, 27, 34], "expon": 27, "decim": 27, "exact": [27, 30], "00000000001": 27, "upon": 28, "incorpor": 28, "estim": [28, 29, 33], "conceptu": 28, "convei": 28, "directli": [28, 30], "protein": 28, "calori": 28, "gram": 28, "180": 28, "assumpt": [28, 30], "wage": 28, "tenur": 28, "month": 28, "factori": 28, "rais": 28, "realiz": 28, "arm": 28, "throught": 28, "recip": [2, 28], "plug": [28, 30], "underestim": 28, "anim": 28, "sourc": [28, 29, 34], "vegan": 28, "singli": 28, "defi": 28, "littl": [22, 28], "debbi": 28, "nutti": 28, "buddi": 28, "eventu": 28, "unprocess": 28, "prudent": 28, "enjoi": 28, "gustatori": 28, "realli": 28, "proccess": 28, "rmse": 28, "_i": 28, "nonlinear": 28, "formless": 28, "cloud": 28, "varianc": 28, "homoscedast": 28, "narrow": [28, 34], "violat": 28, "32": 28, "sleepless": 28, "amount": [28, 34], "slept": 28, "experienc": 28, "rave": 28, "whet": 28, "appetit": 28, "revisit": 28, "mediocr": 28, "gravit": 28, "mc": 28, "nba": 28, "consist": [28, 34], "unobserv": 28, "perspect": [2, 28, 30, 34], "instrins": 28, "realist": 28, "encompass": 28, "luck": 28, "outperform": 28, "underperform": 28, "By": [28, 30], "roll": 28, "reset": 28, "neutral": 28, "sophomor": 28, "slump": 28, "straightforward": 28, "consequ": [5, 6, 28], "phenomenon": 28, "assort": 28, "mate": 28, "least": [2, 22, 28], "fur": 28, "coat": 28, "difficult": [28, 29, 30], "sketch": [28, 34], "exception": [28, 34], "athlet": 28, "complet": [28, 34], "upgrad": [28, 33], "markdown": 28, "md": 28, "use_al": [28, 33], "raw": [28, 33], "githubusercont": [28, 33], "alexanderthclark": [28, 33], "stats1101": [28, 33], "fathersonheight": [28, 33], "load": [28, 31, 32, 33], "df": [28, 33], "pd": [28, 33], "read_csv": [28, 33], "reg": 28, "xlabel": [28, 33], "ylabel": [28, 33], "titl": [28, 34], "rms_error": 28, "scatter_plot": [28, 33], "nrmse": 28, "1f": 28, "893": [28, 33], "514": [28, 33], "x_": [28, 33], "attent": [30, 34], "acknowledg": 30, "disadvantag": 30, "margin": 30, "releas": 30, "resourc": 30, "contribut": 30, "dental": 30, "compon": 30, "histor": 30, "stage": 30, "die": 30, "suffici": [6, 30], "toi": 30, "car": [30, 34], "crash": 30, "safeti": 30, "10x": 30, "1100": 30, "110": 30, "occurr": 30, "cross": 30, "13000r": 30, "13000": 30, "1000000r": 30, "987": 30, "safer": 30, "deliber": 30, "vari": 30, "conclus": 30, "imprecis": 30, "undon": 30, "sort": [29, 30], "studious": 30, "etc": 30, "duplic": 30, "shift": 30, "1200": 30, "cutoff": 30, "1400": 30, "900": 30, "exclud": [29, 30], "exlcud": 30, "strength": 30, "noisi": 30, "match": [31, 32, 34], "accident": [31, 32], "wade": [31, 32], "overwhelm": [31, 32], "use_fpp": [31, 32], "use_sheet": [31, 32], "perman": [31, 32], "session": [31, 32], "fpp": [31, 32], "modul": [31, 32], "816496580927726": 32, "minim": 32, "sklearn": 33, "imit": 33, "pure": 33, "eg": 33, "starter": 33, "8999999999999999": 33, "regression_lin": 33, "000000000000009": 33, "000000000000007": 33, "sd_x": 33, "sd_y": 33, "y_averag": 33, "x_averag": 33, "panda": 33, "earlier": [33, 34], "inspect": [30, 33, 34], "61": [5, 6, 33], "64": 33, "alpha": [30, 33], "opac": [33, 34], "reg_lin": 33, "x_rang": 33, "min": 33, "y_predict": 33, "api": 33, "sm": 33, "add_const": 33, "ol": 33, "param": 33, "arrai": 33, "residuals_sm": 33, "resid": 33, "smf": 33, "model_smf": 33, "residuals_smf": 33, "dtype": 33, "float64": 33, "linear_model": 33, "linearregress": 33, "model_sk": 33, "x_sk": 33, "reshap": 33, "y_sk": 33, "coef_": 33, "intercept_": 33, "0000000000000009": 33, "y_pred": 33, "residuals_sk": 33, "televis": 34, "inessenti": 34, "jargon": 34, "trait": 34, "fame": 34, "tall": 34, "predetermin": 34, "softwar": 34, "216": [29, 34], "approxim": 34, "africa": 34, "wide": 34, "bottom": 34, "span": 34, "221": 34, "reveal": [2, 30, 34], "irregular": 34, "retract": 34, "uncov": 34, "odemet": 34, "statement": 34, "assert": 34, "mileag": 34, "896": 34, "39198": 34, "21396": 34, "63511": 34, "alleg": [22, 34], "uniform": 34, "mile": 34, "anomal": 34, "preposter": 34, "spike": 34, "nearest": 34, "predomin": 34, "fishi": [22, 34], "fabric": 34, "henc": 34, "latter": [2, 5, 6, 34], "vehicl": 34, "qualit": 34, "automat": 34, "qualifi": 34, "postal": 34, "grew": 34, "40422": 34, "offic": 34, "measli": 34, "zip": 34, "10027": 34, "395": 34, "taxonomi": 34, "subdivid": 34, "discret": 34, "quantiti": [2, 6, 34], "fill": [2, 34], "beaker": 34, "ounc": 34, "continuoustli": 34, "lowest": [29, 34], "famili": 34, "blurri": 34, "ic": [5, 6, 34], "cream": [5, 6, 34], "charg": 34, "scoop": [5, 6, 34], "shoo": 34, "7777777": 34, "complain": 34, "gave": 34, "99999999998": 34, "tension": 34, "familiar": [6, 34], "anyon": 34, "agon": 34, "stingi": 34, "dine": 34, "chipotl": 34, "mexican": 34, "grill": 34, "detour": 34, "vocabulari": 34, "endpoint": 34, "contiuou": 34, "messi": [2, 34], "inelegantli": 34, "establish": 34, "999": [29, 34], "88": 34, "888": 34, "quanti": 34, "lesson": 34, "accompani": 34, "codebook": 34, "strang": [2, 34], "clump": 34, "unfortun": 34, "racial": 34, "basi": 34, "necessit": 34, "grai": 34, "unusu": 34, "cautionari": 34, "tale": 34, "necess": 34, "miss": [29, 34], "coax": 34, "19": [29, 34], "netflix": 34, "led": 34, "user": 34, "blood": 34, "oral": 34, "contracept": 34, "overlai": 34, "pill": 34, "paint": 34, "picasso": 34, "cezann": 34, "varaibl": 34, "clutter": 34, "covid": 34, "mortal": 34, "background": 34, "gradient": 34, "alaska": 34, "utah": 34, "younger": 34, "vermont": 34, "style": 34, "t_366bb": 34, "border": 34, "collaps": 34, "2px": 34, "header": 34, "f0f0f0": 34, "000000": 34, "pad": 34, "8px": 34, "1px": 34, "solid": 34, "ccc": 34, "align": 34, "td": 34, "t_366bb_row0_col0": 34, "fdd9b5": 34, "t_366bb_row0_col1": 34, "fddab6": 34, "t_366bb_row0_col2": 34, "fdc794": 34, "t_366bb_row0_col3": 34, "fdbb81": 34, "t_366bb_row0_col4": 34, "fdd5ab": 34, "t_366bb_row1_col0": 34, "t_366bb_row1_col1": 34, "fdd2a6": 34, "t_366bb_row1_col2": 34, "fdcfa0": 34, "t_366bb_row1_col3": 34, "fdbe84": 34, "t_366bb_row1_col4": 34, "fddbb8": 34, "t_366bb_row2_col0": 34, "fdd4aa": 34, "t_366bb_row2_col1": 34, "fdce9e": 34, "t_366bb_row2_col2": 34, "fdc088": 34, "t_366bb_row2_col3": 34, "t_366bb_row2_col4": 34, "fdac67": 34, "t_366bb_row3_col0": 34, "t_366bb_row3_col1": 34, "t_366bb_row3_col2": 34, "fdc692": 34, "t_366bb_row3_col3": 34, "t_366bb_row3_col4": 34, "fda965": 34, "t_366bb_row4_col0": 34, "t_366bb_row4_col1": 34, "fdd3a9": 34, "t_366bb_row4_col2": 34, "t_366bb_row4_col3": 34, "t_366bb_row4_col4": 34, "t_366bb_row5_col0": 34, "fdc28b": 34, "t_366bb_row5_col1": 34, "fdc590": 34, "t_366bb_row5_col2": 34, "t_366bb_row5_col3": 34, "t_366bb_row5_col4": 34, "t_366bb_row6_col0": 34, "t_366bb_row6_col1": 34, "fdc895": 34, "t_366bb_row6_col2": 34, "fdd7b1": 34, "t_366bb_row6_col3": 34, "fedfc0": 34, "t_366bb_row6_col4": 34, "fedebd": 34, "t_366bb_row7_col0": 34, "t_366bb_row7_col1": 34, "fee0c3": 34, "t_366bb_row7_col2": 34, "feead6": 34, "t_366bb_row7_col3": 34, "t_366bb_row7_col4": 34, "fee9d4": 34, "t_366bb_row8_col0": 34, "feead5": 34, "t_366bb_row8_col1": 34, "feebd8": 34, "t_366bb_row8_col2": 34, "fff0e2": 34, "t_366bb_row8_col3": 34, "ffefe0": 34, "t_366bb_row8_col4": 34, "ffeedd": 34, "t_366bb_row9_col0": 34, "t_366bb_row9_col1": 34, "t_366bb_row9_col2": 34, "t_366bb_row9_col3": 34, "t_366bb_row9_col4": 34, "district": 34, "nbsp": 34, "17": [5, 6, 34], "29": [22, 34], "69": 34, "79": 34, "eda": 34, "notabl": 34, "tukei": 34, "box": [2, 30, 34], "emphasi": 34, "mine": [29, 34], "1962": 34, "propon": 34, "asymptot": 34, "cleveland": 34, "1985": 34, "along": 34, "view": 34, "1993": 34, "donoho": 34, "discoveri": 34, "fix": 34, "graphic": 34, "prove": 34, "cite": 34, "bland": 34, "altman": 34, "1986": 34, "aspect": 34, "excit": [6, 34], "explanatori": 34, "distil": 34, "frame": 34, "prose": 34, "distract": 34, "insofar": 34, "thoughtfulli": 34, "151": 34, "spark": 34, "joi": 34, "clear": [22, 30, 34], "li": 34, "upload": 34, "classifi": 34, "satur": 34, "credit": 34, "nick": 34, "huntington": 34, "klein": 34, "bradlei": 34, "cooper": 34, "mindset": 34, "domain": [29, 34], "gini": 34, "lyric": [2, 22], "loser": 22, "montgomeri": 22, "gentri": 22, "outlaw": 22, "boozer": 22, "glass": 22, "hippi": 22, "redneck": 22, "suspect": 22, "bloodlin": [], "am": [], "eddi": 22, "sing": 22, "descend": 22, "translat": 22, "ancestor": 22, "strictli": 22, "advic": 2, "monti": 2, "hall": 2, "paradox": [2, 30], "bend": 2, "14195066": 3, "harder": 22, "114": 22, "fraudul": 22, "101": 22, "firm": 22, "tamper": 22, "billion": 22, "parti": 22, "equival": 22, "rearrang": 2, "isol": 2, "textbf": [], "rewrit": 2, "combin": 2, "expand": [2, 30], "whenev": 2, "transpos": 2, "quad": 2, "005": 2, "00995": 2, "duo": 22, "guido": 17, "imben": 17, "roundabout": 17, "stress": 2, "implicitli": 2, "gerd": 2, "gigerenz": 2, "cold": 2, "percent": 2, "woman": 2, "mammogram": 2, "friendlier": 2, "formul": 2, "992": 2, "screen": 2, "opaqu": 2, "children": 17, "earner": 30, "secondari": 30, "okai": 30, "binomi": [5, 6, 30], "vp": 30, "preseid": 30, "bob": 30, "pretti": 2, "hack": [2, 5, 6], "blue": 2, "plu": 2, "pluss": 2, "rote": 2, "qu": 2, "othan": 2, "625": [], "676": [2, 29], "42": 2, "wheel": 2, "fortun": 2, "termin": 2, "pilgrim": 2, "travel": 2, "home": 2, "wander": 2, "troll": 2, "woe": 2, "73": 2, "fate": 2, "decre": 2, "certainti": 2, "thee": 2, "finish": 2, "exil": 2, "alarm": 2, "bargain": 2, "wise": 2, "velma": [], "park": 2, "unknown": [2, 30], "scrub": [2, 30], "baller": [2, 30], "sold": 2, "amazon": 2, "fake": [2, 30], "joker": [2, 30], "countri": 2, "tractor": [2, 30], "truck": [2, 30], "866": 30, "swap": 30, "substant": 30, "reorder": 30, "visibl": 30, "08": [5, 6], "smaller": [5, 6], "yield": [5, 6, 30], "2x": [5, 6], "100x": [5, 6], "recruit": [5, 6], "2000": [5, 6], "volunt": [5, 6], "iii": [5, 6], "se": [5, 6], "500": [5, 6], "18": [5, 6], "doublearrow": [], "leftrightarrow": [], "focal": [5, 6], "mimic": [5, 6], "1s": [5, 6], "0s": [5, 6], "ruth": [5, 6], "antonin": [5, 6], "vanilla": [5, 6], "chocol": [5, 6], "stock": [5, 6], "cdot0": [5, 6], "018": [5, 6], "470": [5, 6], "530": [5, 6], "central": [5, 6], "lopsid": 6, "bokeh": [], "output_notebook": [], "columndatasourc": [], "layout": [], "slider": [], "customj": [], "pantool": [], "wheelzoomtool": [], "resettool": [], "json": [], "hide_bann": [], "initial_n_draw": [], "precomput": [], "pmf": [], "precomputed_pmf": [], "n_draw": [], "201": [], "arang": [], "tolist": [], "javascript": [], "precomputed_pmfs_json": [], "dump": [], "600": [], "x_axis_label": [], "y_axis_label": [], "vbar": [], "callback": [], "arg": [], "dict": [], "const": [], "cb_obj": [], "pars": [], "tostr": [], "emit": [], "js_on_chang": [], "habea": 6, "gelatu": 6, "ts": 30, "hs": 30, "subtleti": 30, "intuitit": 30, "soution": [], "cdot1": [], "underbrac": 30, "_": 30, "overbrac": 30, "famous": 30, "boi": 30, "girl": 30, "favorit": 30, "remark": 30, "beta": 30, "gamma": 30, "delta": 30, "h_2": 30, "h_1": 30, "tempt": 30, "simul": 30, "990": 30, "10000": 30, "dieas": 30, "989": 30, "901": 30, "9899": 30, "9997": 30, "02": 30, "willing": [29, 30], "ten": 2, "lend": 2, "lest": 2, "aim": 29, "lifespan": 29, "owl": 29, "nearli": 29, "reserv": 29, "truthfulli": 29, "hurdl": 29, "opportun": 29, "pollster": 29, "creameri": 29, "vote": 29, "elect": 29, "milk": 29, "sensibl": 29, "candid": 29, "yuppi": 29, "lactos": 29, "northern": 29, "european": 29, "descent": 29, "intoler": 29, "america": 29, "smarter": 29, "assembl": 29, "truli": 29, "hurld": 29, "phone": 29, "bureau": 29, "labor": 29, "amb06": [], "reproduc": 29, "160": 29, "736": 29, "54": 29, "438": 29, "447": 29, "58": 29, "56": 29, "119": 29, "ethnic": 29, "hispan": 29, "508": 29, "864": 29, "524": 29, "household": 29, "055": 29, "41": 29, "947": 29, "817": 29, "53": 29, "982": 29, "095": 29, "declin": 29, "reweight": 29, "atusrespr": [], "2004": [], "atu": [], "respon": [], "svg": [], "bl": [], "gov": [], "osmr": []}, "objects": {}, "objtypes": {}, "objnames": {}, "titleterms": {"homework": 0, "5": [0, 30], "overview": [1, 13, 27], "run": 1, "r": [1, 15, 33], "altern": 1, "calcul": [1, 7, 22, 25], "variabl": [1, 6, 25, 34], "comment": [1, 25], "probabl": [2, 13, 22, 23, 24, 30], "ii": [2, 30], "import": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 19, 20, 22, 24, 28, 29, 33, 34], "read": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 19, 20, 22, 24, 28, 29, 33, 34], "chanc": [2, 5, 6, 28], "tree": [2, 24], "bay": 2, "theorem": 2, "bibliographi": 3, "center": [4, 30], "spread": [4, 30], "The": [4, 9, 18, 19, 28, 34], "averag": [4, 16], "standard": [4, 9, 18], "deviat": 4, "preambl": 4, "root": 4, "mean": 4, "squar": 4, "find": [4, 12, 18, 28], "popul": 4, "vs": [4, 13], "sampl": [4, 29], "sd": 4, "sup": 4, "what": [4, 27], "sai": 4, "exercis": [2, 4, 7, 8, 9, 10, 16, 17, 18, 20, 22, 28, 30, 34], "correl": [7, 8, 30], "scatter": [7, 8], "plot": [7, 8, 28], "father": [7, 8], "son": [7, 8], "height": [7, 8], "data": [7, 8, 34], "coeffici": [7, 8, 22], "interact": [7, 34], "exampl": [7, 17, 20, 32, 33, 34], "except": 7, "case": 7, "causat": [7, 8], "featur": 8, "experi": [9, 17, 30], "type": 9, "question": 9, "evid": 9, "On": 9, "design": 9, "interpret": 9, "extens": [9, 20, 24, 34], "gold": 9, "stori": 9, "time": 9, "get": [10, 30], "start": [10, 30], "histogram": [11, 14, 34], "regress": [12, 28, 30, 33], "simpl": 12, "linear": [12, 28], "line": [12, 28], "predict": 12, "residu": [12, 28], "basic": [13, 25], "formula": [13, 22], "Not": 13, "1": [5, 6, 13, 30, 33], "cell": 13, "refer": 13, "a1": 13, "sheet1": 13, "rang": 13, "a2": 13, "A": [13, 22], "b2": 13, "copi": 13, "past": 13, "mathemat": 13, "statist": 13, "distribut": [13, 18, 19, 30, 34], "logic": 13, "lookup": 13, "function": 13, "welcom": 15, "intro": 15, "stat": 15, "more": 15, "about": 15, "1101": 15, "main": 15, "text": 15, "googl": 15, "sheet": 15, "option": 15, "python": [15, 27, 28], "other": [15, 20, 21], "law": 16, "natur": [2, 17, 30], "normal": [5, 6, 18, 19, 30], "curv": [18, 19], "unit": 18, "68": 18, "95": 18, "rule": [18, 22], "area": 18, "under": 18, "tabl": [18, 29], "why": 18, "care": 18, "observ": [20, 30], "studi": [20, 30], "simpson": 20, "s": 20, "paradox": 20, "applic": 20, "admit": 20, "potenti": 20, "world": 20, "health": 20, "outcom": 20, "accord": 20, "alic": 20, "bob": 20, "belief": 20, "colleg": 20, "earn": 20, "signal": 20, "abil": [20, 28], "increas": 20, "certain": 20, "individu": 20, "vacat": 20, "itali": 20, "set": 22, "box": [5, 6, 22], "model": 22, "random": 22, "draw": 22, "condit": 22, "gener": [], "mulitpl": 22, "b": 22, "independ": 22, "addit": 22, "list": 22, "wai": 22, "binomi": 22, "librari": 26, "should": 27, "you": 27, "learn": [27, 33], "think": 27, "like": 27, "programm": 27, "slope": 28, "error": [5, 6, 28], "outlier": 28, "evalu": 28, "fallaci": 28, "select": 30, "solut": 30, "4": 30, "7": 30, "8": 30, "10": 30, "15": 30, "20": 30, "23": 30, "statwrap": [31, 32, 33], "us": [31, 32], "catalog": 32, "2": [29, 33], "from": [5, 6, 29, 33], "csv": 33, "statsmodel": 33, "user": 33, "scikit": 33, "summar": 34, "frequenc": [2, 34], "sleuth": 34, "out": 34, "fraud": 34, "drive": 34, "work": 34, "real": 34, "control": 34, "cross": 34, "tabul": 34, "visual": 34, "exploratori": 34, "analysi": 34, "expand": 22, "lift": 2, "fog": 2, "22": 30, "28": 30, "31": 30, "21": 30, "sum": [5, 6], "0": [5, 6], "central": [], "limit": [], "approxim": [5, 6], "i": 30, "32": 30, "33": 30, "34": 30, "36": 30, "37": 30, "survei": 29, "2004": 29, "atu": 29, "respons": 29, "rate": 29, "amb06": 29}, "envversion": {"sphinx.domains.c": 2, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 6, "sphinx.domains.index": 1, "sphinx.domains.javascript": 2, "sphinx.domains.math": 2, "sphinx.domains.python": 3, "sphinx.domains.rst": 2, "sphinx.domains.std": 2, "sphinx.ext.intersphinx": 1, "sphinxcontrib.bibtex": 9, "sphinx": 56}}) \ No newline at end of file +Search.setIndex({"docnames": ["Homework05lab", "Rbasics", "bayes", "bibliography", "centerspread", "chancevar", "chancevary", "correlation", "correlation2", "experiments", "gettingstarted", "ghistogram", "gregression", "gsheets", "histograms", "intro", "lawofaverages", "natural", "normal", "normal0", "observational", "other", "probability", "probability1", "probtree", "pycalculator", "pylibs", "python", "regression", "sampling", "solutions", "statwrap", "statwrap0", "statwrapregression", "thehistogram"], "filenames": ["Homework05lab.ipynb", "Rbasics.ipynb", "bayes.md", "bibliography.md", "centerspread.md", "chancevar.md", "chancevary.ipynb", "correlation.ipynb", "correlation2.md", "experiments.md", "gettingstarted.md", "ghistogram.md", "gregression.md", "gsheets.md", "histograms.ipynb", "intro.md", "lawofaverages.md", "natural.md", "normal.ipynb", "normal0.md", "observational.md", "other.md", "probability.md", "probability1.md", "probtree.md", "pycalculator.ipynb", "pylibs.ipynb", "python.md", "regression.ipynb", "sampling.md", "solutions.md", "statwrap.md", "statwrap0.ipynb", "statwrapregression.ipynb", "thehistogram.md"], "titles": ["Homework 5", "Overview", "Probability II", "Bibliography", "Center and Spread", "Chance Error", "Chance Variability", "Correlation", "Correlation", "Experiments", "Getting Started", "Histograms", "Regression", "Overview", "Histograms", "Welcome to Intro Stats", "Law of Averages", "Natural Experiments", "Normal Distribution", "Normal Distribution", "Observational Studies", "Other", "Probability", "Probability", "Probability Trees", "Basics", "Libraries", "Overview", "Regression", "Sampling", "Selected Solutions", "StatWrap", "StatWrap", "Regression", "The Histogram"], "terms": {"copi": [0, 12], "differ": [0, 2, 4, 5, 6, 9, 10, 13, 17, 20, 27, 28, 29, 30, 33, 34], "text": [0, 2, 4, 5, 6, 7, 10, 13, 18, 21, 22, 25, 27, 28, 30, 31, 34], "exampl": [0, 2, 4, 5, 6, 9, 11, 13, 15, 18, 22, 27, 28, 29, 30], "you": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 13, 15, 17, 18, 20, 21, 22, 25, 26, 28, 29, 30, 31, 32, 33, 34], "receiv": [0, 2, 7, 17, 28], "small": [0, 2, 9, 17, 34], "data": [0, 3, 4, 5, 6, 9, 10, 11, 12, 13, 14, 15, 17, 18, 20, 22, 25, 27, 28, 29, 30, 33], "set": [0, 6, 7, 9, 10, 17, 18, 20, 28, 29, 30, 34], "call": [0, 4, 5, 6, 7, 8, 9, 17, 18, 20, 22, 25, 28, 29, 30, 33, 34], "cps_coupl": 0, "csv": [0, 28], "built": [0, 28], "from": [0, 2, 3, 4, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 22, 25, 26, 27, 28, 30, 31, 32, 34], "current": [0, 7, 9, 22], "popul": [0, 2, 3, 17, 20, 29, 30, 34], "survei": [0, 3, 18, 34], "each": [0, 2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 28, 29, 30, 34], "row": [0, 12, 13, 18, 22, 30, 33, 34], "describ": [0, 4, 5, 6, 9, 20, 22, 27, 28, 34], "marri": [0, 6], "coupl": [0, 28, 30], "The": [0, 1, 2, 3, 5, 6, 7, 8, 10, 11, 12, 15, 17, 20, 22, 25, 26, 27, 29, 30], "alreadi": [0, 2, 7, 20, 22, 26, 28, 31, 32], "clean": 0, "There": [0, 2, 5, 6, 7, 8, 9, 13, 17, 20, 22, 25, 27, 29, 30, 34], "ar": [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 32, 33, 34], "flag": [0, 22, 34], "valu": [0, 1, 4, 6, 7, 10, 12, 13, 18, 22, 25, 26, 27, 28, 30, 34], "need": [0, 1, 2, 7, 8, 10, 13, 17, 25, 27, 34], "drop": [0, 9, 28], "review": [0, 2, 3, 7, 9, 30, 34], "condens": 0, "document": [0, 10, 11, 31, 32, 34], "more": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 20, 22, 25, 27, 28, 29, 30, 31, 32, 33, 34], "inform": [0, 2, 9, 10, 22, 28, 34], "column": [0, 10, 12, 13, 18, 20, 30, 34], "e": [0, 2, 3, 9, 10, 22, 28, 31, 32], "g": [0, 3, 9, 10, 12, 31, 32], "an": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 13, 15, 17, 18, 20, 21, 22, 27, 28, 29, 30, 34], "educ": [0, 17, 20], "46": [0, 29], "correspond": [0, 9, 11, 22, 26, 28, 34], "phd": 0, "variabl": [0, 5, 7, 8, 15, 18, 20, 27, 28, 29, 30], "name": [0, 9, 13, 17, 25, 27, 29, 31, 32, 34], "tucaseid": 0, "identifi": [0, 2, 17, 22], "prernwa": 0, "partner": [0, 28, 30], "earn": [0, 7, 8], "peeduca": 0, "prtage": 0, "ag": [0, 9, 17, 20, 30, 34], "pesex": 0, "sex": [0, 3, 17, 20, 29, 30], "ptdtrace": 0, "race": [0, 3, 29], "submit": 0, "your": [0, 1, 2, 4, 5, 6, 9, 12, 13, 15, 18, 20, 22, 25, 27, 28, 30, 34], "work": [0, 1, 3, 9, 10, 21, 22, 25, 27, 28, 29, 32], "two": [0, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 20, 22, 28, 30, 33, 34], "file": 0, "1": [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 14, 18, 20, 22, 25, 26, 27, 28, 29, 31, 32, 34], "main": [0, 2, 24, 28, 33, 34], "pdf": 0, "doc": 0, "answer": [0, 2, 4, 9, 18, 22, 29, 30, 34], "question": [0, 2, 5, 6, 10, 15, 22, 27, 30], "provid": [0, 2, 6, 9, 15, 28, 30, 34], "statist": [0, 2, 3, 4, 6, 9, 10, 15, 18, 20, 27, 29, 31, 32, 33, 34], "reason": [0, 3, 9, 10, 18, 20, 22], "actual": [0, 1, 2, 5, 6, 7, 9, 10, 12, 17, 22, 25, 27, 28, 29, 34], "calcul": [0, 4, 5, 6, 10, 12, 13, 18, 26, 27, 28, 29, 30, 31, 32, 33, 34], "2": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 14, 18, 20, 22, 25, 27, 28, 30, 31, 32, 34], "supplementari": 0, "either": [0, 2, 4, 7, 8, 15, 17, 18, 22, 30, 34], "xlsx": 0, "code": [0, 1, 25, 26, 27, 31, 32, 34], "thi": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 21, 22, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34], "proof": 0, "replic": [0, 3, 9], "creat": [0, 7, 9, 11, 25, 30, 33, 34], "scatter": [0, 20, 28, 30, 34], "diagram": [0, 7, 22, 28], "relat": [0, 7, 15, 17, 28, 30, 31, 32], "choos": [0, 1, 2, 7, 8, 9, 10, 20, 22, 34], "among": [0, 9, 20, 22, 28, 34], "quantit": [0, 7, 8, 10, 18, 28, 30, 34], "onli": [0, 2, 5, 6, 7, 9, 10, 13, 15, 17, 20, 22, 27, 28, 30, 34], "us": [0, 1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 17, 18, 20, 22, 25, 26, 27, 28, 30, 33, 34], "follow": [0, 2, 4, 5, 6, 7, 8, 9, 10, 15, 18, 20, 22, 25, 30, 34], "find": [0, 1, 2, 3, 7, 8, 9, 10, 17, 20, 21, 22, 26, 29, 30, 31, 32, 34], "regress": [0, 13, 15, 34], "line": [0, 4, 7, 8, 20, 22, 25, 26, 27, 31, 32, 33, 34], "equat": [0, 5, 6, 10, 12, 25, 28], "let": [0, 7, 8, 20, 22, 27, 28, 30, 33], "independ": [0, 2, 5, 6, 7, 8, 20, 28, 30], "3": [0, 1, 2, 4, 5, 6, 7, 8, 9, 12, 14, 18, 20, 22, 26, 28, 29, 30, 31, 32, 33, 34], "interpret": [0, 10, 15, 28, 30, 34], "context": [0, 9, 10, 13, 15, 30], "what": [0, 2, 3, 5, 6, 7, 9, 10, 15, 17, 18, 20, 22, 25, 26, 28, 30, 31, 32, 34], "do": [0, 1, 2, 4, 5, 6, 9, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32], "coeffici": [0, 12, 28, 30, 33, 34], "mean": [0, 2, 5, 6, 7, 9, 10, 12, 13, 18, 20, 22, 27, 28, 30, 34], "4": [0, 3, 4, 7, 9, 12, 14, 18, 20, 22, 25, 27, 28, 29, 33, 34], "discuss": [0, 9, 20, 22, 28, 34], "linear": [0, 7, 8, 15, 30, 33], "appropri": [0, 2, 7, 8, 27, 28, 30], "root": [0, 5, 6, 12, 28], "squar": [0, 5, 6, 12, 28], "error": [0, 4, 7, 12, 13, 21, 27], "assum": [0, 2, 7, 17, 18, 22, 30], "residu": [0, 33], "normal": [0, 1, 4, 7, 15, 25, 26], "curv": [0, 5, 6, 7, 26, 34], "6": [0, 2, 5, 6, 7, 17, 19, 20, 22, 24, 28, 29, 34], "plot": [0, 20, 30, 33, 34], "detect": [0, 30], "ani": [0, 2, 4, 6, 7, 9, 10, 17, 18, 20, 22, 27, 28, 30, 34], "non": [0, 2, 7, 9, 20, 34], "pattern": [0, 7, 18, 28], "heteroscedast": [0, 28], "7": [0, 2, 18, 28, 29, 34], "empir": [0, 9], "probabl": [0, 3, 5, 6, 10, 15, 34], "abov": [0, 2, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 25, 26, 28, 30, 31, 32, 34], "averag": [0, 2, 5, 6, 7, 9, 10, 12, 13, 18, 20, 28, 30, 33], "condit": [0, 2, 5, 6, 17, 30, 34], "posit": [0, 2, 5, 6, 7, 8, 9, 18, 20, 28, 30, 34], "doe": [0, 2, 3, 4, 7, 9, 10, 17, 18, 20, 22, 25, 27, 28, 30, 33, 34], "support": [0, 4, 9, 34], "previou": [0, 2, 9, 17, 22, 30, 34], "8": [0, 1, 2, 7, 8, 22, 26, 28, 29, 33, 34], "label": [0, 2, 4, 22, 30], "parter": 0, "within": [0, 4, 5, 6, 18, 20, 26, 28], "somewhat": 0, "arbitrari": [0, 34], "reorgan": 0, "wai": [0, 1, 2, 4, 7, 8, 9, 10, 17, 20, 25, 26, 27, 30, 34], "doesn": [0, 2, 4, 5, 6, 7, 9, 20, 22, 25, 27, 29, 30, 33, 34], "t": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34], "split": [0, 4, 18, 34], "simpli": [0, 18, 22, 25, 26, 30], "relabel": [0, 30], "everi": [0, 1, 2, 9, 13, 17, 20, 29, 31, 32], "vice": [0, 22], "versa": 0, "some": [0, 1, 2, 4, 5, 6, 7, 9, 10, 17, 18, 20, 22, 25, 27, 28, 29, 32], "x": [0, 1, 4, 7, 8, 12, 13, 18, 20, 23, 25, 28, 30, 33], "y": [0, 7, 8, 12, 20, 25, 28, 30, 33, 34], "pair": [0, 7, 8, 9, 28, 30], "stai": [0, 2], "same": [0, 2, 5, 6, 7, 9, 13, 17, 18, 20, 22, 25, 26, 28, 30, 34], "other": [0, 2, 4, 7, 8, 9, 10, 12, 13, 17, 22, 26, 28, 29, 30, 31, 32, 34], "flip": [0, 5, 6, 7, 22], "how": [0, 2, 4, 5, 6, 7, 9, 10, 15, 17, 18, 20, 22, 28, 29, 30, 34], "did": [0, 9, 20, 27], "new": [0, 2, 3, 7, 9, 31, 32], "comment": [0, 4, 9, 15, 20], "chang": [0, 1, 2, 3, 4, 7, 8, 9, 12, 18, 20, 22, 27, 30, 34], "popular": [1, 10, 27, 30], "industri": 1, "It": [1, 2, 4, 5, 6, 7, 9, 17, 20, 22, 25, 26, 28, 29, 30, 33, 34], "s": [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15, 17, 22, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34], "academia": 1, "i": [1, 2, 3, 4, 5, 6, 7, 9, 15, 22, 27, 28, 31, 32, 34], "ll": [1, 2, 4, 5, 6, 9, 15, 20, 22, 26, 29, 30, 31, 32, 34], "occasion": [1, 27], "myself": 1, "leav": [1, 2, 24, 30], "python": [1, 13, 25, 26, 31, 32, 33], "someth": [1, 2, 4, 9, 10, 17, 20, 22, 25, 27, 28, 33, 34], "advanc": [1, 20, 30, 31, 32], "notebook": [1, 27, 33], "done": [1, 9, 10, 12, 13, 17, 22, 25, 30], "first": [1, 2, 4, 5, 6, 7, 8, 9, 10, 17, 20, 22, 25, 27, 28, 30, 33, 34], "cell": [1, 12, 18, 27, 34], "below": [1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 17, 18, 20, 22, 25, 26, 28, 30, 32, 34], "ad": [1, 7], "command": [1, 27, 33], "open": [1, 2, 27, 34], "googl": [1, 4, 5, 6, 10, 11, 13, 27, 30, 31, 32, 33, 34], "colab": [1, 27, 31, 32, 33, 34], "runtim": 1, "type": [1, 2, 10, 13, 15, 20, 25, 27, 29, 30], "go": [1, 2, 5, 6, 7, 8, 9, 10, 15, 20, 27, 30, 34], "menu": 1, "top": [1, 7, 29, 30, 34], "page": [1, 3, 17, 18, 27, 34], "select": [1, 2, 9, 13, 15, 17, 29], "under": [1, 5, 6, 26, 30], "click": 1, "save": 1, "list": [1, 4, 5, 6, 25, 28, 29, 30, 31, 32], "typic": [1, 4, 5, 6, 17, 25, 26, 28, 33, 34], "oper": [1, 25], "descript": [1, 9, 15, 25, 28, 34], "addit": [1, 9, 17, 25, 28], "subtract": [1, 25, 34], "multipl": [1, 2, 15, 22, 25], "float": [1, 25], "point": [1, 4, 7, 8, 11, 13, 17, 18, 20, 22, 25, 27, 28, 30, 33, 34], "divis": [1, 25], "exponenti": [1, 25], "we": [1, 2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 15, 17, 18, 20, 22, 24, 25, 26, 27, 28, 29, 30, 33, 34], "can": [1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 17, 18, 20, 21, 22, 25, 26, 27, 28, 29, 30, 32, 34], "parenthesi": [1, 25], "readabl": [1, 25, 27], "order": [1, 2, 4, 5, 6, 22, 25, 27, 28, 30, 33, 34], "usual": [1, 9, 17, 25, 27, 29, 34], "pip": [1, 28, 31, 32, 33], "instal": [1, 26, 28, 31, 32, 33], "rpy2": 1, "load_ext": 1, "ipython": [1, 28], "0": [1, 2, 4, 7, 8, 12, 13, 14, 18, 20, 22, 25, 26, 27, 28, 29, 30, 32, 33, 34], "assign": [1, 9, 17, 20, 25, 30], "help": [1, 2, 4, 9, 10, 12, 15, 20, 21, 22, 25, 29, 30, 34], "care": [1, 9, 20, 25, 27, 28], "about": [1, 2, 3, 4, 5, 6, 7, 9, 10, 18, 20, 22, 24, 25, 27, 28, 30, 34], "colleagu": [1, 25, 29, 34], "futur": [1, 25], "self": [1, 3, 9, 15, 25, 34], "should": [1, 2, 5, 6, 7, 8, 9, 12, 13, 15, 20, 22, 25, 28, 30, 34], "add": [1, 15, 17, 22, 25, 28, 33], "clariti": [1, 25], "intent": [1, 7, 25], "A": [1, 2, 3, 5, 6, 7, 8, 9, 10, 12, 15, 17, 18, 20, 24, 25, 26, 27, 28, 29, 30, 34], "piec": [1, 25, 34], "isn": [1, 2, 9, 10, 17, 20, 25, 27, 31, 32], "execut": [1, 25, 27], "left": [1, 2, 7, 10, 12, 13, 18, 25, 26, 28, 34], "reader": [1, 22, 25, 34], "person": [1, 2, 17, 20, 22, 25, 27, 28, 29, 34], "who": [1, 2, 7, 9, 10, 13, 17, 20, 25, 27, 28, 29, 30, 34], "inherit": [1, 25], "modifi": [1, 22, 25], "everyth": [1, 4, 9, 20, 22, 25, 27], "after": [1, 2, 5, 6, 10, 17, 20, 22, 25, 28, 34], "ignor": [1, 4, 17, 22, 25, 32], "1000": [1, 5, 6, 20, 30], "becaus": [1, 2, 4, 5, 6, 7, 9, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 33, 34], "out": [1, 2, 3, 5, 6, 7, 9, 18, 20, 22, 25, 27, 28, 30], "9": [1, 2, 6, 7, 8, 18, 22, 28, 29, 30, 33, 34], "10": [1, 2, 3, 5, 6, 10, 18, 20, 25, 28, 29, 33, 34], "90": [1, 2, 3, 20, 22, 25, 30], "tij12": [2, 3, 24], "chapter": [2, 4, 5, 6, 7, 8, 9, 10, 15, 17, 18, 19, 20, 22, 24, 28, 29, 34], "str10": [2, 3, 24], "In": [2, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17, 18, 20, 22, 24, 25, 26, 27, 28, 29, 30, 34], "section": [2, 6, 9, 15, 17, 20, 30], "textbook": [2, 10, 15, 22, 24, 28], "learn": [2, 7, 8, 9, 13, 15, 17, 24, 30, 34], "foundat": [2, 6], "further": [2, 9, 26], "coursework": 2, "bayesian": 2, "just": [2, 4, 5, 6, 7, 8, 10, 15, 17, 18, 22, 26, 28, 29, 30, 34], "interact": [2, 28], "nerdi": 2, "peopl": [2, 5, 6, 7, 9, 17, 18, 20, 22, 29, 30, 34], "talk": [2, 4, 22], "updat": [2, 34], "respons": [2, 7, 34], "solv": [2, 9, 10, 22, 27, 28, 29, 30], "mathbb": [2, 5, 6, 22, 30], "p": [2, 3, 5, 6, 12, 22, 30], "mid": [2, 22, 30], "b": [2, 3, 4, 9, 10, 12, 13, 18, 20, 25, 27, 28, 30], "given": [2, 7, 8, 9, 22, 27, 28, 30, 34], "involv": [2, 9, 17, 22, 27, 34], "observ": [2, 3, 4, 5, 6, 7, 9, 12, 15, 17, 18, 22, 28, 34], "uncondit": [2, 22, 30], "prior": [2, 9, 17, 22], "belief": [2, 9, 22], "posterior": 2, "kind": [2, 4, 5, 6, 9, 10, 17, 20, 22, 25, 27, 28, 29, 30, 34], "environ": 2, "where": [2, 4, 5, 6, 7, 9, 12, 13, 17, 18, 20, 22, 25, 27, 30, 34], "gather": 2, "For": [2, 4, 5, 6, 7, 8, 9, 12, 13, 17, 20, 22, 27, 28, 29, 30, 34], "medic": [2, 9, 34], "doctor": [2, 9], "assess": 2, "diseas": [2, 9, 30], "particular": [2, 4, 5, 6, 7, 28], "test": [2, 3, 7, 8, 9, 12, 15, 17, 23, 24, 30, 34], "result": [2, 5, 6, 7, 9, 17, 20, 22, 27, 29, 30], "noth": [2, 7, 9, 10, 20, 22, 30], "requir": [2, 5, 6, 9, 10, 13, 17, 27, 29, 34], "event": [2, 18, 22, 30], "organ": [2, 3, 10, 12, 15, 29, 34], "regard": [2, 10, 20, 29], "almost": 2, "anyth": [2, 7, 9, 10, 27, 34], "gener": [2, 3, 5, 6, 10, 17, 20, 22, 27, 28, 29, 30, 34], "rule": [2, 4, 5, 6, 7, 9, 20, 27, 34], "And": [2, 9, 18, 22, 28, 34], "here": [2, 9, 10, 15, 22, 27, 28, 30, 31, 32, 34], "concret": [2, 20], "english": 2, "word": [2, 4, 28, 30, 34], "latin": 2, "french": 2, "origin": [2, 4, 9, 22, 34], "letter": [2, 13], "q": 2, "alwai": [2, 4, 12, 22, 28, 30, 34], "u": [2, 9, 18], "know": [2, 5, 6, 7, 9, 17, 20, 22, 26, 28, 29, 30, 34], "start": [2, 5, 6, 9, 15, 17, 22, 25, 27, 31, 32], "second": [2, 5, 6, 10, 12, 20, 22, 25, 27, 28, 30], "being": [2, 7, 8, 9, 17, 20, 22, 25, 27, 30], "100": [2, 5, 6, 9, 10, 14, 17, 18, 20, 22, 25, 28, 30, 34], "howev": [2, 5, 6, 7, 8, 18, 20, 28, 29], "veri": [2, 3, 5, 6, 17, 22, 34], "like": [2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 17, 18, 20, 22, 25, 26, 28, 29, 30, 31, 32, 33, 34], "If": [2, 4, 5, 6, 7, 8, 9, 10, 12, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32, 34], "drawn": [2, 4, 11, 22, 30], "randomli": [2, 9, 17, 30], "would": [2, 4, 5, 6, 7, 8, 9, 10, 13, 17, 20, 22, 26, 28, 30, 34], "26": [2, 7], "also": [2, 4, 7, 8, 9, 11, 18, 20, 21, 22, 25, 27, 28, 30, 34], "simplic": [2, 4], "especi": [2, 7, 8, 9, 13, 22, 27], "when": [2, 4, 5, 6, 7, 8, 9, 13, 17, 18, 20, 22, 25, 27, 28, 29, 34], "depend": [2, 4, 5, 6, 7, 8, 22, 28, 30, 34], "see": [6, 7, 9, 17, 20, 26, 28, 30, 34], "abe12": [3, 10], "robert": 3, "abelson": 3, "principl": [3, 9, 10, 34], "argument": [3, 10, 17], "psycholog": 3, "press": 3, "2012": 3, "ap14": [3, 9], "joshua": 3, "d": [2, 3, 4, 12, 18, 20, 22, 30, 34], "angrist": 3, "j": 3, "\u00f6": 3, "rn": 3, "steffen": 3, "pischk": 3, "master": [3, 27], "metric": 3, "path": [2, 3], "caus": [3, 7, 8, 9, 17, 20, 27, 29], "effect": [3, 7, 8, 9, 17, 20, 28, 30, 34], "princeton": 3, "univers": [3, 9, 17, 28], "2014": 3, "url": [3, 28, 33], "http": [3, 18, 28, 33], "clio": 3, "columbia": [3, 9, 22, 34], "edu": 3, "catalog": [3, 10, 15, 34], "11221502": 3, "bhoconnell75": [3, 20], "bickel": 3, "hammel": 3, "w": 3, "o": [3, 20], "connel": 3, "bia": [3, 9, 17, 20, 29], "graduat": [3, 9, 20], "admiss": [3, 18, 20, 22, 30], "berkelei": [3, 20], "scienc": [3, 9, 20, 34], "187": 3, "4175": 3, "398": 3, "404": 3, "1975": 3, "www": 3, "jstor": 3, "org": 3, "stabl": 3, "1739581": 3, "visit": [3, 9], "2024": 3, "01": [2, 3, 30], "03": 3, "blm22": [3, 17], "luca": [3, 7], "braghieri": 3, "ro": 3, "ee": 3, "levi": 3, "alexei": 3, "makarin": 3, "social": [3, 4, 9, 17, 22], "media": [3, 17], "mental": [3, 7, 17], "health": [3, 7, 9, 10, 17, 30], "american": [3, 18, 28], "econom": 3, "112": 3, "11": [3, 5, 6, 22, 27, 28, 29, 30, 34], "3660": 3, "3693": 3, "2022": 3, "cc65": [3, 20], "william": [3, 20], "cochran": [3, 20], "paul": 3, "chamber": [3, 34], "plan": [3, 9], "studi": [2, 3, 7, 9, 10, 15, 17, 28, 29, 31, 32, 34], "human": [3, 34], "journal": [3, 7, 20], "royal": 3, "societi": [3, 7, 8], "seri": [3, 33], "128": 3, "234": 3, "266": 3, "1965": [3, 20], "2344179": 3, "dvvb19": [3, 10, 34], "richard": [3, 9], "de": 3, "veaux": 3, "f": [2, 3, 12, 28, 33], "velleman": 3, "bock": 3, "stat": [3, 9, 26, 27, 33], "model": [3, 5, 6, 33, 34], "5th": 3, "edit": 3, "pearson": [3, 13, 28, 33], "addison": 3, "weslei": 3, "boston": 3, "2019": [3, 18], "dc18": [3, 9], "angu": 3, "deaton": 3, "nanci": 3, "cartwright": 3, "understand": [3, 9, 10, 15, 17, 20, 22, 27], "misunderstand": 3, "random": [3, 4, 5, 6, 7, 9, 17, 18, 20, 28, 30, 34], "control": [3, 7, 9, 17, 20, 30], "trial": [3, 5, 6, 7, 9, 13, 22], "medicin": [3, 20], "210": 3, "21": [3, 33], "2018": 3, "fr99": [3, 9], "r": [3, 4, 7, 13, 27, 28, 30], "feynman": [3, 9], "robbin": 3, "pleasur": 3, "Of": [2, 3, 9, 29, 30], "thing": [3, 7, 9, 10, 18, 20, 22, 25, 26, 28, 33, 34], "best": [2, 3, 5, 6, 9, 22, 26, 28], "short": [3, 9, 17, 26, 34], "helix": 3, "book": [3, 15, 31, 32], "basic": [3, 9, 15, 20, 33], "1999": 3, "isbn": 3, "9780738201085": 3, "2450053": 3, "fpp07": [3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 18, 19, 20, 22, 28, 29, 31, 32, 34], "david": 3, "freedman": 3, "pisani": 3, "roger": 3, "purv": 3, "ww": 3, "norton": 3, "compani": [3, 17, 27, 34], "2007": 3, "6285515": 3, "fre91": [3, 17], "shoe": 3, "leather": 3, "sociolog": 3, "methodolog": 3, "291": 3, "313": 3, "1991": 3, "gal06": [3, 9], "galenson": 3, "old": [2, 3, 20, 22, 29], "young": [3, 20, 29], "genius": 3, "life": [3, 9], "cycl": [3, 7, 8, 9], "artist": [3, 9, 10, 30, 34], "creativ": [3, 9, 27], "2006": 3, "9780691121093": 3, "14140122": 3, "gel18": [3, 9], "andrew": 3, "gelman": 3, "benefit": [3, 9, 20, 34], "limit": [3, 5, 6, 7, 17, 20, 34], "commentari": 3, "1982": 3, "48": [3, 22], "49": [3, 34], "gv21": [3, 34], "aki": 3, "vehtari": 3, "most": [3, 9, 10, 17, 28, 30, 34], "import": [3, 14, 15, 25, 26, 27, 30, 31, 32], "idea": [3, 9, 15, 27, 28, 34], "past": [3, 7, 12, 20, 27, 34], "50": [2, 3, 5, 6, 14, 18, 20, 22, 29, 30, 33, 34], "year": [2, 3, 7, 9, 20, 22, 28, 34], "associ": [3, 7, 8, 10, 20], "116": 3, "536": 3, "2087": 3, "2097": 3, "2021": [3, 34], "han08": [3, 10], "hand": [3, 20, 22], "introduct": [3, 17], "oxford": 3, "usa": 3, "2008": 3, "14180088": 3, "her09": [3, 34], "cedric": 3, "her": [3, 4, 9, 22, 34], "divers": [3, 34], "pai": [3, 9, 10, 13, 22, 30], "gender": [3, 17, 34], "busi": [3, 7, 9, 34], "case": [3, 4, 9, 10, 17, 20, 22, 25, 27, 28, 30, 34], "74": [3, 29], "208": 3, "224": 3, "2009": 3, "her17": [3, 34], "Is": [2, 3, 4, 7, 17, 18, 20, 22, 27], "still": [2, 3, 7, 8, 9, 15, 17, 20, 25, 30, 34], "good": [2, 3, 9, 10, 15, 17, 22, 25, 27, 28, 29, 30, 31, 32, 34], "82": [3, 7, 30], "868": 3, "877": 3, "2017": [3, 34], "kkm01": [3, 34], "arn": 3, "l": [2, 3], "kalleberg": 3, "knoke": 3, "peter": [3, 27], "v": 3, "marsden": 3, "nation": [3, 7, 34], "NOS": 3, "1996": [3, 34], "1997": [3, 34], "inter": 3, "consortium": 3, "polit": [3, 29], "research": [3, 7, 9, 17, 20, 29, 30, 34], "ann": 3, "arbor": 3, "mi": 3, "2001": 3, "kna15": [3, 34], "cole": 3, "nussbaum": 3, "knaflic": 3, "storytel": [3, 9], "visual": [3, 4, 18], "guid": 3, "profession": [3, 7, 27, 28], "john": [3, 17, 34], "wilei": 3, "son": [3, 12, 28, 33], "2015": 3, "ktx20": [3, 9], "ron": 3, "kohavi": 3, "dian": 3, "tang": 3, "ya": 3, "xu": 3, "trustworthi": [3, 28], "onlin": [3, 26], "experi": [3, 7, 8, 15, 20, 22, 34], "practic": [3, 9, 20, 27, 29], "cambridg": 3, "2020": [3, 7], "mb72": [3, 20], "mai": [3, 9, 27], "karl": 3, "bemesderf": 3, "inquiri": 3, "duxburi": 3, "1972": 3, "mjel21": [3, 7, 8], "elli": 3, "monk": 3, "jr": 3, "michael": [3, 7, 9], "h": [2, 3, 5, 6, 22, 30], "esposito": 3, "hedwig": 3, "lee": 3, "behold": 3, "inequ": [3, 34], "return": [3, 4, 5, 6, 7, 8, 27], "physic": [3, 7, 8, 17], "attract": [3, 7, 8], "unit": [3, 4, 6, 7, 10, 28, 34], "state": [3, 5, 6, 7, 9, 10, 17, 20, 34], "127": 3, "194": 3, "241": 3, "doi": 3, "1086": 3, "715141": 3, "ros17": [3, 17], "rosenbaum": 3, "causal": [3, 7, 8, 9, 20, 22, 30], "infer": [3, 6, 20, 30, 33], "harvard": [3, 7, 17], "15176619": 3, "sch21": [3, 34], "jonathan": 3, "schwabish": 3, "better": [2, 3, 4, 9, 10, 17, 20, 22, 25, 26, 27, 28, 29, 34], "scholar": 3, "wonk": 3, "15473733": 3, "smg": [3, 34], "12": [2, 3, 9, 27, 28, 29, 33, 34], "lisa": [3, 9], "shu": 3, "nina": 3, "mazar": 3, "francesca": 3, "gino": 3, "dan": 3, "ari": 3, "max": [3, 33], "bazerman": 3, "sign": [2, 3, 4, 7, 13, 22, 25, 28, 34], "begin": [3, 6, 9, 20, 22, 30, 34], "make": [2, 3, 4, 5, 6, 9, 10, 13, 17, 20, 25, 27, 28, 30, 31, 32, 34], "ethic": [3, 20, 34], "salient": [3, 34], "decreas": [3, 4, 7, 34], "dishonest": [3, 34], "report": [3, 9, 10, 20, 29, 30, 34], "comparison": [3, 9, 17, 20, 30, 34], "end": [3, 9, 25, 30, 34], "proceed": 3, "academi": 3, "109": 3, "38": 3, "15197": 3, "15200": 3, "sns21": [3, 34], "uri": 3, "simonsohn": 3, "leif": 3, "nelson": 3, "joe": 3, "simmon": 3, "98": [3, 30], "evid": [3, 10, 17, 34], "fraud": [3, 22], "influenti": [3, 34], "field": [3, 15, 29, 31, 32, 34], "dishonesti": 3, "colada": [3, 22], "datacolada": 3, "sno49": [3, 17], "snow": [3, 17], "On": [3, 20, 28], "mode": 3, "commun": [3, 10, 34], "cholera": [3, 17], "churchil": 3, "1849": 3, "ste23": [3, 9], "megan": 3, "stevenson": [3, 9], "structur": [2, 3, 28, 30, 34], "world": [2, 3, 10, 22, 25, 34], "law": [3, 5, 6, 9, 17], "2023": [3, 20], "sbl17": [3, 34], "dragana": 3, "stojmenovska": 3, "thij": 3, "bol": 3, "thoma": 3, "leopold": 3, "857": 3, "867": 3, "steven": 3, "strogatz": 3, "chanc": [3, 10, 15, 22, 30], "york": [3, 9], "time": [2, 3, 5, 6, 7, 10, 12, 15, 18, 20, 22, 27, 28, 30], "2010": 3, "archiv": 3, "nytim": 3, "com": [3, 18, 28, 33], "opinion": [3, 9, 29], "blog": 3, "04": 3, "25": [2, 3, 4, 18, 20, 22, 30, 34], "tijm": 3, "9781107658561": 3, "id": 34, "fjprjj65hwic": [], "tk83": [3, 22], "amo": 3, "tverski": 3, "daniel": 3, "kahneman": 3, "extension": 3, "versu": [3, 9], "intuit": 3, "conjunct": 3, "fallaci": 3, "judgment": [3, 10], "293": 3, "1983": 3, "yul99": [3, 7, 8], "udni": [3, 7, 8], "yule": [3, 7, 8], "investig": [3, 7, 8, 9, 22, 34], "pauper": [3, 7, 8], "england": [3, 7, 8], "chiefli": 3, "dure": 3, "last": [3, 9, 20, 30, 34], "intercens": 3, "decad": 3, "part": [3, 10, 22, 30, 34], "62": [3, 29, 33], "249": 3, "295": 3, "1899": 3, "previous": [4, 7], "summar": [2, 4, 28], "histogram": [4, 5, 6, 15, 18, 30, 32], "represent": [4, 22], "sometim": [4, 7, 9, 22, 26, 28, 34], "lack": [2, 4, 9, 20, 30, 34], "precis": [4, 5, 6, 27, 34], "so": [4, 7, 9, 12, 13, 17, 18, 20, 22, 25, 26, 27, 28, 29, 30, 31, 32, 34], "now": [2, 4, 7, 18, 27, 28, 30, 33, 34], "distribut": [4, 5, 6, 7, 15, 22, 28, 29], "number": [4, 5, 6, 9, 10, 13, 20, 22, 25, 26, 27, 29, 30, 31, 32, 34], "its": [2, 4, 5, 6, 7, 9, 10, 13, 17, 22], "altern": [4, 7, 9, 17, 22], "includ": [2, 4, 9, 10, 11, 15, 17, 22, 26, 28, 30, 31, 32, 34], "median": [4, 13], "interquartil": 4, "rang": [4, 5, 6, 28], "respect": [4, 22, 28, 29], "n": [4, 5, 6, 7, 22, 28, 30], "sum": [2, 4, 13, 22, 30, 34], "divid": [4, 17, 20, 22], "notat": [4, 15, 22, 28, 30], "bar": [4, 34], "mu": 4, "prefer": [4, 17, 22, 25, 27, 30], "summat": 4, "frac": [2, 4, 5, 6, 7, 22, 28, 30], "sum_": [4, 7, 28], "x_i": [4, 7], "middl": 4, "even": [4, 5, 6, 9, 20, 22, 25, 29, 30], "less": [2, 4, 5, 6, 7, 9, 17, 22, 27, 28, 29, 30], "affect": [2, 4, 9, 34], "extrem": [4, 7, 18, 28, 34], "have": [2, 4, 5, 6, 7, 8, 9, 10, 11, 13, 17, 18, 20, 22, 26, 27, 28, 29, 30, 31, 32, 33, 34], "both": [4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 30, 34], "similar": [2, 4, 5, 6, 7, 9, 20, 22, 28, 30, 34], "symmetr": [4, 18, 34], "extend": [4, 18], "94": 4, "increas": [4, 5, 6, 7, 8, 9, 22, 28, 30, 34], "5": [2, 4, 5, 6, 10, 13, 18, 20, 22, 28, 29, 33, 34], "repres": [4, 5, 6, 7, 22, 29, 30, 34], "might": [4, 5, 6, 7, 8, 9, 10, 13, 17, 20, 22, 25, 27, 28, 29, 30, 31, 32, 34], "often": [2, 4, 7, 9, 13, 20, 22, 27, 28, 29, 34], "avoid": [4, 9, 20, 34], "influenc": [4, 7, 8, 9], "fig": [2, 4, 7, 20, 22, 28, 34], "15": [4, 18, 22, 29, 34], "show": [2, 4, 5, 6, 7, 8, 9, 11, 14, 18, 20, 22, 28, 33, 34], "skew": [4, 18, 34], "vertic": [4, 28, 34], "which": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 26, 28, 29, 30, 31, 32, 34], "mark": [4, 7, 15, 30], "heavier": 4, "orang": [2, 4, 7, 8, 9], "white": [4, 9, 34], "while": [4, 25, 28, 29], "equal": [2, 4, 10, 11, 13, 20, 22, 25, 28, 30, 34], "area": [4, 6, 11, 20, 22, 26, 34], "side": [2, 4, 9, 17, 22], "balanc": [4, 5, 6], "imagin": [2, 4, 9, 17, 20, 22, 28, 29], "tip": [4, 34], "toward": [4, 22, 34], "long": [4, 5, 6, 9, 13, 22, 34], "tail": [4, 5, 6, 13, 18, 22, 34], "leverag": [4, 13, 17], "exert": 4, "size": [4, 5, 6, 7, 10, 11, 17, 28, 30, 34], "aka": 4, "entri": 4, "sqrt": [4, 5, 6, 7, 22, 28], "m": [4, 22, 28], "absolut": [4, 5, 6, 11, 12, 13], "fit": [4, 28, 30, 33, 34], "algebra": [4, 15, 28], "statistician": [4, 7, 8, 10, 28, 34], "get": [4, 5, 6, 7, 8, 9, 13, 15, 17, 20, 22, 25, 27, 29, 33], "notion": [4, 10], "take": [2, 4, 6, 7, 8, 9, 10, 15, 17, 20, 22, 27, 30], "measur": [4, 7, 8, 9, 10, 20, 28, 30, 34], "refer": [4, 10, 12, 22, 25, 30, 34], "singl": [2, 4, 6, 9, 13, 17, 18, 22, 28, 29, 30, 34], "rm": [4, 28], "tabl": [2, 4, 7, 8, 20, 26, 28, 30, 34], "complic": [4, 9, 25, 27, 31, 32], "our": [4, 5, 6, 9, 10, 22, 26, 27, 28, 30], "technic": [4, 34], "oppos": 4, "These": [4, 9, 10, 12, 15, 18, 22, 30, 34], "slightli": 4, "instead": [4, 5, 6, 7, 9, 11, 15, 20, 22, 27, 28, 29, 34], "appreci": [4, 7, 28], "sheet": [4, 5, 6, 11, 13, 27, 30, 31, 32, 33, 34], "stdevp": [4, 13, 31, 32], "cover": [4, 9, 18, 28, 34], "subset": [4, 13, 20, 22, 29], "larger": [4, 5, 6, 22, 29, 34], "later": [4, 9, 13, 17, 18, 27, 30, 33], "cours": [4, 9, 15, 17, 18, 20, 27, 29, 31, 32, 33], "entir": [4, 9, 10, 13, 15, 28], "think": [2, 4, 9, 10, 18, 20, 22], "term": [2, 4, 5, 6, 28, 29, 30, 34], "predict": [4, 7, 8, 9, 28, 33], "algorithm": 4, "guess": [4, 5, 6, 22, 27, 28], "expect": [2, 4, 5, 6, 7, 8, 9, 10, 13, 18, 20, 30, 34], "keep": [4, 33], "vagu": 4, "68": [4, 5, 6, 28], "95": [4, 5, 6, 28], "thumb": [4, 34], "explain": [2, 4, 9, 20, 22, 27, 28, 30, 34], "yardstick": 4, "roughli": [4, 27], "one": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 20, 22, 25, 27, 28, 29, 30, 34], "true": [2, 4, 5, 6, 9, 12, 20, 29], "between": [4, 5, 6, 7, 8, 9, 11, 17, 18, 20, 22, 28, 29, 34], "fals": [2, 4, 9, 20, 30, 33], "justifi": [4, 5, 6, 7, 8, 18], "suppos": [2, 4, 5, 6, 9, 12, 17, 20, 22, 26, 28, 29, 30, 34], "taylor": [4, 34], "swift": [4, 34], "launch": 4, "own": [4, 9, 17, 20, 27, 30, 34], "network": 4, "member": [4, 9, 20, 22], "nobodi": [4, 22, 34], "els": [4, 10, 22, 25, 27], "As": [4, 9, 17, 18, 20, 22], "courtesi": 4, "everyon": [4, 10, 20, 28], "back": [2, 4, 13, 22, 27, 28], "illustr": [4, 6, 30], "possibl": [4, 9, 13, 17, 18, 20, 22, 25, 28, 30, 34], "three": [2, 4, 7, 8, 9, 12, 13, 17, 22, 29, 30, 33, 34], "seven": 4, "twelv": 4, "yellow": 4, "circl": [4, 22], "greater": [4, 7, 11, 18, 22, 28, 30], "than": [2, 4, 5, 6, 7, 9, 10, 17, 18, 20, 22, 26, 27, 28, 29, 30, 33, 34], "c": [2, 4, 9, 12, 13, 18, 22, 30], "ever": 4, "exce": [4, 22], "ha": [2, 4, 5, 6, 7, 10, 17, 18, 20, 22, 28, 29, 30, 34], "13": [4, 20, 22, 30, 34], "hold": [4, 18, 25], "1989": 4, "formula": [4, 5, 6, 12, 28, 30, 33], "euclidean": 4, "distanc": [4, 28], "coordin": [4, 13, 22], "system": 4, "without": [2, 4, 7, 8, 9, 10, 12, 13, 17, 22, 30, 34], "relationship": [7, 8, 9, 20, 22, 28, 30], "explor": [7, 8, 17, 34], "notic": [7, 8, 28], "trend": [7, 8, 20, 28, 34], "shape": [6, 7, 8, 18, 28, 30, 34], "inch": [7, 8], "65": [7, 8, 29, 33], "59": [7, 8, 33, 34], "63": [7, 8, 30, 33], "slope": [7, 8, 12, 30, 33], "upward": [7, 8], "downward": [7, 8], "neg": [2, 5, 6, 7, 8, 9, 17, 18, 20, 28, 34], "strong": [7, 8], "indic": [2, 7, 8, 17, 20, 22, 30], "hi": [2, 7, 8, 9, 12, 17, 20], "shown": [7, 8, 13, 18, 30], "axi": [7, 8, 18, 28, 30, 34], "thought": [2, 5, 6, 7, 8, 9], "languag": [7, 8, 13, 20, 22, 27], "suggest": [7, 8, 17, 18, 22, 33, 34], "direct": [7, 8, 15, 33], "hypothes": [7, 8, 34], "class": [7, 8, 11, 13, 17, 30, 34], "cautiou": [7, 8], "claim": [7, 8, 17, 20], "ahead": [7, 8, 9], "too": [2, 7, 8, 9, 17, 27, 30], "much": [7, 8, 9, 10, 13, 18, 28, 30, 34], "angst": [7, 8], "hesit": [7, 8], "readi": [7, 8, 17], "humbl": [7, 8], "ultim": [7, 8, 30, 34], "backward": [7, 8, 9], "hour": [7, 8, 18, 28], "sleep": [7, 8, 18, 28], "perform": [7, 8, 9, 28], "dai": [7, 8, 22, 28, 30], "public": [7, 8, 29], "assist": [7, 8], "welfar": [7, 8], "poverti": [7, 8], "incom": [7, 8, 9, 20, 28, 29, 30, 34], "tempor": [7, 8], "preced": [7, 8], "choic": [2, 7, 8, 9, 17, 20, 22, 28, 30, 33], "consid": [2, 7, 8, 9, 10, 18, 20, 30, 34], "don": [2, 7, 8, 9, 17, 20, 22, 25, 27, 29, 31, 32, 34], "stanc": [7, 8], "spend": [7, 8, 28], "believ": [7, 8, 9, 20], "promot": [7, 8, 20], "break": [7, 8, 9, 27], "lead": [2, 7, 8, 9, 29], "compat": [7, 8], "recogn": [7, 8], "respond": [7, 8, 20, 29, 34], "level": [7, 8, 9, 20, 22, 28, 34], "examin": [7, 8, 9, 18], "figur": [2, 6, 7, 8, 9, 18, 27, 34], "denot": [7, 30], "free": [7, 13, 17, 20], "cluster": [7, 8], "around": [7, 8, 28], "fall": [5, 6, 7, 8], "matter": [2, 7, 9, 10, 22, 27, 28], "shouldn": [7, 9, 20], "confus": [7, 30], "tight": 7, "perfectli": [7, 30], "linearli": [7, 28], "200": [2, 5, 6, 7, 17, 30, 34], "moder": 7, "lower": [7, 9, 18, 20, 30], "drag": [7, 28], "delet": 7, "individu": [2, 7, 9, 17, 22, 29, 30, 34], "twice": [7, 30], "natur": [5, 6, 7, 9, 15, 22, 28, 33, 34], "sens": [7, 10, 28], "correlaton": 7, "80": [2, 5, 6, 7, 20, 34], "sai": [5, 6, 7, 10, 17, 20, 22, 27, 28, 34], "deeper": [7, 15], "stronger": [7, 20], "adjust": [7, 20, 22, 34], "nois": [5, 6, 7, 28], "paramet": [7, 29], "few": [2, 7, 10, 15, 18, 25, 27, 28, 34], "tend": [7, 9, 22], "unless": [7, 27], "underscor": [7, 20], "product": [2, 7, 20, 30, 34], "standard": [5, 6, 7, 10, 20, 26, 27, 28, 31, 32], "_x": [7, 28], "sd": [5, 6, 7, 13, 18, 28, 30, 31, 32, 33], "y_i": 7, "_y": [7, 28], "move": [7, 9, 34], "togeth": [7, 22, 30], "opposit": [7, 30], "goe": [7, 9, 20, 30, 34], "up": [2, 5, 6, 7, 9, 18, 22, 27, 29, 30, 34], "down": [2, 5, 6, 7, 10, 12, 17, 20, 28, 34], "quadrant": 7, "push": [7, 30], "right": [2, 5, 6, 7, 9, 12, 13, 20, 22, 27, 28, 34], "eight": [2, 7, 22], "must": [2, 7, 9, 17, 18, 22, 30], "zero": [5, 6, 7, 12, 18, 20, 22, 28, 34], "cdot": [2, 5, 6, 7, 22, 30], "Then": [5, 6, 7, 17, 22, 28, 30, 32], "dfrac": [7, 18, 30], "prime": 7, "unchang": 7, "per": [7, 10, 13, 28], "corrrel": 7, "footbal": [7, 28], "meant": [7, 15, 29, 34], "obvious": 7, "surprisingli": 7, "precic": 7, "aris": [7, 18, 20, 22, 28], "bell": [6, 7, 18, 34], "taper": 7, "come": [5, 6, 7, 9, 10, 17, 18, 20, 22, 28, 34], "fewer": [7, 9, 17, 25, 28, 34], "anscomb": 7, "quartet": 7, "four": [7, 22, 30], "demonstr": [5, 6, 7, 18, 20, 22, 28, 30], "panel": [7, 20, 34], "obviou": [7, 17, 27], "rate": [7, 18, 20, 30, 34], "phrase": [2, 7], "impli": [7, 18, 20, 34], "utter": [7, 9], "recognit": 7, "quantifi": [5, 6, 7, 20], "highli": 7, "spuriou": 7, "confound": [7, 9, 17, 20, 30], "third": [7, 30, 31, 32], "give": [2, 7, 12, 17, 18, 22, 29, 30], "misinterpret": [7, 28], "articl": [7, 34], "leader": 7, "stop": 7, "One": [5, 6, 7, 9, 22, 29, 30], "classic": [7, 17], "economist": 7, "ebai": 7, "analyz": [7, 10, 17, 20], "conduct": 7, "found": [2, 5, 6, 7, 12, 18, 20, 22, 28, 34], "were": [2, 7, 9, 10, 12, 17, 20, 22, 30, 34], "larg": [5, 6, 7, 9, 10, 15, 17, 22, 34], "wast": 7, "despit": [7, 9, 20, 34], "market": 7, "team": [2, 7], "advertis": 7, "target": 7, "shop": [5, 6, 7, 29, 34], "custom": [5, 6, 7, 11, 17, 20, 34], "pre": [7, 9, 15, 34], "exist": [7, 9], "purchas": 7, "decis": [7, 20], "made": [2, 5, 6, 7, 10, 12, 17, 20, 22, 34], "mistak": [7, 12, 34], "underappreci": 7, "factor": [5, 6, 7, 9, 13, 30], "wa": [7, 9, 10, 17, 20, 22, 26, 27, 28, 34], "higher": [7, 17, 18, 20, 28, 30, 34], "sale": 7, "interest": [2, 7, 9, 13, 20, 22, 28, 29, 30, 33, 34], "spent": 7, "regardless": [2, 7, 20, 29], "polic": [7, 30], "crime": [7, 30], "highlight": [7, 20, 34], "chicken": [7, 30, 34], "egg": [7, 27, 30], "problem": [2, 7, 9, 17, 22, 27, 29, 30], "washington": 7, "post": [7, 9, 20], "conclud": [7, 30], "local": [7, 29], "over": [5, 6, 7, 9, 10, 17, 18, 20, 22, 25, 27, 29, 30, 34], "60": [5, 6, 7, 28, 29, 34], "mislead": [7, 20], "driver": 7, "scenario": [7, 9, 28], "fact": [2, 5, 6, 7, 10, 18, 20, 29], "reduct": [7, 10], "1800": 7, "naiv": [7, 20], "itself": [7, 13], "movi": 7, "theater": 7, "clerk": 7, "want": [2, 7, 9, 12, 15, 22, 26, 27, 28, 29, 30, 33], "daili": [7, 9], "ticket": [2, 5, 6, 7, 22, 30], "matt": [7, 30], "damon": [7, 30], "wahlberg": [7, 30], "he": [7, 9, 17, 20, 22], "record": [7, 34], "week": [7, 30], "mondai": [7, 30], "tuesdai": [7, 30], "wednesdai": [7, 30], "mix": [7, 9, 13, 34], "oop": 7, "mess": [7, 27], "again": [2, 7, 9, 18, 20, 22, 30, 31, 32, 33], "turn": [2, 7, 20, 28], "initi": [7, 9, 22, 30], "correct": [7, 10, 22, 25, 27, 29], "journalist": 7, "bloat": 7, "colleg": [7, 17, 18], "hire": [7, 9, 28], "faculti": [7, 9], "employe": [7, 28], "focus": [7, 30, 33, 34], "thei": [2, 5, 6, 7, 9, 10, 15, 17, 20, 22, 27, 28, 29, 30, 34], "mani": [2, 5, 6, 7, 9, 15, 17, 18, 20, 22, 26, 28, 29, 30, 34], "campus": [7, 17], "monei": [7, 20, 28, 30], "trust": 7, "write": [2, 5, 6, 7, 20, 25, 27, 28, 30, 31, 32], "accus": 7, "school": [7, 9, 15, 17, 18, 20, 30], "award": [7, 30], "driven": [7, 10, 34], "merit": [7, 30], "why": [7, 9, 10, 20, 22, 28, 34], "befor": [2, 9, 15, 17, 20, 22, 27, 30, 34], "continu": [9, 18, 20, 30, 34], "next": [2, 9, 12, 22, 26, 27, 28, 29, 34], "vaccin": 9, "prevent": [9, 31, 32], "excus": 9, "charter": [9, 17], "produc": [9, 15, 27, 32, 34], "outcom": [2, 5, 6, 9, 17, 22], "Will": 9, "my": [2, 9, 20, 22, 27, 30, 34], "cuni": 9, "At": [9, 20, 28], "peak": [9, 34], "seek": 9, "impact": [9, 17, 22, 34], "intervent": 9, "guidanc": 9, "polici": [9, 17], "similarli": [9, 13, 28], "attribut": [9, 20], "student": [9, 15, 17, 18, 22, 30], "success": [5, 6, 9, 13, 34], "attend": [9, 17, 20], "mere": [9, 17, 34], "manag": 9, "degre": [9, 13], "predictor": 9, "qualif": 9, "job": [9, 13, 27, 28], "intellig": 9, "easi": [9, 17, 20, 27, 28, 29], "train": 9, "those": [9, 10, 17, 20, 22, 27, 28, 29, 30, 31, 32], "qualiti": [2, 9, 17, 29, 30, 34], "purpos": [9, 10, 13, 26, 27, 28, 34], "possess": 9, "arriv": [9, 22, 28], "campu": 9, "could": [2, 9, 17, 20, 22, 27, 28, 29, 30, 34], "resum": 9, "perhap": [9, 25, 29, 34], "genet": 9, "water": [9, 17, 34], "hometown": 9, "format": 9, "preschool": 9, "valuabl": 9, "signal": 9, "remain": [2, 9, 20, 22], "shock": 9, "scandal": 9, "prestig": 9, "thu": [5, 6, 9, 28, 30, 34], "fun": 9, "marvel": 9, "jordan": 9, "basketbal": [2, 9, 28], "career": 9, "shakespear": 9, "categor": [9, 34], "earli": [9, 17, 30], "surfac": 9, "explicit": [9, 22, 27], "propos": [9, 20], "theori": [9, 17, 34], "theoriz": [9, 28], "creep": 9, "territori": 9, "themselv": 9, "tell": [2, 9, 20, 22, 27, 30, 33], "challeng": 9, "simplist": 9, "reliabl": [9, 10, 17, 20], "practition": 9, "speak": [9, 22, 27], "hiearchi": 9, "simpl": [9, 27, 28, 33, 34], "hierarchi": 9, "base": [2, 5, 6, 9, 10, 15, 20, 22, 28, 29, 30, 34], "systemat": [9, 28, 29], "meta": 9, "analysi": [9, 10, 13, 15, 17, 20, 28], "anecdot": 9, "expert": [9, 29], "vitamin": [9, 20], "improv": [9, 20, 28, 30], "progress": [9, 17, 21], "method": [9, 20, 22, 34], "treatment": [9, 15, 17, 20, 30], "treat": [9, 20, 27], "group": [5, 6, 9, 17, 20, 22, 29, 30, 34], "Their": [9, 13], "compar": [5, 6, 9, 17, 20, 25, 34], "clip": 9, "simpson": 9, "sell": 9, "tiger": 9, "repel": 9, "rock": 9, "father": [9, 12, 28, 33], "she": [2, 9, 20, 22], "abl": [9, 17, 27, 34], "appeal": 9, "homer": 9, "presenc": 9, "suffer": [9, 13], "attack": 9, "prowl": 9, "springfield": 9, "courtroom": 9, "pose": 9, "But": [5, 6, 9, 10, 17, 20, 22, 30, 34], "defend": 9, "action": 9, "harm": 9, "occur": [9, 20, 22, 29, 30], "onc": [9, 22, 26], "anoth": [2, 5, 6, 9, 10, 13, 17, 22, 25, 30, 34], "Not": [9, 10, 30, 34], "yet": [5, 6, 9], "relev": [9, 10, 17, 28, 30], "With": [9, 20, 22, 30], "dissimilar": 9, "fulli": [9, 29], "afford": 9, "baselin": [9, 34], "behavior": [9, 22], "To": [5, 6, 9, 13, 20, 26, 28, 30, 31, 32], "understood": [9, 28, 29, 30], "bad": [2, 9, 17, 22, 25, 27, 28, 30, 34], "exactli": [9, 22, 28, 34], "chosen": [2, 9, 17, 25, 34], "express": [2, 5, 6, 9], "wouldn": [9, 29], "ensur": [9, 12, 27, 30], "them": [2, 5, 6, 9, 20, 27, 34], "eat": [9, 20], "healthier": [9, 20, 34], "said": [9, 20, 22], "contemporan": 9, "enlist": 9, "navi": 9, "18th": 9, "centuri": 9, "sailor": 9, "ate": 9, "hardtack": 9, "interven": 9, "regimen": 9, "closer": [9, 20, 33, 34], "period": [9, 10, 30], "threaten": 9, "valid": [9, 30], "black": [9, 29, 33], "account": [5, 6, 9, 18, 29, 30], "demograph": [9, 29, 34], "bone": 9, "procedur": 9, "femur": 9, "hard": [9, 22, 27, 28, 34], "dramat": 9, "socioeconom": 9, "statu": [9, 17], "unlik": [5, 6, 9, 20, 29], "biolog": 9, "process": [5, 6, 9, 18, 22, 28, 34], "heal": 9, "ai": 9, "task": [9, 26], "worth": [5, 6, 9, 22, 34], "run": [5, 6, 9, 20, 22, 25, 26, 27, 28, 31, 32, 33], "invol": 9, "lot": [9, 13, 20, 28, 32, 34], "try": [2, 9, 20, 22, 30], "stuff": [9, 33], "happen": [9, 13, 20, 22, 25, 26, 28], "placebo": 9, "particip": [9, 22], "pain": 9, "blind": [9, 30], "doubl": [9, 22, 30], "someon": [9, 10, 13, 18, 20, 27, 28, 29, 30], "evalu": 9, "shan": 9, "carri": [5, 6, 9, 22], "awai": [2, 9, 22, 34], "caution": [9, 22], "literatur": [9, 17], "full": 9, "paper": [9, 22], "rigor": 9, "somehow": [9, 22], "suffus": 9, "through": [2, 9, 15, 20, 28, 34], "folli": 9, "overst": 9, "facebook": [9, 17], "notif": 9, "reduc": [9, 33, 34], "activ": [9, 22, 34], "crimin": 9, "legal": 9, "space": [9, 34], "scale": [9, 11, 17, 28, 34], "expans": [2, 9, 17], "program": [9, 20, 25, 27], "tough": 9, "scare": [9, 13], "straight": 9, "ones": 9, "barack": 9, "obama": 9, "brother": 9, "keeper": 9, "note": [2, 5, 6, 9, 13, 15, 18, 22, 25, 26, 27, 30, 33, 34], "engin": 9, "cautious": 9, "jame": 9, "lind": 9, "scurvi": 9, "debilit": 9, "defici": 9, "scourg": 9, "british": 9, "1742": 9, "surgeon": [9, 10, 20], "hm": 9, "salisburi": 9, "cure": 9, "chose": 9, "seamen": 9, "ident": [5, 6, 9, 17, 22], "diet": [9, 20, 28], "form": [2, 9, 10, 27, 34], "six": [9, 27, 28], "supplement": [9, 15], "food": [9, 28], "ration": 9, "extra": 9, "lemon": 9, "acid": 9, "though": [9, 10, 17, 18, 20, 25, 28], "sampl": [2, 9, 10, 12, 13, 15, 18], "pioneer": 9, "citru": 9, "eater": 9, "britain": 9, "limei": 9, "quickli": [9, 26], "incontrovert": 9, "emerg": [9, 18], "wrong": [2, 9, 20, 22, 27, 30], "approach": [5, 6, 9, 30], "didn": [2, 9, 20, 27], "role": [9, 20, 34], "got": [2, 5, 6, 9, 20, 28], "essenti": [9, 17, 20, 30], "recommend": [9, 15, 34], "disciplin": [9, 10], "indulg": 9, "chain": 9, "cider": 9, "therefor": [2, 5, 6, 9, 17, 18, 22, 30], "luckili": [9, 17, 27], "otherwis": [5, 6, 9, 17, 34], "attempt": [9, 15, 17, 30, 34], "scientif": 9, "integr": 9, "beyond": [9, 15, 18, 30, 33, 34], "ly": 9, "put": [2, 9, 22, 30], "famou": [9, 34], "cargo": 9, "cult": 9, "address": 9, "honesti": [9, 34], "lean": 9, "re": [2, 9, 10, 12, 22, 27, 34], "invalid": 9, "ve": [9, 20, 22, 31, 32, 34], "elimin": [9, 17], "sure": [9, 27], "fellow": 9, "been": [9, 17, 20, 34], "detail": [9, 17, 34], "throw": [9, 22], "doubt": 9, "all": [2, 5, 6, 9, 10, 11, 13, 17, 18, 22, 26, 27, 28, 29, 30, 34], "final": [9, 10, 22, 29], "forget": [9, 27], "mostli": [9, 10, 28], "look": [9, 10, 12, 20, 22, 28, 29], "conundrum": 9, "zealot": 9, "st": 9, "joseph": 9, "mari": 9, "classroom": 9, "innov": 9, "adopt": 9, "judg": [9, 10], "failur": 9, "dismiss": 9, "ask": [2, 9, 22, 27, 29, 34], "known": [2, 9, 29, 33], "pupil": 9, "curriculum": 9, "academ": 9, "stand": [9, 25, 28], "teacher": 9, "governor": 9, "mechan": [9, 17], "whether": [9, 20, 22, 28, 34], "appli": [2, 5, 6, 9, 15, 20, 22, 28, 30], "adapt": 9, "successfulli": 9, "sentenc": [9, 10, 27], "easili": 9, "comfort": [9, 10, 15, 20], "ambigu": [9, 10, 27, 28], "toler": [9, 29], "slow": 9, "build": 9, "000": [2, 9, 20, 29, 30, 34], "20": [2, 5, 6, 9, 20, 22, 28, 29, 33, 34], "electr": [9, 30], "toothbrush": [9, 30], "vs": [9, 28, 30, 31, 32], "fail": [9, 10, 30, 34], "lotteri": [9, 17], "due": [9, 30], "intern": 9, "revenu": [9, 34], "servic": [9, 29], "audit": 9, "taxpay": 9, "high": [2, 9, 15, 17, 18, 20, 28, 34], "fat": 9, "low": [2, 9, 13, 20, 28], "rand": [9, 20], "insur": [9, 20, 34], "util": 9, "hypothesi": [9, 15, 34], "comprehens": 9, "coverag": 9, "overus": 9, "cost": [9, 20], "simplif": [9, 20], "partial": [9, 29], "potenti": [9, 17, 29], "attrit": 9, "remov": [9, 22, 34], "substanti": 9, "across": [9, 13, 17, 34], "problemat": 9, "intens": 9, "specul": 9, "deliv": 9, "caltech": 9, "1974": 9, "commenc": 9, "defin": [10, 17, 20, 26, 27, 30], "definit": [10, 17, 30], "broader": 10, "collect": [10, 18, 22, 28, 34], "imag": 10, "smell": 10, "audio": 10, "nsa": 10, "troubl": [2, 10], "machineri": 10, "disori": 10, "jumbl": 10, "technolog": 10, "extract": 10, "tool": 10, "art": [10, 20], "numer": [2, 10, 22, 26, 29], "conjectur": 10, "puzzl": 10, "concern": [10, 22, 29, 34], "wikipedia": 10, "present": [10, 29, 34], "well": [10, 20, 22, 28, 33, 34], "emphas": [10, 28, 34], "endeavor": 10, "summari": [10, 33], "map": [10, 22], "simplifi": [10, 22, 30, 31, 32], "spatial": 10, "oversimplifi": [10, 34], "applic": [2, 10, 13, 15, 22, 27, 33, 34], "inde": [5, 6, 10, 20], "logic": [10, 27], "rhetor": 10, "brain": 10, "forward": 10, "gambl": 10, "win": [5, 6, 10, 17, 22, 25], "million": [2, 10, 20], "89": [10, 12], "39": [5, 6, 10, 29, 34], "accord": [5, 6, 10, 18, 22, 30], "insist": [10, 27], "risk": [2, 5, 6, 10], "decid": [10, 20, 30], "comput": [10, 26, 27], "worst": [5, 6, 10, 30], "won": [10, 13, 22, 34], "sensit": 10, "lost": 10, "implicit": [10, 27], "disappoint": [10, 20], "resolv": 10, "slowli": [5, 6, 10], "1890": 10, "publish": [10, 17], "smoke": [10, 20], "lung": 10, "cancer": [2, 10, 20, 30], "until": 10, "1964": [10, 20], "wasn": [10, 17], "adequ": 10, "captur": [10, 28], "rather": [10, 17], "certain": [10, 17, 18], "met": 10, "spotifi": [10, 30, 34], "song": [2, 10, 22, 30, 34], "total": [2, 10, 20, 22, 30, 34], "plai": [2, 10, 20], "track": 10, "had": [10, 17, 18, 20, 28], "recent": [10, 17, 30], "deriv": [10, 34], "inher": [5, 6, 10], "develop": [10, 15, 28, 34], "rank": [10, 17], "briefli": 10, "caveat": [10, 30], "hint": 10, "garth": 10, "brook": 10, "biggest": 10, "hit": [10, 22, 26], "wonder": 10, "plural": 10, "datum": 10, "That": [10, 20, 22, 30], "grammat": 10, "puppi": 10, "chart": [11, 34], "editor": [11, 34], "default": [11, 31, 32], "densiti": [11, 34], "height": [11, 12, 28, 33, 34], "block": [11, 25, 34], "reflect": [5, 6, 11], "frequenc": [5, 6, 11, 30], "interv": [11, 28, 34], "width": [11, 34], "bucket": 11, "option": 11, "rightarrow": 11, "draw": [2, 5, 6, 11, 30, 34], "distinct": [11, 28, 30], "taller": 11, "linest": [12, 28, 33], "usag": [12, 13], "a2": 12, "a10": [12, 13], "b2": [12, 22], "b10": [12, 13], "verbos": 12, "output": [12, 25, 28, 32], "signific": [12, 20], "galton": [12, 18], "170": 12, "hat": [12, 28, 33], "mx": [12, 28], "spreadsheet": [2, 12, 34], "store": [12, 27, 34], "a1079": 12, "b1079": 12, "51": [2, 12, 29], "33": [12, 14, 22, 28, 33], "intercept": [12, 28, 33], "furthest": 12, "75": [12, 29, 30], "tallest": 12, "approx": [2, 5, 6, 12], "72": 12, "separ": [12, 28, 34], "tab": [12, 13, 34], "g2": 12, "f2": 12, "referenc": [12, 13], "frozen": 12, "replac": [2, 5, 6, 12, 22, 25, 30], "a3": 12, "c2": 12, "enter": [12, 13], "d2": 12, "rest": [12, 28, 34], "saniti": 12, "check": [12, 27, 34], "f14": 12, "64884635": 12, "round": [12, 20, 34], "excel": [13, 27, 31, 32, 33], "avail": [13, 17, 22, 26, 29], "internet": 13, "browser": [13, 27], "microsoft": 13, "bit": [13, 34], "advantag": [13, 22], "toolpak": 13, "plugin": 13, "abil": 13, "alon": [13, 28], "manipul": [13, 17, 34], "invest": 13, "arithmet": 13, "workbook": 13, "syntax": [13, 25, 26, 27, 31, 32], "mous": 13, "specifi": [13, 17, 20], "rectangular": 13, "b1": 13, "c1": [13, 28], "entireti": 13, "2x2": 13, "cannot": [2, 13, 17, 20, 22], "insert": 13, "power": [13, 15], "behav": 13, "plain": [13, 27], "rel": 13, "dollar": [13, 20, 28, 34], "front": [13, 20, 22], "offer": [13, 17, 27], "hundr": [5, 6, 13, 17], "sever": [13, 22], "categori": 13, "math": [13, 15, 22, 30], "commonli": 13, "appar": [13, 34], "correl": [13, 15, 22, 28, 33, 34], "covar": 13, "percentil": [13, 26], "var": 13, "varp": 13, "stdev": 13, "normdist": 13, "std": 13, "dev": 13, "cumul": [5, 6, 13, 18], "binomdist": [5, 6, 13], "num": 13, "chidist": 13, "freedom": 13, "chisq": 13, "dist": 13, "tdist": 13, "norminv": 13, "tinv": 13, "invers": 13, "IF": 13, "logical_express": 13, "value_if_tru": 13, "value_if_fals": 13, "AND": 13, "OR": 13, "averageif": 13, "criteria_rang": 13, "criterion": 13, "average_rang": 13, "sumif": 13, "sum_rang": 13, "taxi": 13, "xlookup": 13, "search_kei": 13, "lookup_rang": 13, "range_result": 13, "missing_valu": 13, "match_mod": 13, "search_mod": 13, "shaq": 13, "matplotlib": [14, 33], "pyplot": 14, "plt": [14, 33], "hist": 14, "bin": 14, "99": [2, 14, 18, 30, 34], "102": 14, "contain": [2, 15, 17, 22, 30, 34], "read": 15, "companion": 15, "primari": [15, 30], "primarili": 15, "content": [5, 6, 15, 28, 34], "real": 15, "author": 15, "materi": [15, 20], "skip": [2, 15, 27], "topic": [15, 34], "brief": [15, 34], "mention": [2, 15, 30, 34], "exploratori": 15, "bay": [15, 24, 30], "theorem": [5, 6, 15, 24, 30, 34], "tree": [15, 30], "allow": [15, 17, 20, 22, 30], "extens": 15, "subject": [15, 20, 34], "broaden": 15, "exercis": 15, "drill": 15, "concept": 15, "argu": [15, 17, 28, 34], "imper": 15, "halmo": 15, "introductori": 15, "analys": 15, "taken": 15, "major": [2, 15, 20, 22, 34], "design": [15, 20], "requisit": 15, "calculu": [15, 17], "pursu": [15, 31, 32], "center": [15, 18, 34], "spread": [5, 6, 15, 28], "ii": [5, 6, 15], "bibliographi": 15, "overview": 15, "librari": [15, 33], "statwrap": [15, 28], "solut": [5, 6, 15], "irrat": 16, "voter": [16, 29], "108": 17, "skeptic": 17, "nuanc": [17, 29], "indirectli": 17, "compel": [17, 30], "broadli": 17, "absenc": 17, "seat": 17, "alloc": 17, "implement": [17, 27], "concert": 17, "instanc": [17, 20], "bounti": 17, "unconfound": [17, 20], "featur": [17, 20, 29, 30, 34], "fancier": 17, "exogen": 17, "outbreak": 17, "london": 17, "discov": [17, 28, 34], "contamin": 17, "suppli": [17, 34], "prevail": 17, "air": 17, "southwark": 17, "vauxhal": 17, "serv": [17, 34], "lambeth": 17, "purer": 17, "drove": [17, 34], "intak": [17, 20], "sewag": 17, "discharg": 17, "downstream": 17, "plausibl": [17, 20, 28], "hous": 17, "rich": [17, 20], "poor": 17, "occup": 17, "whatev": 17, "surround": 17, "devis": 17, "thoroughli": 17, "circumst": 17, "place": [2, 17, 31, 32, 34], "grandest": 17, "No": [2, 17, 20, 22, 30, 34], "thousand": 17, "station": 17, "gentlefolk": 17, "knowledg": [17, 29], "amongst": 17, "patient": [2, 17], "quit": 17, "impur": 17, "neighborhood": 17, "focu": [5, 6, 17], "determin": [17, 28, 30, 34], "haphazard": 17, "spectrum": 17, "geograph": 17, "region": [17, 18, 28, 34], "104": 17, "105": [17, 18], "grant": 17, "dutch": [17, 27], "famin": 17, "uniqu": 17, "stagger": 17, "proce": 17, "confid": [17, 22, 28, 29, 30], "rollout": 17, "prestigi": 17, "sat": [17, 18, 30], "score": [17, 18, 26, 30], "smart": 17, "decent": 17, "wider": [17, 34], "issu": [17, 22], "fair": [5, 6, 17, 22, 30], "california": 17, "tax": 17, "south": [17, 22, 34], "dakota": 17, "gdp": 17, "growth": [17, 34], "specif": [17, 20, 22, 26, 27, 28, 29, 34], "8am": [17, 30], "1pm": [17, 30], "taught": 17, "instructor": 17, "cap": 17, "switch": [17, 30, 31, 32, 34], "trade": 17, "morn": [17, 30], "debunk": 17, "hurrican": 17, "femal": [17, 29, 30], "deadli": 17, "serious": 17, "male": [17, 29, 30], "landfal": 17, "1900": 17, "date": 17, "death": [17, 20, 30], "toll": 17, "tropic": 17, "storm": 17, "season": [17, 28], "1979": 17, "ideal": [18, 22], "enorm": 18, "necessarili": [18, 22, 29, 34], "deviat": [5, 6, 18, 28, 31, 32], "infin": 18, "neglig": 18, "underneath": 18, "convert": [6, 18, 22, 28, 33], "z": [18, 26], "iq": 18, "130": 18, "ax": 18, "rescal": 18, "maintain": [18, 30], "far": [18, 34], "rare": [2, 5, 6, 18, 30, 34], "recal": [18, 27], "percentag": [5, 6, 18, 22, 25, 28, 29, 30, 34], "evenli": 18, "enough": [18, 20, 22, 27, 31, 32], "varieti": 18, "interior": 18, "fraction": [18, 22], "pm": [5, 6, 18], "nice": 18, "properti": [18, 28], "aren": [18, 27, 34], "Its": 18, "inclus": 18, "close": [5, 6, 18, 28, 34], "sneak": 18, "video": [18, 30], "bounc": 18, "bead": 18, "beauti": [18, 27], "mathemat": [18, 25, 34], "board": 18, "co": [18, 22, 30], "wptsnf1aln": 18, "pic": 18, "twitter": [18, 21], "lxohk72poz": 18, "mdash": 18, "lionel": 18, "page_eco": 18, "septemb": 18, "highest": [18, 34], "16": [5, 6, 18, 22, 34], "il": 18, "84": 18, "verifi": 18, "compet": 18, "admit": 18, "threshold": 18, "construct": [18, 28, 29], "overstat": 20, "prohibit": 20, "taker": 20, "wealthier": 20, "wealth": 20, "homogen": 20, "panacea": 20, "never": [20, 22, 27, 29, 31, 32], "hyperbol": 20, "testabl": 20, "weak": [20, 30], "richer": 20, "seem": [20, 22, 27], "Or": [2, 20, 34], "cooki": 20, "counter": [20, 22], "gadfli": 20, "characterist": [20, 29, 34], "object": [20, 26, 34], "elucid": 20, "feasibl": 20, "experiment": 20, "neither": [20, 22, 30], "wrote": [20, 34], "mind": [2, 20, 22], "imposs": [20, 30, 34], "lab": 20, "govern": 20, "forc": [20, 22], "expens": [20, 28], "400": 20, "fund": [20, 30], "revers": 20, "uc": 20, "appear": [2, 20, 28, 34], "women": [2, 20, 30], "overal": 20, "against": 20, "whole": 20, "seemingli": [2, 20], "clash": [20, 27, 31, 32], "120": [5, 6, 20], "men": 20, "70": [2, 20, 34], "150": 20, "240": 20, "40": [2, 20, 22, 29, 33, 34], "30": [5, 6, 20, 29, 33, 34], "seen": [2, 5, 6, 20, 34], "distort": 20, "flat": [20, 27], "dosag": 20, "obscur": 20, "truth": [2, 20, 30], "counterfactu": 20, "flu": 20, "shot": [2, 20, 22, 30], "happi": 20, "nonetheless": 20, "sick": 20, "pocket": 20, "big": [5, 6, 20, 25, 27], "pharma": 20, "wors": 20, "off": [20, 34], "elementari": 20, "door": [2, 20, 27], "flyer": 20, "told": 20, "anna": [20, 22], "bori": [20, 22], "chad": 20, "dori": 20, "salari": 20, "none": [2, 20, 26], "boost": 20, "erma": 20, "fred": 20, "gina": 20, "harri": 20, "cut": 20, "half": [20, 22, 30], "55": [20, 29], "overestim": 20, "accur": [2, 20, 28], "yourself": [20, 27, 28], "happier": 20, "tourist": 20, "romano": 20, "tour": 20, "snl": 20, "skit": 20, "adam": [20, 22], "sandler": 20, "salesman": 20, "listen": 20, "temper": 20, "encount": 20, "honest": 20, "quot": [20, 25, 27], "sad": 20, "plane": 20, "italian": 20, "riviera": 20, "feel": 20, "bath": 20, "suit": [20, 26, 28], "favor": [20, 30, 34], "editori": 20, "breast": [2, 20, 30], "constant": [20, 28, 33], "35": [20, 22, 34], "constanc": 20, "obtain": 20, "fatal": 20, "45": [2, 20, 29], "1940": 20, "1945": 20, "1950": 20, "1955": 20, "1960": 20, "1970": 20, "extent": [20, 27], "maladi": 20, "factual": 20, "premis": 20, "standup": 20, "comedian": [20, 30], "joke": [20, 27, 30], "version": [20, 30], "gaug": 20, "audienc": [20, 30, 34], "reaction": [20, 30], "loudest": 20, "laugh": 20, "crowd": [20, 34], "email": 21, "me": 21, "ac4725": 21, "troubleshoot": 21, "star": [21, 34], "watch": [21, 34], "project": 21, "github": 21, "linkedin": [21, 34], "14": [22, 29, 30, 34], "tendenc": 22, "rain": 22, "tomorrow": 22, "repeat": [5, 6, 22, 30], "proport": [5, 6, 22, 34], "frequentist": 22, "philosophi": 22, "scope": 22, "coin": [5, 6, 22], "toss": [2, 5, 6, 22, 28], "head": [5, 6, 22, 33], "weight": [22, 34], "leq": 22, "outer": 22, "91": [22, 25], "insid": 22, "guarante": [22, 29], "land": [2, 5, 6, 22], "36": 22, "drew": [22, 28], "akin": 22, "lose": 22, "hh": 22, "ht": 22, "th": [22, 34], "tt": 22, "weather": 22, "devot": 22, "farmer": 22, "almanac": 22, "color": [22, 28, 33, 34], "sky": 22, "written": [22, 27, 31, 32, 33], "red": [22, 34], "textit": 22, "34": [22, 26], "37": [22, 34], "eyebal": 22, "shade": 22, "enclos": 22, "overlap": [22, 34], "exam": 22, "pressur": [22, 34], "clue": 22, "certainli": 22, "game": [22, 28], "stori": 22, "multipli": [2, 22, 30], "invent": 22, "neq": [22, 30], "mayor": 22, "umbrella": 22, "indirect": 22, "live": [22, 28], "nyc": 22, "tote": 22, "powerbal": 22, "correctli": [2, 22, 28], "connect": 22, "mayb": [2, 22, 28, 29, 30, 34], "horoscop": 22, "lucki": [22, 28], "sequenti": 22, "mutut": 22, "exclus": 22, "eath": 22, "cake": 22, "todai": [5, 6, 22], "special": [22, 27, 34], "mutual": 22, "count": [2, 22, 27, 30, 34], "brute": 22, "routin": 22, "sequenc": [22, 27], "hhh": 22, "denomin": [2, 22], "trick": 22, "hth": 22, "tht": 22, "81": [22, 30], "htt": 22, "tth": 22, "ttt": 22, "five": [22, 33], "hunt": 22, "treasur": [22, 28], "sea": 22, "north": 22, "island": 22, "bear": 22, "adjac": 22, "search": 22, "clockwis": 22, "strategi": 22, "maxim": 22, "steer": 22, "binom": [5, 6, 22, 30], "k": [22, 30], "element": 22, "glee": 22, "club": 22, "presid": [22, 30], "pascal": 22, "triangl": 22, "arrang": [22, 30], "horizont": 22, "item": [22, 30], "rememb": [22, 27, 34], "hero": 22, "preliminari": [22, 34], "step": [22, 34], "substitut": [2, 22, 26], "iid": 22, "24": 22, "27": 22, "alic": [22, 30], "battleship": 22, "grandmast": 22, "secret": 22, "spot": 22, "b3": 22, "e12": 22, "carniv": 22, "player": [2, 22, 28, 30], "111": 22, "request": 22, "nor": [22, 30], "cent": 22, "linda": 22, "31": [22, 28, 29], "outspoken": 22, "bright": 22, "deepli": 22, "discrimin": 22, "justic": 22, "anti": 22, "nuclear": 22, "bank": [22, 34], "teller": [2, 22, 30], "feminist": 22, "movement": 22, "leap": 22, "birthdai": 22, "365": 22, "born": 22, "june": 22, "1st": 22, "share": 22, "string": [25, 27], "greet": 25, "integ": 25, "my_favorite_numb": 25, "hello": 25, "print": [25, 33], "function": [25, 26, 27, 31, 32], "displai": [25, 28], "nonsens": 25, "asid": 25, "shorter": 25, "deal": [5, 6, 25, 27, 34], "perfect": [5, 6, 25, 30], "techniqu": 25, "loss": 25, "winning_percentag": 25, "becom": [25, 27, 28, 30], "longer": [25, 30], "collabor": 25, "charact": 25, "golf": 25, "recreat": 25, "tri": 25, "Being": 25, "golfer": 25, "coder": 25, "ceil": [26, 34], "extern": 26, "pi": 26, "ti": 26, "button": 26, "numpi": [26, 33], "access": 26, "141592653589793": 26, "prefix": 26, "cumbersom": 26, "alias": 26, "abbrevi": 26, "np": [26, 33], "alia": 26, "scipi": 26, "capabl": 26, "norm": 26, "cdf": 26, "submodul": 26, "9640696808870742": 26, "shorten": 26, "clearli": 26, "convent": [26, 31, 32, 34], "cool": 27, "lesser": 27, "easier": [27, 30, 31, 32], "pick": [2, 27], "sting": 27, "critiqu": 27, "interview": 27, "scientist": 27, "common": [27, 34], "machin": [27, 33], "packag": [27, 31, 32, 33], "implic": 27, "mainli": 27, "coher": 27, "graph": [27, 28, 34], "colaboratori": 27, "mirror": 27, "jupyt": [27, 33], "setup": 27, "intro": 27, "profici": 27, "sql": 27, "wait": 27, "tech": 27, "intend": 27, "conform": 27, "zen": 27, "elsewher": 27, "tim": 27, "ugli": 27, "complex": 27, "nest": 27, "spars": 27, "dens": 27, "although": 27, "beat": 27, "puriti": 27, "pass": [2, 27, 28, 30], "silent": 27, "explicitli": [27, 33], "silenc": 27, "face": 27, "refus": [27, 34], "temptat": 27, "namespac": 27, "honk": 27, "great": 27, "endlessli": 27, "fluent": 27, "012": 27, "aspir": 27, "fluenci": 27, "bui": 27, "loaf": 27, "bread": 27, "dozen": [2, 27], "loav": 27, "liter": 27, "frustrat": 27, "couldn": 27, "belliger": 27, "friend": 27, "chunk": 27, "messag": 27, "typo": 27, "ran": [27, 28], "chatgpt": 27, "explan": [17, 27], "persist": 27, "scratch": 27, "overwrit": 27, "unexpect": 27, "datafram": [27, 28, 33], "odd": 27, "former": [5, 6, 27, 34], "expon": 27, "decim": 27, "exact": [27, 30], "00000000001": 27, "upon": 28, "incorpor": 28, "estim": [28, 29, 33], "conceptu": 28, "convei": 28, "directli": [28, 30], "protein": 28, "calori": 28, "gram": 28, "180": 28, "assumpt": [28, 30], "wage": 28, "tenur": 28, "month": 28, "factori": 28, "rais": 28, "realiz": 28, "arm": 28, "throught": 28, "recip": [2, 28], "plug": [28, 30], "underestim": 28, "anim": 28, "sourc": [28, 29, 34], "vegan": 28, "singli": 28, "defi": 28, "littl": [22, 28], "debbi": 28, "nutti": 28, "buddi": 28, "eventu": 28, "unprocess": 28, "prudent": 28, "enjoi": 28, "gustatori": 28, "realli": 28, "proccess": 28, "rmse": 28, "_i": 28, "nonlinear": 28, "formless": 28, "cloud": 28, "varianc": 28, "homoscedast": 28, "narrow": [28, 34], "violat": 28, "32": 28, "sleepless": 28, "amount": [28, 34], "slept": 28, "experienc": 28, "rave": 28, "whet": 28, "appetit": 28, "revisit": 28, "mediocr": 28, "gravit": 28, "mc": 28, "nba": 28, "consist": [28, 34], "unobserv": 28, "perspect": [2, 28, 30, 34], "instrins": 28, "realist": 28, "encompass": 28, "luck": 28, "outperform": 28, "underperform": 28, "By": [28, 30], "roll": 28, "reset": 28, "neutral": 28, "sophomor": 28, "slump": 28, "straightforward": 28, "consequ": [5, 6, 28], "phenomenon": 28, "assort": 28, "mate": 28, "least": [2, 22, 28], "fur": 28, "coat": 28, "difficult": [28, 29, 30], "sketch": [28, 34], "exception": [28, 34], "athlet": 28, "complet": [28, 34], "upgrad": [28, 33], "markdown": 28, "md": 28, "use_al": [28, 33], "raw": [28, 33], "githubusercont": [28, 33], "alexanderthclark": [28, 33], "stats1101": [28, 33], "fathersonheight": [28, 33], "load": [28, 31, 32, 33], "df": [28, 33], "pd": [28, 33], "read_csv": [28, 33], "reg": 28, "xlabel": [28, 33], "ylabel": [28, 33], "titl": [28, 34], "rms_error": 28, "scatter_plot": [28, 33], "nrmse": 28, "1f": 28, "893": [28, 33], "514": [28, 33], "x_": [28, 33], "attent": [30, 34], "acknowledg": 30, "disadvantag": 30, "margin": 30, "releas": 30, "resourc": 30, "contribut": 30, "dental": 30, "compon": 30, "histor": 30, "stage": 30, "die": 30, "suffici": [6, 30], "toi": 30, "car": [30, 34], "crash": 30, "safeti": 30, "10x": 30, "1100": 30, "110": 30, "occurr": 30, "cross": 30, "13000r": 30, "13000": 30, "1000000r": 30, "987": 30, "safer": 30, "deliber": 30, "vari": 30, "conclus": 30, "imprecis": 30, "undon": 30, "sort": [29, 30], "studious": 30, "etc": 30, "duplic": 30, "shift": 30, "1200": 30, "cutoff": 30, "1400": 30, "900": 30, "exclud": [29, 30], "exlcud": 30, "strength": 30, "noisi": 30, "match": [31, 32, 34], "accident": [31, 32], "wade": [31, 32], "overwhelm": [31, 32], "use_fpp": [31, 32], "use_sheet": [31, 32], "perman": [31, 32], "session": [31, 32], "fpp": [31, 32], "modul": [31, 32], "816496580927726": 32, "minim": 32, "sklearn": 33, "imit": 33, "pure": 33, "eg": 33, "starter": 33, "8999999999999999": 33, "regression_lin": 33, "000000000000009": 33, "000000000000007": 33, "sd_x": 33, "sd_y": 33, "y_averag": 33, "x_averag": 33, "panda": 33, "earlier": [33, 34], "inspect": [30, 33, 34], "61": [5, 6, 33], "64": 33, "alpha": [30, 33], "opac": [33, 34], "reg_lin": 33, "x_rang": 33, "min": 33, "y_predict": 33, "api": 33, "sm": 33, "add_const": 33, "ol": 33, "param": 33, "arrai": 33, "residuals_sm": 33, "resid": 33, "smf": 33, "model_smf": 33, "residuals_smf": 33, "dtype": 33, "float64": 33, "linear_model": 33, "linearregress": 33, "model_sk": 33, "x_sk": 33, "reshap": 33, "y_sk": 33, "coef_": 33, "intercept_": 33, "0000000000000009": 33, "y_pred": 33, "residuals_sk": 33, "televis": 34, "inessenti": 34, "jargon": 34, "trait": 34, "fame": 34, "tall": 34, "predetermin": 34, "softwar": 34, "216": [29, 34], "approxim": 34, "africa": 34, "wide": 34, "bottom": [29, 34], "span": 34, "221": 34, "reveal": [2, 30, 34], "irregular": 34, "retract": 34, "uncov": 34, "odemet": 34, "statement": 34, "assert": 34, "mileag": 34, "896": 34, "39198": 34, "21396": 34, "63511": 34, "alleg": [22, 34], "uniform": 34, "mile": 34, "anomal": 34, "preposter": 34, "spike": 34, "nearest": 34, "predomin": 34, "fishi": [22, 34], "fabric": 34, "henc": 34, "latter": [2, 5, 6, 34], "vehicl": 34, "qualit": 34, "automat": 34, "qualifi": 34, "postal": [29, 34], "grew": 34, "40422": 34, "offic": 34, "measli": 34, "zip": 34, "10027": 34, "395": 34, "taxonomi": 34, "subdivid": 34, "discret": 34, "quantiti": [2, 6, 34], "fill": [2, 34], "beaker": 34, "ounc": 34, "continuoustli": 34, "lowest": [29, 34], "famili": 34, "blurri": 34, "ic": [5, 6, 34], "cream": [5, 6, 34], "charg": 34, "scoop": [5, 6, 34], "shoo": 34, "7777777": 34, "complain": 34, "gave": 34, "99999999998": 34, "tension": 34, "familiar": [6, 34], "anyon": 34, "agon": 34, "stingi": 34, "dine": 34, "chipotl": 34, "mexican": 34, "grill": 34, "detour": 34, "vocabulari": 34, "endpoint": 34, "contiuou": 34, "messi": [2, 34], "inelegantli": 34, "establish": 34, "999": [29, 34], "88": 34, "888": 34, "quanti": 34, "lesson": 34, "accompani": 34, "codebook": 34, "strang": [2, 34], "clump": 34, "unfortun": 34, "racial": 34, "basi": 34, "necessit": 34, "grai": 34, "unusu": 34, "cautionari": 34, "tale": 34, "necess": 34, "miss": [29, 34], "coax": 34, "19": [29, 34], "netflix": 34, "led": 34, "user": 34, "blood": 34, "oral": 34, "contracept": 34, "overlai": 34, "pill": 34, "paint": 34, "picasso": 34, "cezann": 34, "varaibl": 34, "clutter": 34, "covid": 34, "mortal": 34, "background": 34, "gradient": 34, "alaska": 34, "utah": 34, "younger": 34, "vermont": 34, "style": 34, "t_366bb": 34, "border": 34, "collaps": 34, "2px": 34, "header": 34, "f0f0f0": 34, "000000": 34, "pad": 34, "8px": 34, "1px": 34, "solid": 34, "ccc": 34, "align": 34, "td": 34, "t_366bb_row0_col0": 34, "fdd9b5": 34, "t_366bb_row0_col1": 34, "fddab6": 34, "t_366bb_row0_col2": 34, "fdc794": 34, "t_366bb_row0_col3": 34, "fdbb81": 34, "t_366bb_row0_col4": 34, "fdd5ab": 34, "t_366bb_row1_col0": 34, "t_366bb_row1_col1": 34, "fdd2a6": 34, "t_366bb_row1_col2": 34, "fdcfa0": 34, "t_366bb_row1_col3": 34, "fdbe84": 34, "t_366bb_row1_col4": 34, "fddbb8": 34, "t_366bb_row2_col0": 34, "fdd4aa": 34, "t_366bb_row2_col1": 34, "fdce9e": 34, "t_366bb_row2_col2": 34, "fdc088": 34, "t_366bb_row2_col3": 34, "t_366bb_row2_col4": 34, "fdac67": 34, "t_366bb_row3_col0": 34, "t_366bb_row3_col1": 34, "t_366bb_row3_col2": 34, "fdc692": 34, "t_366bb_row3_col3": 34, "t_366bb_row3_col4": 34, "fda965": 34, "t_366bb_row4_col0": 34, "t_366bb_row4_col1": 34, "fdd3a9": 34, "t_366bb_row4_col2": 34, "t_366bb_row4_col3": 34, "t_366bb_row4_col4": 34, "t_366bb_row5_col0": 34, "fdc28b": 34, "t_366bb_row5_col1": 34, "fdc590": 34, "t_366bb_row5_col2": 34, "t_366bb_row5_col3": 34, "t_366bb_row5_col4": 34, "t_366bb_row6_col0": 34, "t_366bb_row6_col1": 34, "fdc895": 34, "t_366bb_row6_col2": 34, "fdd7b1": 34, "t_366bb_row6_col3": 34, "fedfc0": 34, "t_366bb_row6_col4": 34, "fedebd": 34, "t_366bb_row7_col0": 34, "t_366bb_row7_col1": 34, "fee0c3": 34, "t_366bb_row7_col2": 34, "feead6": 34, "t_366bb_row7_col3": 34, "t_366bb_row7_col4": 34, "fee9d4": 34, "t_366bb_row8_col0": 34, "feead5": 34, "t_366bb_row8_col1": 34, "feebd8": 34, "t_366bb_row8_col2": 34, "fff0e2": 34, "t_366bb_row8_col3": 34, "ffefe0": 34, "t_366bb_row8_col4": 34, "ffeedd": 34, "t_366bb_row9_col0": 34, "t_366bb_row9_col1": 34, "t_366bb_row9_col2": 34, "t_366bb_row9_col3": 34, "t_366bb_row9_col4": 34, "district": 34, "nbsp": 34, "17": [5, 6, 34], "29": [22, 34], "69": 34, "79": 34, "eda": 34, "notabl": 34, "tukei": 34, "box": [2, 30, 34], "emphasi": 34, "mine": [29, 34], "1962": 34, "propon": 34, "asymptot": 34, "cleveland": 34, "1985": 34, "along": 34, "view": 34, "1993": 34, "donoho": 34, "discoveri": 34, "fix": 34, "graphic": 34, "prove": 34, "cite": 34, "bland": 34, "altman": 34, "1986": 34, "aspect": 34, "excit": [6, 34], "explanatori": 34, "distil": 34, "frame": 34, "prose": 34, "distract": 34, "insofar": 34, "thoughtfulli": 34, "151": 34, "spark": 34, "joi": 34, "clear": [22, 30, 34], "li": 34, "upload": 34, "classifi": 34, "satur": 34, "credit": 34, "nick": 34, "huntington": 34, "klein": 34, "bradlei": 34, "cooper": 34, "mindset": 34, "domain": [29, 34], "gini": 34, "lyric": [2, 22], "loser": 22, "montgomeri": 22, "gentri": 22, "outlaw": 22, "boozer": 22, "glass": 22, "hippi": 22, "redneck": 22, "suspect": 22, "bloodlin": [], "am": [], "eddi": 22, "sing": 22, "descend": 22, "translat": 22, "ancestor": 22, "strictli": 22, "advic": 2, "monti": 2, "hall": 2, "paradox": [2, 30], "bend": 2, "14195066": 3, "harder": 22, "114": 22, "fraudul": 22, "101": 22, "firm": 22, "tamper": 22, "billion": 22, "parti": 22, "equival": 22, "rearrang": 2, "isol": 2, "textbf": [], "rewrit": 2, "combin": 2, "expand": [2, 30], "whenev": 2, "transpos": 2, "quad": 2, "005": 2, "00995": 2, "duo": 22, "guido": 17, "imben": 17, "roundabout": 17, "stress": 2, "implicitli": 2, "gerd": 2, "gigerenz": 2, "cold": 2, "percent": 2, "woman": 2, "mammogram": 2, "friendlier": 2, "formul": 2, "992": 2, "screen": 2, "opaqu": 2, "children": 17, "earner": 30, "secondari": 30, "okai": 30, "binomi": [5, 6, 30], "vp": 30, "preseid": 30, "bob": 30, "pretti": 2, "hack": [2, 5, 6], "blue": 2, "plu": 2, "pluss": 2, "rote": 2, "qu": 2, "othan": 2, "625": [], "676": [2, 29], "42": 2, "wheel": 2, "fortun": 2, "termin": 2, "pilgrim": 2, "travel": 2, "home": 2, "wander": 2, "troll": 2, "woe": 2, "73": 2, "fate": 2, "decre": 2, "certainti": 2, "thee": 2, "finish": 2, "exil": 2, "alarm": 2, "bargain": 2, "wise": 2, "velma": [], "park": 2, "unknown": [2, 30], "scrub": [2, 30], "baller": [2, 30], "sold": 2, "amazon": 2, "fake": [2, 30], "joker": [2, 30], "countri": 2, "tractor": [2, 30], "truck": [2, 30], "866": 30, "swap": 30, "substant": 30, "reorder": 30, "visibl": 30, "08": [5, 6], "smaller": [5, 6], "yield": [5, 6, 30], "2x": [5, 6], "100x": [5, 6], "recruit": [5, 6], "2000": [5, 6], "volunt": [5, 6], "iii": [5, 6], "se": [5, 6], "500": [5, 6], "18": [5, 6], "doublearrow": [], "leftrightarrow": [], "focal": [5, 6], "mimic": [5, 6], "1s": [5, 6], "0s": [5, 6], "ruth": [5, 6], "antonin": [5, 6], "vanilla": [5, 6], "chocol": [5, 6], "stock": [5, 6], "cdot0": [5, 6], "018": [5, 6], "470": [5, 6], "530": [5, 6], "central": [5, 6], "lopsid": 6, "bokeh": [], "output_notebook": [], "columndatasourc": [], "layout": [], "slider": [], "customj": [], "pantool": [], "wheelzoomtool": [], "resettool": [], "json": [], "hide_bann": [], "initial_n_draw": [], "precomput": [], "pmf": [], "precomputed_pmf": [], "n_draw": [], "201": [], "arang": [], "tolist": [], "javascript": [], "precomputed_pmfs_json": [], "dump": [], "600": [], "x_axis_label": [], "y_axis_label": [], "vbar": [], "callback": [], "arg": [], "dict": [], "const": [], "cb_obj": [], "pars": [], "tostr": [], "emit": [], "js_on_chang": [], "habea": 6, "gelatu": 6, "ts": 30, "hs": 30, "subtleti": 30, "intuitit": 30, "soution": [], "cdot1": [], "underbrac": 30, "_": 30, "overbrac": 30, "famous": 30, "boi": 30, "girl": 30, "favorit": 30, "remark": 30, "beta": 30, "gamma": 30, "delta": 30, "h_2": 30, "h_1": 30, "tempt": 30, "simul": 30, "990": 30, "10000": 30, "dieas": 30, "989": 30, "901": 30, "9899": 30, "9997": 30, "02": 30, "willing": [29, 30], "ten": 2, "lend": 2, "lest": 2, "aim": 29, "lifespan": 29, "owl": 29, "nearli": 29, "reserv": 29, "truthfulli": 29, "hurdl": 29, "opportun": 29, "pollster": 29, "creameri": 29, "vote": 29, "elect": 29, "milk": 29, "sensibl": 29, "candid": 29, "yuppi": 29, "lactos": 29, "northern": 29, "european": 29, "descent": 29, "intoler": 29, "america": 29, "smarter": 29, "assembl": 29, "truli": 29, "hurld": 29, "phone": 29, "bureau": 29, "labor": 29, "amb06": [], "reproduc": 29, "160": 29, "736": 29, "54": 29, "438": 29, "447": 29, "58": 29, "56": 29, "119": 29, "ethnic": 29, "hispan": 29, "508": 29, "864": 29, "524": 29, "household": 29, "055": 29, "41": 29, "947": 29, "817": 29, "53": 29, "982": 29, "095": 29, "declin": 29, "reweight": 29, "atusrespr": [], "2004": [], "atu": [], "respon": [], "svg": [], "bl": [], "gov": [], "osmr": [], "unrepres": 29, "quota": 29, "resembl": 29, "kei": 29, "older": 29, "curmudgeon": 29, "overrepres": 29}, "objects": {}, "objtypes": {}, "objnames": {}, "titleterms": {"homework": 0, "5": [0, 30], "overview": [1, 13, 27], "run": 1, "r": [1, 15, 33], "altern": 1, "calcul": [1, 7, 22, 25], "variabl": [1, 6, 25, 34], "comment": [1, 25], "probabl": [2, 13, 22, 23, 24, 30], "ii": [2, 30], "import": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 19, 20, 22, 24, 28, 29, 33, 34], "read": [2, 4, 5, 6, 7, 8, 9, 10, 17, 18, 19, 20, 22, 24, 28, 29, 33, 34], "chanc": [2, 5, 6, 28], "tree": [2, 24], "bay": 2, "theorem": 2, "bibliographi": 3, "center": [4, 30], "spread": [4, 30], "The": [4, 9, 18, 19, 28, 34], "averag": [4, 16, 29], "standard": [4, 9, 18], "deviat": 4, "preambl": 4, "root": 4, "mean": 4, "squar": 4, "find": [4, 12, 18, 28], "popul": 4, "vs": [4, 13], "sampl": [4, 29], "sd": 4, "sup": 4, "what": [4, 27], "sai": 4, "exercis": [2, 4, 7, 8, 9, 10, 16, 17, 18, 20, 22, 28, 30, 34], "correl": [7, 8, 30], "scatter": [7, 8], "plot": [7, 8, 28], "father": [7, 8], "son": [7, 8], "height": [7, 8], "data": [7, 8, 34], "coeffici": [7, 8, 22], "interact": [7, 34], "exampl": [7, 17, 20, 32, 33, 34], "except": 7, "case": 7, "causat": [7, 8], "featur": 8, "experi": [9, 17, 30], "type": 9, "question": 9, "evid": 9, "On": 9, "design": 9, "interpret": 9, "extens": [9, 20, 24, 34], "gold": 9, "stori": 9, "time": [9, 29], "get": [10, 30], "start": [10, 30], "histogram": [11, 14, 34], "regress": [12, 28, 30, 33], "simpl": 12, "linear": [12, 28], "line": [12, 28], "predict": 12, "residu": [12, 28], "basic": [13, 25], "formula": [13, 22], "Not": 13, "1": [5, 6, 13, 30, 33], "cell": 13, "refer": 13, "a1": 13, "sheet1": 13, "rang": 13, "a2": 13, "A": [13, 22], "b2": 13, "copi": 13, "past": 13, "mathemat": 13, "statist": 13, "distribut": [13, 18, 19, 30, 34], "logic": 13, "lookup": 13, "function": 13, "welcom": 15, "intro": 15, "stat": 15, "more": 15, "about": 15, "1101": 15, "main": 15, "text": 15, "googl": 15, "sheet": 15, "option": 15, "python": [15, 27, 28], "other": [15, 20, 21], "law": 16, "natur": [2, 17, 30], "normal": [5, 6, 18, 19, 30], "curv": [18, 19], "unit": 18, "68": 18, "95": 18, "rule": [18, 22], "area": 18, "under": 18, "tabl": [18, 29], "why": 18, "care": 18, "observ": [20, 30], "studi": [20, 30], "simpson": 20, "s": 20, "paradox": 20, "applic": 20, "admit": 20, "potenti": 20, "world": 20, "health": 20, "outcom": 20, "accord": 20, "alic": 20, "bob": 20, "belief": 20, "colleg": 20, "earn": 20, "signal": 20, "abil": [20, 28], "increas": 20, "certain": 20, "individu": 20, "vacat": 20, "itali": 20, "set": 22, "box": [5, 6, 22], "model": 22, "random": 22, "draw": 22, "condit": 22, "gener": [], "mulitpl": 22, "b": 22, "independ": 22, "addit": 22, "list": 22, "wai": 22, "binomi": 22, "librari": 26, "should": 27, "you": 27, "learn": [27, 33], "think": 27, "like": 27, "programm": 27, "slope": 28, "error": [5, 6, 28], "outlier": 28, "evalu": 28, "fallaci": 28, "select": 30, "solut": 30, "4": 30, "7": 30, "8": 30, "10": 30, "15": 30, "20": 30, "23": 30, "statwrap": [31, 32, 33], "us": [29, 31, 32], "catalog": 32, "2": [29, 33], "from": [5, 6, 29, 33], "csv": 33, "statsmodel": 33, "user": 33, "scikit": 33, "summar": 34, "frequenc": [2, 34], "sleuth": 34, "out": 34, "fraud": 34, "drive": 34, "work": 34, "real": 34, "control": 34, "cross": 34, "tabul": 34, "visual": 34, "exploratori": 34, "analysi": 34, "expand": 22, "lift": 2, "fog": 2, "22": 30, "28": 30, "31": 30, "21": 30, "sum": [5, 6], "0": [5, 6], "central": [], "limit": [], "approxim": [5, 6], "i": 30, "32": 30, "33": 30, "34": 30, "36": 30, "37": 30, "survei": 29, "2004": 29, "atu": 29, "respons": 29, "rate": 29, "amb06": 29, "usp": 29, "satisfact": 29, "ag": 29, "curmudgeonli": 29, "non": 29, "american": 29}, "envversion": {"sphinx.domains.c": 2, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 6, "sphinx.domains.index": 1, "sphinx.domains.javascript": 2, "sphinx.domains.math": 2, "sphinx.domains.python": 3, "sphinx.domains.rst": 2, "sphinx.domains.std": 2, "sphinx.ext.intersphinx": 1, "sphinxcontrib.bibtex": 9, "sphinx": 56}}) \ No newline at end of file diff --git a/book/sampling.md b/book/sampling.md index 7233437..588b5bf 100644 --- a/book/sampling.md +++ b/book/sampling.md @@ -20,13 +20,36 @@ In practice, finding a good sample statistic is difficult. There are nuances tha Each hurdle presents an opportunity for bias in the final estimate. -One important type of bias is **selection bias**, which occurs when the sample systematically excludes one kind of person. Suppose a political pollster sets up a table at the local creamery, asking people who they'll vote for in an American election as they shop for organic milk. The sensible population of interest is American voters and the parameters of interest are the percentage voting for each candidate. However, the creamery setting *selects* for a sort of yuppie person who can tolerate lactose. People of Northern European descent have the lowest rate of lactose intolerant, so the sample is unlikely to be representative of America. +One important type of bias is **selection bias**, which occurs when the sample systematically excludes one kind of person. Suppose a political pollster sets up a table at the local creamery, asking people who they'll vote for in an American election as they shop for organic milk. The sensible population of interest is American voters and the parameters of interest are the percentage voting for each candidate. However, the creamery setting *selects* for a sort of yuppie person who can tolerate lactose. People of Northern European descent have the lowest rate of lactose intolerance, so the sample is unlikely to be representative of America. -The pollster might have a smarter colleague who assembles a list of names that is truly representative of all voters. The next hurlde is getting responses. If a phone survey is used, there will be many who don't answer. This is a problem *if* those who don't respond are systematically different than those who do respond. In fact, old people are usually more available and willing to answer the phone, potentially leading to bias. A systematic difference between respondents and non-respondents is called **non-response bias**. +The pollster might have a smarter colleague who assembles a list of names that is truly representative of all voters. The next hurdle is getting responses. If a phone survey is used, there will be many who don't answer. This is a problem *if* those who don't respond are systematically different than those who do respond. In fact, old people are usually more available and willing to answer the phone, potentially leading to bias. A systematic difference between respondents and non-respondents is called **non-response bias**. + +The specific problem of an unrepresentative distribution of ages in a sample can be solved by using **quota sampling**. In quota sampling, the sample is constructed to resemble the population of interest with respect to key characteristics. This can help, but it doesn't guarantee representativeness because not all important characteristics can be understood. + +**Example**: Imagine we want to estimate the public's satisfaction with the US Postal Service. Opinions differ by age and by their curmudgeonliness. Perhaps older people like USPS more, but curmudgeons will not like USPS regardless of age *and* curmudgeons will not respond. It's easy to quota sample based on age, and a quota sample will result in an average satisfaction rating of 9 based on {numref}`age-curmudg-table`. This is better than not using quota sampling and constructing a sample that overrepresents older non-curmudgeons. However, the true average rating is 7. Quota sampling can't give a good estimate of the actual population parameter because quotas for old or young people will systematically exclude curmudgeons. + +```{list-table} Average USPS Satisfaction by Age and Curmudgeonliness +:header-rows: 1 +:name: age-curmudg-table + +* - + - Bottom 50% Age + - Top 50% Age +* - Bottom 50% Curmudgeon + - 8 + - 10 +* - Top 50% Curmudgeon + - 5 + - 5 +``` + +The last hurdle in surveying is getting truthful responses. People might provide socially acceptable answers instead of truthful answers, especially when the survey involves talking to an actual person. Answers can be influenced by the wording of questions. These phenomena all fall under the umbrella of **response bias**. + +The Trafalgar Group is an opinion polling company, notable for predicting that Donald Trump would win the 2016 US presidential election while most polls were wrong. One proposed explanation for why so many polls were wrong is the theory of the "shy Trump voter." A shy Trump voter is someone who voted for Trump but indicated the opposite to pollsters, motivated by fear of social stigma. This is a case of response bias and correcting for it requires some artifice. The Trafalgar group attempted to account for that by asking respondents how they think their neighbors will vote. ### Non-response in the American Time Use Survey -{cite}`abraham2006nonresponse` reports different response rates for the American Time Use Survey, partially reproduced in {numref}`atusresprates`. The differing response rates present a mine field for researchers. +{cite}`abraham2006nonresponse` reports different response rates for the American Time Use Survey, partially reproduced in {numref}`atusresprates`. The differing response rates present a minefield for researchers. ```{list-table} 2004 ATUS Response Rates (Table 2 from [AMB06]) :header-rows: 1 @@ -104,4 +127,36 @@ name: household-survey-respons Source: [Bureau of Labor Statistics](https://www.bls.gov/osmr/response-rates/) ``` +### Probability Methods + +A good sample is representative of the population of interest. Like in experiments, the best way to ensure representativeness is to use randomization. A **simple random sample** is one drawn at random without replacement. When feasible, this is a good method. Feasibility requires there's some big list of names to draw from. For people who will vote in the next election, there is no such list. So, political polling is complicated and the nuts and bolts are beyond our scope. + +Note that probability methods are important regardless of the sample size. An estimate can be decomposed as + +$$\text{estimate = parameter + bias + chance error}.$$ + +The sample size controls the chance error, with larger samples reducing the chance error, but a bad sampling technique is vulnerable to bias no matter the sample size. + + +## Exercises + +```{exercise-start} +:label: incentivesurvey +``` +A user researcher at a large ecommerce company wants to have a representative sample of its users take a survey. + +1. They create a survey that is visible to anyone who completes an order on a single day. Describe at least one source of bias. + +2. They email 100 users, drawn without replacement, from a list of all people holding an account with the company. What kind of sample is this? + +3. In the email to 100 users, they offer a $10 gift card to anyone who completes the survey. What kind of bias is this designed to prevent? + +```{exercise-end} +``` + + + + + +

Table 11 2004 ATUS Response Rates (Table 2 from [AMB06])#Table 12 2004 ATUS Response Rates (Table 2 from [AMB06])#

Variable

Number in Sample