probability - the chance that something happens
-
example of crossing street
not hit: IIIII IIIII IIIII
hit: I
IMAGE 3.1 Normal distribution
measurement variation | biological variation |
---|---|
measurement error, measurement method, measurement conditions |
space, time, species, age, sex, genotype |
randomness - a mixture of measurement error and sources of variation too complex to measure and/or not of primary interest
null hypothesis -( “no effect” H
0) observed differences among groups reflect measurement error and/or other sources of unspecified variation
alternative hypothesis - NOT H
0
statistical hypothesis - a test of whether the pattern in the data is better explained by H
0(null hypothesis) or NOT H0(alternative hypothesis)
IMAGE 3.2 Null and alternative hypothesis for sex differences
statistical p - probability of obtaining the observed results (or something more extreme) if the null hypothesis (H
0) were true (p(data|H0)
- if p is “large” (p = 0.87), no evidence to reject H
0 - if p is “small” (p = 0.02), sufficient evidence to reject H
0
INCORRECT definition of statistical p - the probability that H
0is true
discrete variable - groupings (sex,age,genotype)
continuous variable - continuous numeric scale (mass, abundance)
IMAGE 3.3 schematic of bar chart
IMAGE 3.4 null versus alternative bar chart
IMAGE 3.5 schematic of linear regression
IMAGE 3.6 null versus alternative regression model
H
Biol= biological hypothesis (= mechanism)H
0= null hypothesis (= pattern)
IMAGE 3.7 flow chart for logic tree of H
Bioland H0
- H
BiolIn high-alpine lakes, increased algal biomass increases fish species diversity (“bottom-up control”)
IMAGE 3.8 Schematic for outcome of fish experiment
- larger sample size (
$N$ )$\rightarrow$ small p - larger differences among group means
$(\bar{G_1} - \bar{G_2})$ $\rightarrow$ small p - larger within-group variance
$\sigma^2$ $\rightarrow$ large p
-
Reality = H
0true or H0false -
Conclusion = not reject H
0or reject H0 -
stomach ache in the night H
0not true:appendicitis; H0true: no appendicitis
H |
H |
|
---|---|---|
not reject H |
correct decision (go home) |
Type II statistical error (go home) |
reject H |
Type I statistical error (operate) |
correct decision (operate) |
Type I Statistical Error - incorrectly rejecting a null hypothesis that is true (error of falsity)
Type II Statistical Error - incorrectly accepting a null hypothesis that is false (error of ignorance)
- which kind of error is more serious?
- in clinical applications, usually assume Type II error is more important
- in standard science applications, priority is placed on Type I error
- errors of ignorance are less serious than errors of falsity
- Type I error is measured readily in mainstream statistics, but Type II error is much harder (Bayesian analysis)
alternative definition for statistical p - probability of making a Type I error by rejecting H
0