k-tree
E-learning book

Analysis of variance

In the examples in this article, data is generated every time the page loads. If you want to see an example with different values - reload the page.

ANOVA

ANOVA in statistics is a powerful tool for determining the influence of different groups of observations among themselves. The analysis of variance was introduced by Fisher, an English scientist who made a huge contribution to the development of science. ANOVA is an acronym for ANalysis Of VAriance.

Example

Suppose you want to conduct an empirical study of gasoline quality, for this you fill up the tank at one gas station and drive n kilometers, repeat such an experiment, say, five times, then conduct the same experiment, only at a different gas station. You have two sets of data - refueling A and refueling B. Certainly, the figures are scattered, but there is still some dependence, so that would determine whether refueling affects gasoline consumption (or the data are not related) You are using variance analysis.

The analysis of variance allows you to determine which of the factors affects more, intra-group or intergroup. In the example above, you will be able to determine how much the choice of gas station affects gasoline consumption. This is the essence of the dispersion analysis: to find out whether the selected factor is significant for the selected observations.

In a sense, the analysis of variance is similar to regression and correlation analyses, because it allows determine the influence of variables on each other.

Analysis

In theory, a simple model is built to analyze the variance, similar to the one studied in time series analysis.

Model

The model of the analysis of variance includes the average value, the effect of the experiment and a random error:

y = μ + τ + ε
τ - experiment effect, ε - random error

Single-factor

One-factor analysis of variance considers the influence of one criterion, it is done this way: we conduct two experiments, in one of them we include an additional factor and analyze whether this factor has made changes. As initial data, consider the results of a number of experiments:

NE1E2E3E4
1383810532
234389348
357478154
454598144
550377433
μi46.643.886.842.2
μ = (46.6 + 43.8 + 86.8 + 42.2) / 4 = 54.85
The square of errors within groups (Square Sum within group):
SSw = ΣiΣj(yij - μi)2 = 1727.6
The square of errors between groups (Square Sum between group):
SSb = Σi(μi - μ)2 = 1370.99
Given the degrees of freedom, the expected average is:
MSw = SSw / a(n-1) = 115.17
MSb = SSb / a-1 = 342.75
Value of Fcrit :
F0 = MSb/MSw = 2.976

Fischer's test: if the value of F0 turns out to be greater than the value of F λ,4,15, then the factor has an impact.

For n = 20 and a = 5, Fλ,n-a,a-1 = Fλ,15,4= 5.86
Since F0 = 2.976 < 5.86, then we assume that the introduced factor did not have an effecton the results of the experiment.

Two-factor

In two- factor analysis , three hypotheses are put forward for verification:

  • Factors A and B do not affect the result
  • Factor A does not affect the result
  • Factor B does not affect the result

To carry out a two-factor analysis, it is necessary to make groups of results: several measurements for all values of each of the factors, i.e.:

A1A2
B1X1a1,b1...XNa1,b1X1a1,b2...XNa1,b2
B2X1a1,b2...XNa1,b2X1a1,b2...XNa1,b2

Next, the average value for each factor value is calculated, i.e. the average for A1, the average for B1, etc. Then it is calculated the total average for all results. Let's set the number of criteria: k = 2 (the number of criteria A) and m = 2 (the number of criteria B).

T = ΣΣΣxijk
The sum of elements under the influence of factor A:
TAi = Σxi·k
The sum of elements under the influence of factor B:
TBj = Σx·jk
The sum of elements under the influence of factor AB:
TAiBj = Σxij·
SST = Σx2ijk - T2/N
SSA = ΣT2Ai/n·m - T2/N
SSB = ΣT2Bj/n·k - T2/N
SSAB = ΣΣT2AiBj/n - SSA - SSB - T2/N
SSE = ΣΣΣx2ijk - ΣΣT2AiBj/n

SST = SSA + SSB + SSAB + SSE

MSE = SSE/(n-1)·m·k
MSA = SSA/k-1
MSB = SSB/m-1
MSAB = SSAB/(m-1)·(k-1)
Test "Criterion A does notaffect the result", ν1= k-1:
FA = MSA/MSE
Test "Criterion B does notaffect the result", ν1= m-1:
FB = MSB/MSE
Test "Criteria A and B do notaffect the result", ν1 = (k-1)(m-1):
Fint = MSAB/MSE

For each F, if F > F α,ν1,ν2, then the hypothesis is rejected. ν2 = N-mk

Multifactorial

Multivariate analysis is similar to two-factor analysis - the same operations are performed, but the criteria are grouped and the influence of each of the factors is found iteratively.

With repeated measurements

The analysis of variance with repeated measurements indicates that several tests were performed for each criterion measurements of a random variable to obtain a more accurate result (since ANOVA) uses the intra-group sum of squares.

Application

Dispersion analysis is used in a wide variety of branches of science and production when it is necessary to study the dependence of the criteria on the difference in average values, while comparing not the average value, but the spread the results are around the mean, i.e. the variance.

Solving problems

As an example, let's give a problem from metrology. The plant houses five machines that produce shafts. It is necessary to determine whether the choice of a machine tool or the training of an employee affects the result of production. For analysis measurements are made for each machine and employee, the result is a table:

Operator 1
M1 30.361 30.736 30.441 30.479 30.549 30.583 30.955 30.759 30.779 30.567
M2 30.597 30.554 30.362 30.492 30.523 30.446 30.321 30.508 30.346 30.496
M3 30.324 30.32 30.316 30.374 30.361 30.353 30.319 30.357 30.372 30.312
M4 30.406 30.424 30.505 30.553 30.495 30.511 30.368 30.4 30.485 30.364
M5 30.378 30.327 30.312 30.345 30.371 30.352 30.333 30.321 30.366 30.338
Operator 2
M1 30.255 30.258 30.202 30.285 30.283 30.29 30.248 30.294 30.234 30.286
M2 30.833 30.563 30.767 30.962 30.988 30.978 30.342 30.314 30.539 30.589
M3 30.392 30.369 30.315 30.346 30.386 30.39 30.382 30.366 30.326 30.363
M4 30.374 30.35 30.367 30.366 30.397 30.314 30.365 30.352 30.399 30.344
M5 30.309 30.359 30.47 30.372 30.475 30.446 30.444 30.419 30.385 30.404

Let's use the method of two-factor analysis, factor A is the operator, factor B is the machine. Calculate the sums of squares, to do this, you need to calculate the average value for each of the groups:

TTA1TA2 TB1TB2TB3TB4TB5
3043.072 1522.2161520.856 608.844 611.52 607.043 608.139 607.526
SSA = 0.018
SSB = 0.619
SSAB = 0.931
SSE = 1.055

MSA = 0.018
MSB = 0.155
MSAB = 0.233
MSE = 0.264

FA = 0.068
FB = 0.587
FAB = 0.883

Critical values for the Fischer test:
Fcrit A = F0.1, 1, 90 = 2.77
Fcrit B = F0.1, 4, 90 = 2.01
Fcrit AB = F0.1, 4, 90 = 2.01

Results table:

The impact of the machine on the result Yes 0.068 < 2.77
The impact of the employee's qualifications on the result Yes 0.587 < 2.01
The mutual influence of the employee's qualifications and the choice of the machine on the result Yes 0.883 < 2.01

In excel/Open Calc

To solve the variance analysis in a spreadsheet, you will need the following formulas:

sumproduct Sum of products, used to find the sum of squares
finv Inverse value of the distribution F - Fisher criterion

Download table in the formats ods and xls.

Download article in PDF format.

Do you find this article curious? /

Seen: 12 340