The name is absent

Even though all tests are in the fields ‘Mathematics’ and ‘Science’, they do not necessarily
test the same cognitive skill: The IEA tests are related to common elements of school
curricula across countries while IAEP is geared towards the curriculum in USA building on
the national testing procedures developed by the National Assessment of Education Progress
NAEP. The OECD PISA test has a more real-world approach and claims to assess the skills
that are considered to be essential for full participation in the society. These differences do
not, however, seem to be very important with respect to measured student performance. For
example, the correlation coefficient between the test results for the 18 countries participating
both in TIMSS 2003 and PISA 2003 is 0.94.⁶

Table 1. Data sources description

Note. For some countries separate scores are reported for different parts of the country. We have calculated mean
country averages by using population as weight. IEA (except the 1983/84 test) and IAEP tests are conducted in
the fall in the southern hemisphere and in the spring in the northern hemisphere. PISA 2000 originally only
included five non-OECD countries, but nine additionally non-OECD countries conducted the same test in 2002.

Recently, it has become common to report national averages based on Items Response Theory
which weights the different questions by their difficulty (“Warm estimates”, Warm, 1989),
and standardizes the scores such that the average across all students across countries
participating is 500 with standard deviation of 100. Particularly the PISA studies employ this

⁶ The correlation coefficient between the average Science and Mathematics score in TIMSS-repeat 1999 and
PISA 2000 is 0.87 and for IAEP 1991 and TIMSS 1995 the correlation coefficient is 0.80. The correlation
coefficients are calculated using the adjusted test score described below. Interestingly, as can be seen from
Figure 2 below, USA has its poorest performance in the IAEP test that was based on the US curriculum.

<<   <   6   7   8   9   10   11   12   >   >>