2020-11-06T14:31:50 q4

Performance judgements in the Idol series

Viewed: 636

Collected from multiple websites (wikipedia.org, tv.com and television show websites) this data set consists of observations of the ranking of contestants in live shows for several pop Idol series, from eight countries. The data were collected from the following countries during the specified years:

  • Australia (Australian Idol: 2003, 2004, 2006, 2007; X-factor: 2005)
  • Brazil (Idolos Brazil: 2007)
  • Canada (Canadian Idol: 2003, 2004, 2005, 2006, 2007)
  • Germany (Deutschland sucht den Superstar: 2003, 2004, 2006, 2007)
  • India (Indian Idol: 2006, 2007)
  • Netherlands (Idols: 2005; X-factor: 2006)
  • UK (X-factor: 2004, 2005, 2006, 2007)
  • USA (American Idol: 2002, 2003, 2004, 2005, 2006, 2007)

The effects of ordering on the evaluation of individual performance were studied, as the shows share a generic format. A comparison between the empirical probability to be "safe" during one show and the theoretical probability to be "safe" was conducted, to assess the existence of bias in contestants' performance evaluations. The publication arising from an analysis of this data presents new evidence about the systematic biases in sequential evaluation of performances and the psychological phenomena at the origin of these biases.

Analysis of the data was performed using Stata and SPSS. Identification systems in the data: variable to code "bottom 2."

Access rights

The owners of this data collection reserve the right to provide access to the data by negotiation. You could be required to indicate your intended use of the data and to fulfil other terms and conditions as determined by the data owners. Please contact Katie Page at katie.page@qut.edu.au for permission to view/re-use this data set.

Geographical area of data collection

Australia; USA; UK; Brazil; India; Germany; Canada; Netherlands.


Page, Lionel and Page, Katie. (2010). Last shall be first: a field study of biases in sequential performance evaluation on the Idol series. Journal of Economic Behavior and Organization, 73(2), p. 186. http://dx.doi.org/10.1016/j.jebo.2009.08.012

Research areas

Television shows
Applied Economics not elsewhere classified
Decision Making
Computer Perception, Memory and Attention
Econometric and Statistical Methods
Order effects
Film and Television

Cite this collection

Page, Lionel; Page, Katie (2012): Performance judgements in the Idol series. Queensland University of Technology. (Dataset) https://doi.org/10.4225/09/587d6aa41725b

Data file types


© L. Page and K. Page, 2010

Dates of data collection

From 2002 to 2007


Is output of
Katie Page  (Researcher)
Is owned by
Katie Page  (Researcher)
Lionel Page  (Researcher)


Name: Katie Page
Phone: +61 7 3138 6000
Fax: +61 7 3138 6030


Date record created:
Date record modified:
Record status:
Published - Open Access