Inconsistencies in reported employment characteristics among employed stayers


  • Francesca Bassi Università degli Studi di Padova
  • Alessandra Padoan Regione Veneto
  • Ugo Trivellato Università degli Studi di Padova



The paper deals with measurement error, and its potentially distorting role, in information on industry and professional status collected by labour force surveys. The focus of our analyses is on inconsistent information on these employment characteristics resulting from yearly transition matrices for workers who were continuously employed over the year and who did not change job. As a case-study we use yearly panel data for the period from April 1993 to April 2003 collected by the Italian Quarterly Labour Force Survey. The analysis goes through four steps: (i) descriptive indicators of (dis)agreement; (ii) testing whether the consistency of repeated information significantly increases when the number of categories is collapsed; (iii) examination of the pattern of inconsistencies among response categories by means of Goodman’s quasi-independence model; (iv) comparisons of alternative classifications jointly by professional status and occupation. Results document sizable measurement error, which is only moderately reduced by more aggregated classifications. They suggest that even cross-section estimates of employment by industry and/or professional status are affected by non-random measurement error.


H.X. BARNHART, J.M. WILLIAMSON (2002), Weighted least-squares approach for comparing correlated Kappa, “Biometrics”, 58, pp. 1012-1019.

J. BOUND, C. BROWN, N. MATHIOWETZ (2001), Measurement error in survey data, in J.J. Heckman and E. Leamer (eds.), “Handbook of Econometrics, Volume 5”, Elsevier Science, Amsterdam, pp. 3705-3843.

B. BURCHELL, S. DEAKIN, S. HONEY (1999), The employment status of individuals in non-standard employment, EMAR Publications No. 6, Department of Trade and Industry, London.

J. COHEN (1960), A coefficient of agreement for nominal tables, “Educational and Psychological Measurement”, 20, pp. 37-46.

J. COHEN (1968), Weighted kappa: Nominal scale agreement with provision for scale disagreement or partial credit, “Psychological Bulletin”, 70, pp. 213-220.

S.J. DAVIS, J. HALTIWANGER (1998), Measuring gross worker and job flows, in J. Haltiwanger, M. Manser and R. Topel (sds.), “Labor Statistics Measurement Issues”, University of Chicago Press, Chicago, pp. 77-119.

EUROSTAT (2000), Council Regulation (EC) No 1575/2000 of 19 July 2000 implementing Council Regulation (EC) No 577/1998 on the organization of the labour force sample survey in the Community concerning the codification to be used for data transmission from 2001 onwards, “Official Journal of the European Community”, L. 181, 20.07.2000, 16-33.

B. FALLICK, C.A. FLEISCHMAN (2004), Employer-to-employer flows in the U.S. labour market: The complete picture of gross worker flows. Finance and Economics Discussion Series 2004-34, Board of Governors of the Federal Reserve System (U.S.), Washington D.C..

J.L. FLEISS (1981), Statistical methods for rates and proportions, Wiley, New York.

M. GANDOLFO, P. GENNARI (2000), Il lavoro sommerso, è possibile rilevarlo? In Società Italiana di Statistica, Atti della XL Riunione Scientifica. Firenze 26-28 Apriel 2000, Università di Firenze, Dipartimento di Statistica G. Parenti.

L.A. GOODMAN (1968), The analysis of cross-classified data: independence, quasi-independence, and interaction in contingency tables, “Journal of the American Statistical Association”, 63, pp. 1019-1131.

K. GWET (2002), Inter-rater reliability: Dependency on trait prevalence and marginal homogeneity, “Statistical Methods for Inter-Rater Reliability Assessment”, 2, pp. 1-9.

K. GWET (2008), Computing inter-rater reliability and its variance in the presence of high agreement, “British Journal of Mathematical and Statistical Psychology”, 2, pp. 1-9.

J.A. HAGENAARS (1990), Categorical longitudinal data, Sage, Newbury Park.

M. HANSEN, W.N. HURWITZ, L. PRITZKER (1964), The estimation and interpretation of gross differences and the simple response variance, in C. Rao (ed.), “Contributions to Statistics” (presented to C. Mahalanobis on the occasion of his 70th birthday), Statistical Publishing Society, Calcutta, pp. 111-136.

G. KAMBOUROV, I. MANOVSKII (2008), Rising occupation and industry mobility in the United States: 1968-1997, “International Economic Review”, 49, pp.41-79.

G.G. KOCH, J.R. LANDIS, J.L. FREEMAN, D.H. FREEMAN, R.G. LEHNEN (1977), A general methodology for the analysis of experiments with repeated measurements of categorical data, “Biometrics”, 33, pp. 133-158.

ILO (2008). Resolution Concerning Updating the International Standard Classification of Occupation, Geneva.

A. ISAOGLU (2010), Occupational Affiliation Data and Measurement Error in the German Socio- Economic Panel, SOEP papers 318, DIW, Berlin.

ISTAT (2003), Rilevazione trimestrale sulle forze di lavoro. Tracciato record del file standard longitudinale (Aprile 2002-Aprile 2003), Roma (mimeo).

ISTAT (2004), La nuova rilevazione sulle forze di lavoro - Contenuti, metodologie, organizzazione, Roma.

J.R. LANDIS, G.G. KOCH (1977), The measurement of observer agreement for categorical data, “Biometrics”, 33, pp. 159-174.

P. LYNN, A. JÄCKLE, S.P. JENKINS, E. SALA (2006), The effects of dependent interviewing on responses to questions on income sources, “Journal of Official Statistics”, 22, pp. 357-384.

N. MATHIOWETZ (1992), Errors in reports of occupation, “Public Opinion Quarterly”, 56, pp. 352-355.

N. MATHIOWETZ, A. MCGONAGLE (2000), An assessment of the current state of dependent interviewing in household surveys, “Journal of Official Statistics”, 16, pp. 401-418.

W. MELLOW, H. SIDER (1983), Accuracy of response in labor market surveys: Evidence and implications, “Journal of Labor Economics”, 1, pp. 331-344.

B.P. MCCALL (1990), Occupational matching: A test of sorts, “Journal of Political Economy”, 89, pp. 45-69.

R.A. MILLER (1984), Job matching and occupation choice, “Journal of Political Economy”, 92, pp. 1086-1120.

D. NEAL (1999), The complexity of job mobility among young men, “Journal of Labour Economics”, 17, pp. 237-261.

E. SALA, P. LYNN (2006), Measuring change in employment characteristics: The effects of dependent interviewing, “International Journal of Public Opinion Research”, 18, pp. 500-509.

R. SHIMER (2005), The cyclicality of hires, separations, and job-to-job transitions, “Federal Reserve Bank of St Louis Review”, 87, pp. 493-597.

J. SIM, C.C. WRIGHT (2005), The Kappa statistics in reliability studies: use, interpretation, and sample size requirements, “Physical Therapy”, 85, pp.257-268.

U. TRIVELLATO (1997), Le misure della partecipazione al lavoro nel quadro comunitario, in L. Frey (Ed.), Le informazioni sul lavoro in Italia: significato e limiti delle informazioni provenienti da indagini sulle famiglie, Quaderni di Economia del Lavoro n. 59, Franco Angeli, Milano, pp. 9-34.

U. TRIVELLATO, A. PAGGIARO, R. LEOMBRUNI, S. ROSATI (2005), La dinamica recente della mobilità dei lavoratori, 1998-2003, in B. Contini and U. Trivellato (eds.), “Eppur si muove. Dinamiche e persistenze nel mercato del lavoro italiano”, Il Mulino, Bologna, pp. 271-323.




How to Cite

Bassi, F., Padoan, A., & Trivellato, U. (2012). Inconsistencies in reported employment characteristics among employed stayers. Statistica, 72(1), 93–109.