Reliability

Developing data analysis

Silverman, David (2005) Developing data analysis. In D. Silverman, Doing Qualitative Research, 2nd Edition (pp. 171-187). Thousand Oaks, CA: Sage Publications Description: (for entire book) Provides a step-by-step guide to all the questions students ask when beginning their first research project. Silverman demonstrates how to learn the craft of qualitative research by applying knowledge about different methods to actual data.

Techniques to Identify Themes

W., & Bernard, H. Russell (2003)
Field Methods, 15(1): 85-109
Description: Wonderful guide to describing and identifying themes in qualitative research

Mitchell, Sandra K. (1979)

Interobserver agreement, reliability, and generalizability of data collected in observational studies
Psychological Bulletin, 86(2): 376-390
Description: Discusses reliability and generalizability in terms of coefficients that reflect the "quality" of data, what defines quality data, and how reports of agreement are insufficient.

Hruschka, D. J., Schwartz, D., St. John, D. C., Picone-Decaro, E., Jenkins, R. A., & Carey, J. W. (2004)

Reliability in coding open-ended data: Lessons learned from HIV behavioral research
Field Methods, 16(3): 307-331
Description: Great discussion and illustration of issues and strategy for establishing reliability in inter-rater coding

House, Alvin E., House, Betty J., & Campbell, Martha B. (1981)

Measures of interobserver agreement: Calculation formulas and distribution effects
Journal of Behavioral Assessment, 3(1): 37-57
Description: Discusses issues, types, and calculations for inter-rater reliability

Guggenmoos-Holzmann, Irene (1996)

The meaning of Kappa: Probabilistic concepts of reliability and validity revisited
Journal of Clinical Epidemiology, 49(7): 775-782
Description: Discusses issues and calculations for inter-rater reliability and its use in coding validity

Coffey, Paul A., & Atkinson, Amanda J. (1996)

Making Sense of Qualitative Data. (chs. 2-4 for coding)
Thousand Oaks, CA: Sage Publications.
Description: Describes and illustrates a number of key, complementary approaches to qualitative data and offers practical advice on the many ways to analyze data. Practical and straightforward, with special attention paid to the possibilities in computer-aided analysis. A resource to students and professionals in qualitative and research methods, sociology, anthropology, communication, management, and educations for inter-rater reliability and its use in coding validity.

Weller, Susan C. (2007)

Cultural Consensus Theory: Applications and Frequently Asked Questions
Field Methods, 19(4): 339-368 
Description: Use of consensus theory to estimate culturally appropriate or "correct" answers to questions and assess individual differences in cultural knowledge. Describes the assumptions, appropriate interview materials, and analytic procedures fro carrying out a consensus analysis.

Moret, Margriet, Reuzel, Rob, Van Der Wilt, Gert J. & Grin, John (2007)

Validity and Reliability of Qualitative Data Analysis: Interobserver Agreement in Reconstructing Interpretative Frames
Field Methods, 19(1): 24-39
Description: Assessed interobserver reliability in the use of reconstructing interpretative frames techniques as an indicator of its rigor.

Pages

Subscribe to RSS - Reliability