Can AI interview? Comparing AI-led to Human-led Chat Interviews
Large language model chatbots have been proposed as AI-interviewers for collecting qualitative interview data at scale, potentially bridging social science's longstanding divide between the breadth of surveys and the depth of qualitative interviews.
ProofPaper ↗
Key points
- This paper provides the first direct empirical comparison of data quality in AI-led and human-led interviews.
- In a randomized experiment (N = 41), university students were interviewed via synchronous text chat by either trained non-expert interviewers or a locally hosted AI system; we evaluate exposure, specificity, and relevance.
- Median interview duration was similar across conditions, but AI-interviewers asked more than twice as many questions per interview and elicited roughly 65 percent more respondent text per interview.
- Our findings support the viability of AI-interviewing for large-N qualitative data collection.
Sources (1)
- [1]Can AI interview? Comparing AI-led to Human-led Chat InterviewsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 16, 08:43 AM
Large language model chatbots have been proposed as AI-interviewers for collecting qualitative interview data at scale, potentially bridging social science's longstanding divide between the breadth of surveys and the depth of qualitative interviews.
This paper provides the first direct empirical comparison of data quality in AI-led and human-led interviews.
Extractive summary: sentences quoted from the sources.