Peiyao Li, Noah Castelo, Zsolt Katona, Miklos Sarvary
Published Online:25 Jan 2024 https://doi.org/10.1287/mksc.2023.0454
Abstract: This paper explores the potential of large language models (LLMs) to substitute for human participants in market research. Such LLMs can be used to generate text given a prompt. We argue that perceptual analysis is a particularly promising use case for such automated market research for certain product categories. The proposed new method generates outputs that closely match those generated from human surveys: agreement rates between human- and LLM- generated data sets reach over 75%. Moreover, this applies for perceptual analysis based on both brand similarity measures and product attribute ratings. The paper demonstrates that, for some categories, this new method of fully or partially automated market research will increase the efficiency of market research by meaningfully speeding up the process and potentially reducing the cost. Further results also suggest that with an ever larger training corpus applied to large language models, LLM-based market research will be applicable to answer more nuanced questions based on demographic variables or contextual variation that would be prohibitively expensive or infeasible with human respondents.
The article "Frontiers: Determining the Validity of Large Language Models for Automated Perceptual Analysis" by Peiyao Li, Noah Castelo, Zsolt Katona, and Miklos Sarvary discusses the potential of using large language models (LLMs) to substitute human participants in market research. The authors argue that perceptual analysis is a promising use case for automated market research using LLMs, as they can generate outputs that closely match those generated from human surveys. The study finds that agreement rates between human- and LLM-generated data sets reach over 75% for perceptual analysis based on brand similarity measures and product attribute ratings. The authors suggest that this new method of fully or partially automated market research will increase the efficiency of market research by speeding up the process and potentially reducing costs. The study was accepted through the Marketing Science: Frontiers review process and was funded by the Social Sciences and Humanities Research Council of Canada.
コメント