Application of LLMs for Solving Algorithm Coding Tests in Recruitment
Application of LLMs for Solving Algorithm Coding Tests in Recruitment

Author(s): Miloš Živadinović
Subject(s): Social Sciences
Published by: Udruženje ekonomista i menadžera Balkana
Keywords: LLM; Algorithm coding tests; Recruitment
Summary/Abstract: Usage of programming interview questions which consist of coding is one of the most common approaches when hiring new candidates. Candidates should possess a variety of skills and knowledge in order to solve these assignments properly within the time and memory constraints in order to pass the examinations. With the advent of LLM (Large Language Models) architectures such as ChatGPT, we are able to prove that the most common interview questions are trivial as a measure of knowledge. By comparing a dataset of common programming interview questions with answers generated by ChatGPT, we have shown significant results in favor of ChatGPT as a solution for solving programming interview questions with an acceptance rate of 96.58% which is 46.45% higher than the average. We conclude from these results that the existing practice of programming interview questions is flawed and that significant changes should be made to render it relevant or to abandon it completely in candidate testing.

• Details
• Contents