Breaking News: AI Outperforms Human Lawyers in Legal Research Tasks
A recent study by Vals AI has revealed that several AI applications, including ChatGPT, have surpassed human lawyers in drafting legal research reports. The study, which pitted AI against human lawyers on legal research tasks, found that the AI applications outperformed their human counterparts in accuracy, authoritativeness, and appropriateness. The results are a stark reminder that AI is rapidly advancing and may soon be capable of performing tasks that were previously thought to be the exclusive domain of humans.
According to the study, the AI applications, including ChatGPT, Midpage, Alexi, and Counsel Stack, outperformed the average human lawyer, who scored a median of 69, in drafting legal research reports. ChatGPT, a generalist AI model, scored 74, while Counsel Stack, a specialized AI application, scored the highest at 78. The study was conducted over three criteria: accuracy, authoritativeness, and appropriateness.
The study's findings have immediate implications for the legal profession, where AI is increasingly being used to automate tasks and provide support to human lawyers. The study's results suggest that AI may soon be capable of performing tasks that were previously thought to be the exclusive domain of humans, raising questions about the future of work in the legal profession.
The study's findings are part of a broader trend of AI outperforming humans in various tasks, including medical diagnosis, financial analysis, and customer service. This trend has significant implications for society, where AI is increasingly being used to automate tasks and provide support to humans.
The study was conducted by Vals AI, an AI evaluations company, and was published in a recent report. The study's findings are a reminder that AI is rapidly advancing and may soon be capable of performing tasks that were previously thought to be the exclusive domain of humans.
As AI continues to advance, it is likely that we will see more studies like this one, which highlight the capabilities and limitations of AI. The study's findings suggest that AI may soon be capable of performing tasks that were previously thought to be the exclusive domain of humans, raising questions about the future of work in various professions.
Share & Engage Share
Share this article