arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.18327cs.CYcs.CEcs.IRq-fin.CP
收藏

金融股权研究报告的结构——识别金融分析师报告中最常被问及的问题,以利用 Llama 3 和 GPT-4 实现股权研究自动化

The Structure of Financial Equity Research Reports -- Identification of the Most Frequently Asked Questions in Financial Analyst Reports to Automate Equity Research Using Llama 3 and GPT-4

Adria Pop, Jan Spörer

AI总结:

本文通过逐句分析72份金融股权研究报告,归纳出169个问题原型,发现78.7%的问题可自动化,并用Llama 3和GPT-4验证了约80%的陈述可由大语言模型自动生成,为股权研究写作流程的自动化提供了量化依据。

摘要:

本研究通过将金融股权研究报告(ERRs)的内容映射到不同类别来对其进行剖析。目前对ERRs中所回答问题缺乏充分的实证分析,尤其不清楚某些信息出现的频率、哪些信息被视为必要,以及哪些信息需要人类判断才能提炼成ERR。本研究逐句分析了72份ERRs,将其4940个句子归类为169个独特的问题原型。我们没有预先定义这些问题,而是仅从ERRs中的陈述推导得出。这一方法提供了对所观察ERRs内容的无偏视角。随后,我们利用公开的企业报告来对这些问题的自动化潜力进行分类。如果问题的答案可以在企业报告中获取,则将其标注为“文本可提取”。ERRs中78.7%的问题可以实现自动化。这些可自动化的问题由48.2%的文本可提取问题(适合由大语言模型LLMs处理)和30.5%的数据库可提取问题组成。只有21.3%的问题需要人类判断来回答。我们使用Llama-3-70B和GPT-4-turbo-2024-04-09进行了实证验证,结果表明语言生成和信息抽取方面的最新进展使得ERRs中约80%的陈述可以实现自动化。令人惊讶的是,这两个模型在优势和劣势上形成了良好的互补。研究证实,当前ERRs的撰写流程很可能受益于进一步的自动化,从而提高质量和效率。因此,本研究使我们能够量化在ERR撰写流程中引入大语言模型的潜在影响。完整的问题列表(包括问题原型及其频率)将在同行评审后在线提供。

英文摘要:

This research dissects financial equity research reports (ERRs) by mapping their content into categories. There is insufficient empirical analysis of the questions answered in ERRs. In particular, it is not understood how frequently certain information appears, what information is considered essential, and what information requires human judgment to distill into an ERR. The study analyzes 72 ERRs sentence-by-sentence, classifying their 4940 sentences into 169 unique question archetypes. We did not predefine the questions but derived them solely from the statements in the ERRs. This approach provides an unbiased view of the content of the observed ERRs. Subsequently, we used public corporate reports to classify the questions' potential for automation. Answers were labeled "text-extractable" if the answers to the question were accessible in corporate reports. 78.7% of the questions in ERRs can be automated. Those automatable question consist of 48.2% text-extractable (suited to processing by large language models, LLMs) and 30.5% database-extractable questions. Only 21.3% of questions require human judgment to answer. We empirically validate using Llama-3-70B and GPT-4-turbo-2024-04-09 that recent advances in language generation and information extraction enable the automation of approximately 80% of the statements in ERRs. Surprisingly, the models complement each other's strengths and weaknesses well. The research confirms that the current writing process of ERRs can likely benefit from additional automation, improving quality and efficiency. The research thus allows us to quantify the potential impacts of introducing large language models in the ERR writing process. The full question list, including the archetypes and their frequency, will be made available online after peer review.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑