Revolutionizing Finance with LLMs: An Overview of Applications and Insights
Paper · 2024 · Huaqin Zhao, Zhengliang Liu, Zihao Wu et al.
Summary
This survey examines how large language models can be applied to finance, a field where data is highly specialized and errors are costly. The authors, mainly from the University of Georgia, organize the literature around four task areas: engineering applications in finance, prediction of financial outcomes, the management of risk in finance, and answering financial questions in real time. They also cover the underlying technology, including Transformer self-attention, BPE tokenization, decoding strategies, and NER.
The empirical part tests GPT-4 on 11 financial tasks using natural-language instructions. Where public benchmarks exist, GPT-4 is scored on them. Where they do not, the authors present illustrative case studies. GPT-4 follows task prompts reliably and does well on text-centred work such as sentiment analysis and entity extraction. It is weaker on numeric reasoning and market-movement prediction.
The authors argue that LLMs currently serve as helpers rather than standalone tools for computational finance, including optimization and quantitative trading. They recommend hybrid systems that pair LLM text analysis with quantitative models. For practitioners, the survey offers a map of use cases and a realistic sense of current limits.
Key points
- GPT-4 benchmark scores: FPB 0.78 Acc, FiQA-SA 0.79 Acc, NER 0.81 EntityF1, FinQA 0.64 EmAcc, ConvFinQA 0.73 EmAcc, BigData22 (stock movement) 0.53 Acc.
- In a fraud-detection case study on the PaySim simulated mobile-money dataset, GPT-4 classified all 5 sample transactions correctly.
- The survey's taxonomy groups LLM finance applications into four areas: financial engineering, forecasting, risk management, and real-time QA.
- The authors identify a main limitation: LLMs cannot perform quantitative computation directly. Their sentiment outputs are better used as inputs to existing models.
- Proposed future directions include LLM-plus-quant hybrid systems, more interpretable and reliable outputs, and trend prediction that combines historical data with news.
Institutions
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 worksDecision Sciences · 209 worksManagement Science and Operations Research · 108 works
Cite
Cite as Huaqin Zhao, Zhengliang Liu, Zihao Wu, Yiwei Li, Tianze Yang, Peng Shu, Shaochen Xu, Haixing Dai, Lin Zhao, Hanqi Jiang, Yi Pan, Junhao Chen, Yifan Zhou, Zheyuan Zhang, Zeyu Zhang, Ruitong Sun, Gengchen Mai, Ninghao Liu and Tianming Liu. 2024. Revolutionizing Finance with LLMs: An Overview of Applications and Insights. arXiv:2401.11641.
@misc{zhao2024revolutionizing,
title = {{Revolutionizing Finance with LLMs: An Overview of Applications and Insights}},
author = {Huaqin Zhao, Zhengliang Liu, Zihao Wu, Yiwei Li, Tianze Yang, Peng Shu, Shaochen Xu, Haixing Dai, Lin Zhao, Hanqi Jiang, Yi Pan, Junhao Chen, Yifan Zhou, Zheyuan Zhang, Zeyu Zhang, Ruitong Sun, Gengchen Mai, Ninghao Liu and Tianming Liu},
year = {2024},
doi = {10.48550/arxiv.2401.11641},
eprint = {2401.11641},
archivePrefix = {arXiv},
url = {https://doi.org/10.48550/arxiv.2401.11641}
}References
- Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al.: Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023)
- Ahmadi, Z., Martens, P., Koch, C., Gottron, T., Kramer, S.: Towards bankruptcy prediction: Deep sentiment mining to detect financial distress from business management reports. In: 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA). pp. 293–302. IEEE (2018) find
- Ali, S.R.M.: Geopolitical threat, market capitalization, and portfolio return. Market Capitalization, and Portfolio Return find
- Alvarado, J.C.S., Verspoor, K., Baldwin, T.: Domain adaption of named entity recognition to support credit risk assessment. In: Proceedings of the Australasian Language Technology Association Workshop 2015. pp. 84–90 (2015) find
- Araci, D.: Finbert: Financial sentiment analysis with pre-trained language models. arXiv preprint arXiv:1908.10063 (2019) find
- Audrino, F., Sigrist, F., Ballinari, D.: The impact of sentiment and attention measures on stock market volatility. International Journal of Forecasting 36(2), 334–357 (2020) find
- Aw, E.C.X., Leong, L.Y., Hew, J.J., Rana, N.P., Tan, T.M., Jee, T.W.: Counteracting dark sides of robo-advisors: justice, privacy and intrusion considerations. International Journal of Bank Marketing (2023) find
- Babaei, G., Giudici, P.: Gpt classifications, with application to credit lending. Available at SSRN 4649285 (2023) find
- Baker, T., Dellaert, B.: Regulating robo advice across the financial services industry. Iowa L. Rev. 103, 713 (2017) find
- Bollen, J., Mao, H., Zeng, X.: Twitter mood predicts the stock market. Journal of computational science 2(1), 1–8 (2011) find
- Brigo, D., Mercurio, F.: Interest rate models-theory and practice: with smile, inflation and credit, vol. 2. Springer (2006) find
- Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. Advances in neural information processing systems 33, 1877–1901 (2020)
- Buehler, H., Gonon, L., Teichmann, J., Wood, B.: Deep hedging. Quantitative Finance 19(8), 1271–1291 (2019) find
- Cai, H., Liao, W., Liu, Z., Zhang, Y., Huang, X., Ding, S., Ren, H., Wu, Z., Dai, H., Li, S., Wu, L., Liu, N., Li, Q., Liu, T., Li, X.: Coarse-to-fine knowledge graph domain adaptation based on distantly-supervised iterative training (2023) find
- Cai, H., Liao, W., Liu, Z., Zhang, Y., Huang, X., Ding, S., Ren, H., Wu, Z., Dai, H., Li, S., et al.: Coarse-to-fine knowledge graph domain adaptation based on distantly-supervised iterative training. arXiv preprint arXiv:2211.02849 (2022) — [arXiv:2211.02849](https://arxiv.org/abs/2211.02849) find
- Caspi, I., Felber, S.S., Gillis, T.B.: Generative ai and the future of financial advice regulation find
- Chang, C., Peng, W.C., Chen, T.F.: Llm4ts: Two-stage fine-tuning for time-series forecasting with pre-trained llms. arXiv preprint arXiv:2308.08469 (2023) — [arXiv:2308.08469](https://arxiv.org/abs/2308.08469) find
- Chang, Y., Wang, X., Wang, J., Wu, Y., Zhu, K., Chen, H., Yang, L., Yi, X., Wang, C., Wang, Y., et al.: A survey on evaluation of large language models. arXiv preprint arXiv:2307.03109 (2023)
- Chen, J.M.: Models for predicting business bankruptcies and their application to banking and financial regulation. Penn St. L. Rev. 123, 735 (2018) find
- Chen, Z., Chen, W., Smiley, C., Shah, S., Borova, I., Langdon, D., Moussa, R., Beane, M., Huang, T.H., Routledge, B., et al.: Finqa: A dataset of numerical reasoning over financial data. arXiv preprint arXiv:2109.00122 (2021)
- Chen, Z., Li, S., Smiley, C., Ma, Z., Shah, S., Wang, W.Y.: Convfinqa: Exploring the chain of numerical reasoning in conversational finance question answering. arXiv preprint arXiv:2210.03849 (2022)
- Ciuriak, D., Artyushina, A.: Trading ai: Machine knowledge capital and the trading system. Available at SSRN (2023) find
- Clément, A., Robinot, É., Trespeuch, L.: Improving esg scores with sustainability concepts. Sustainability 14(20), 13154 (2022) find
- Cont, R.: Empirical properties of asset returns: stylized facts and statistical issues. Quantitative finance 1(2), 223 (2001) find
- Dai, H., Li, Y., Liu, Z., Zhao, L., Wu, Z., Song, S., Shen, Y., Zhu, D., Li, X., Li, S., Yao, X., Shi, L., Li, Q., Chen, Z., Zhang, D., Mai, G., Liu, T.: Ad-autogpt: An autonomous gpt for alzheimer’s disease infodemiology (2023) find
- Dai, H., Liu, Z., Liao, W., Huang, X., Cao, Y., Wu, Z., Zhao, L., Xu, S., Liu, W., Liu, N., Li, S., Zhu, D., Cai, H., Sun, L., Li, Q., Shen, D., Liu, T., Li, X.: Auggpt: Leveraging chatgpt for text data augmentation (2023)
- Dastile, X., Celik, T., Potsane, M.: Statistical and machine learning models in credit scoring: A systematic literature survey. Applied Soft Computing 91, 106263 (2020) find
- Deng, X., Bashlovkina, V., Han, F., Baumgartner, S., Bendersky, M.: What do llms know about financial markets? a case study on reddit market sentiment analysis. In: Companion Proceedings of the ACM Web Conference 2023. pp. 107–110 (2023) find
- Dou, F., Ye, J., Yuan, G., Lu, Q., Niu, W., Sun, H., Guan, L., Lu, G., Mai, G., Liu, N., Lu, J., Liu, Z., Wu, Z., Tan, C., Xu, S., Wang, X., Li, G., Chai, L., Li, S., Sun, J., Sun, H., Shao, Y., Li, C., Liu, T., Song, W.: Towards artificial general intelligence (agi) in the internet of things (iot):… find
- Ehrmann, M., Hamdi, A., Pontes, E.L., Romanello, M., Doucet, A.: Named entity recognition and classification on historical documents: A survey (2021) find
- Ehrmann, M., Hamdi, A., Pontes, E.L., Romanello, M., Doucet, A.: Named entity recognition and classification in historical documents: A survey. ACM Computing Surveys 56(2), 1–47 (2023) find
- Ekbal, A., Bandyopadhyay, S.: Named entity recognition using support vector machine: A language independent approach. International Journal of Electrical and Computer Engineering 4(3), 589–604 (2010) find
- Escrig-Olmedo, E., Fernández-Izquierdo, M.Á., Ferrero-Ferrero, I., Rivera-Lirio, J.M., Muñoz-Torres, M.J.: Rating the raters: Evaluating how esg rating agencies integrate sustainability principles. Sustainability 11(3), 915 (2019) find
- Fan, J.: A selective overview of nonparametric methods in financial econometrics. Statistical Science pp. 317–337 (2005) find
- Feng, D., Dai, Y., Huang, J., Zhang, Y., Xie, Q., Han, W., Lopez-Lira, A., Wang, H.: Empowering many, biasing a few: Generalist credit scoring through large language models. arXiv preprint arXiv:2310.00566 (2023) — [arXiv:2310.00566](https://arxiv.org/abs/2310.00566) find
- Freitag, M., Al-Onaizan, Y.: Beam search strategies for neural machine translation. arXiv preprint arXiv:1702.01806 (2017)
- Friede, G., Busch, T., Bassen, A.: Esg and financial performance: aggregated evidence from more than 2000 empirical studies. Journal of sustainable finance & investment 5(4), 210–233 (2015) find
- Gage, P.: A new algorithm for data compression. C Users Journal 12(2), 23–38 (1994) find
- Ge, Y., Hua, W., Ji, J., Tan, J., Xu, S., Zhang, Y.: Openagi: When llm meets domain experts. arXiv preprint arXiv:2304.04370 (2023) — [arXiv:2304.04370](https://arxiv.org/abs/2304.04370) find
- Gong, X., Holmes, J., Li, Y., Liu, Z., Gan, Q., Wu, Z., Zhang, J., Zou, Y., Teng, Y., Jiang, T., Zhu, H., Liu, W., Liu, T., Yan, Y.: Evaluating the potential of leading large language models in reasoning biology questions (2023) find
- Guan, Z., Wu, Z., Liu, Z., Wu, D., Ren, H., Li, Q., Li, X., Liu, N.: Cohortgpt: An enhanced gpt for participant recruitment in clinical study (2023) find
- Gupta, U.: Gpt-investar: Enhancing stock investment strategies through annual report analysis with large language models. arXiv preprint arXiv:2309.03079 (2023) — [arXiv:2309.03079](https://arxiv.org/abs/2309.03079) find
- Holmes, J., Liu, Z., Zhang, L., Ding, Y., Sio, T., McGee, L., Ashman, J., Li, X., Liu, T., Shen, J., et al.: Evaluating large language models on a highly-specialized topic. Radiation Oncology Physics (2023) find
- Holmes, J., Zhang, L., Ding, Y., Feng, H., Liu, Z., Liu, T., Wong, W.W., Vora, S.A., Ashman, J.B., Liu, W.: Benchmarking a foundation llm on its ability to re-label structure names in accordance with the aapm tg-263 report (2023) find
- Jeong, C.: Fine-tuning and utilization methods of domain-specific llms (2024) find
- Jin, M., Wang, S., Ma, L., Chu, Z., Zhang, J.Y., Shi, X., Chen, P.Y., Liang, Y., Li, Y.F., Pan, S., et al.: Time-llm: Time series forecasting by reprogramming large language models. arXiv preprint arXiv:2310.01728 (2023) find
- Johansen, S.: Likelihood-based inference in cointegrated vector autoregressive models. OUP Oxford (1995) find
- Kalra, S., Prasad, J.S.: Efficacy of news sentiment for stock market prediction. In: 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon). pp. 491–496. IEEE (2019) find
- Kalyanaraman, V., Kazi, S., Tondulkar, R., Oswal, S.: Sentiment analysis on news articles for stocks. In: 2014 8th Asia Modelling Symposium. pp. 10–15. IEEE (2014) find
- Khedr, A.E., Yaseen, N., et al.: Predicting stock market behavior using data mining technique and news sentiment analysis. International Journal of Intelligent Systems and Applications 9(7), 22 (2017) find
- Kim, A.G., Yoon, S.: Corporate bankruptcy prediction with domain-adapted bert. In: EMNLP 2021, 3rd Workshop on ECONLP (2021) find
- Kirange, D., Deshmukh, R.R., et al.: Sentiment analysis of news headlines for stock price prediction. Composoft, An International Journal of Advanced Computer Technology 5(3), 2080–2084 (2016) find
- Kojima, T., Gu, S.S., Reid, M., Matsuo, Y., Iwasawa, Y.: Large language models are zero-shot reasoners. Advances in neural information processing systems 35, 22199–22213 (2022)
- Lee, C.F., Chen, H.Y., Lee, J.: Financial econometrics, mathematics and statistics. Springer (2019) find
- Lee, G.G., Shi, L., Latif, E., Gao, Y., Bewersdorf, A., Nyaaba, M., Guo, S., Wu, Z., Liu, Z., Wang, H., et al.: Multimodality of ai for education: Towards artificial general intelligence. arXiv preprint arXiv:2312.06037 (2023) — [arXiv:2312.06037](https://arxiv.org/abs/2312.06037) find
- Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., Zettlemoyer, L.: Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 (2019)
- Li, J., Sun, A., Han, J., Li, C.: A survey on deep learning for named entity recognition. IEEE Transactions on Knowledge and Data Engineering 34(1), 50–70 (2020) find
- Li, Q., Wang, T., Li, P., Liu, L., Gong, Q., Chen, Y.: The effect of news and public mood on stock movements. Information Sciences 278, 826–840 (2014) find
- Li, X., Zhang, L., Wu, Z., Liu, Z., Zhao, L., Yuan, Y., Liu, J., Li, G., Zhu, D., Yan, P., Li, Q., Liu, W., Liu, T., Shen, D.: Artificial general intelligence for medical imaging (2023) find
- Li, X., Wu, P., Wang, W.: Incorporating stock prices and news sentiments for stock market prediction: A case of hong kong. Information Processing & Management 57(5), 102212 (2020) find
- Liao, W., Liu, Z., Dai, H., Wu, Z., Zhang, Y., Huang, X., Chen, Y., Jiang, X., Liu, W., Zhu, D., Liu, T., Li, S., Li, X., Cai, H.: Mask-guided bert for few shot text classification (2023) find
- Liao, W., Liu, Z., Dai, H., Wu, Z., Zhang, Y., Huang, X., Chen, Y., Jiang, X., Zhu, D., Liu, T., et al.: Mask-guided bert for few shot text classification. arXiv preprint arXiv:2302.10447 (2023) — [arXiv:2302.10447](https://arxiv.org/abs/2302.10447) find
- Liao, W., Liu, Z., Dai, H., Xu, S., Wu, Z., Zhang, Y., Huang, X., Zhu, D., Cai, H., Liu, T., Li, X.: Differentiate chatgpt-generated and human-written medical texts (2023) find
- Liu, C., Liu, Z., Holmes, J., Zhang, L., Zhang, L., Ding, Y., Shu, P., Wu, Z., Dai, H., Li, Y., Shen, D., Liu, N., Li, Q., Li, X., Zhu, D., Liu, T., Liu, W.: Artificial general intelligence for radiation oncology. Meta-Radiology p. 100045 (2023). https://doi.org/https://doi.org/10.1016/j.metrad.2023… — [doi:10.1016/j.metrad.2023.100045](https://doi.org/10.1016/j.metrad.2023.100045) find
- Liu, C., Liu, Z., Holmes, J., Zhang, L., Zhang, L., Ding, Y., Shu, P., Wu, Z., Dai, H., Li, Y., et al.: Artificial general intelligence for radiation oncology. Meta-Radiology p. 100045 (2023) find
- Liu, X.Y., Wang, G., Yang, H., Zha, D.: Fingpt: Democratizing internet-scale data for financial large language models (2023) find
- Liu, X., Li, H., Zhu, X.: A gpt-based method of automated compliance checking through prompt engineering (2023) find
- Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al.: Summary of chatgpt-related research and perspective towards the future of large language models. Meta-Radiology p. 100017 (2023)
- Liu, Y., He, H., Han, T., Zhang, X., Liu, M., Tian, J., Zhang, Y., Wang, J., Gao, X., Zhong, T., et al.: Understanding llms: A comprehensive overview from training to inference. arXiv preprint arXiv:2401.02038 (2024) — [arXiv:2401.02038](https://arxiv.org/abs/2401.02038) find
- Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., et al.: Radiology-gpt: a large language model for radiology. arxiv [preprint]. 2023 [cited august 21, 2023] find
- Liu, Z., He, M., Jiang, Z., Wu, Z., Dai, H., Zhang, L., Luo, S., Han, T., Li, X., Jiang, X., et al.: Survey on natural language processing in medical image analysis. Zhong nan da xue xue bao. Yi xue ban= Journal of Central South University. Medical Sciences 47(8), 981–993 (2022) find
- Liu, Z., He, X., Liu, L., Liu, T., Zhai, X.: Context matters: A strategy to pre-train language model for science education. arXiv preprint arXiv:2301.12031 (2023) — [arXiv:2301.12031](https://arxiv.org/abs/2301.12031) find
- Liu, Z., Li, Y., Cao, Q., Chen, J., Yang, T., Wu, Z., Hale, J., Gibbs, J., Rasheed, K., Liu, N., et al.: Transformation vs tradition: Artificial general intelligence (agi) for arts and humanities. arXiv preprint arXiv:2310.19626 (2023) — [arXiv:2310.19626](https://arxiv.org/abs/2310.19626) find
- Liu, Z., Li, Y., Shu, P., Zhong, A., Yang, L., Ju, C., Wu, Z., Ma, C., Luo, J., Chen, C., Kim, S., Hu, J., Dai, H., Zhao, L., Zhu, D., Liu, J., Liu, W., Shen, D., Liu, T., Li, Q., Li, X.: Radiology-llama2: Best-in-class large language model for radiology (2023) find
- Liu, Z., Wang, P., Li, Y., Holmes, J., Shu, P., Zhang, L., Liu, C., Liu, N., Zhu, D., Li, X., Li, Q., Patel, S.H., Sio, T.T., Liu, T., Liu, W.: Radonc-gpt: A large language model for radiation oncology (2023) find
- Liu, Z., Wu, Z., Hu, M., Zhao, B., Zhao, L., Zhang, T., Dai, H., Chen, X., Shen, Y., Li, S., Murray, B., Liu, T., Sikora, A.: Pharmacygpt: The ai pharmacist (2023) find
- Liu, Z., Yu, X., Zhang, L., Wu, Z., Cao, C., Dai, H., Zhao, L., Liu, W., Shen, D., Li, Q., Liu, T., Zhu, D., Li, X.: Deid-gpt: Zero-shot medical text de-identification by gpt-4 (2023) find
- Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., Dai, H., Zhao, L., Zhu, D., Liu, J., Liu, W., Shen, D., Li, Q., Liu, T., Li, X.: Tailoring large language models to radiology: A preliminary approach to llm adaptation for a highly specialized domain. In: Cao,… find
- Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., Dai, H., Zhao, L., Zhu, D., Liu, J., Liu, W., Shen, D., Li, X., Li, Q., Liu, T.: Radiology-gpt: A large language model for radiology (2023) find
- Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., et al.: Radiology-gpt: A large language model for radiology. arXiv preprint arXiv:2306.08666 (2023) — [arXiv:2306.08666](https://arxiv.org/abs/2306.08666) find
- Lopez-Lira, A., Tang, Y.: Can chatgpt forecast stock price movements? return predictability and large language models. arXiv preprint arXiv:2304.07619 (2023) find
- Lopez-Rojas, E., Elmir, A., Axelsson, S.: Paysim: A financial mobile money simulator for fraud detection. In: 28th European Modeling and Simulation Symposium, EMSS, Larnaca. pp. 249–255. Dime University of Genoa (2016) find
- Lourenço, C.J., Dellaert, B.G., Donkers, B.: Whose algorithm says so: The relationships between type of firm, perceptions of trust and expertise, and the acceptance of financial robo-advice. Journal of Interactive Marketing 49, 107–124 (2020) find
- Luo, B., Zhang, Z., Wang, Q., Ke, A., Lu, S., He, B.: Ai-powered fraud detection in decentralized finance: A project life cycle perspective. arXiv preprint arXiv:2308.15992 (2023) — [arXiv:2308.15992](https://arxiv.org/abs/2308.15992) find
- Luo, L., Yang, Z., Yang, P., Zhang, Y., Wang, L., Lin, H., Wang, J.: An attention-based bilstm-crf approach to document-level chemical named entity recognition. Bioinformatics 34(8), 1381–1388 (2018) find
- Ma, C., Wu, Z., Wang, J., Xu, S., Wei, Y., Liu, Z., Jiang, X., Guo, L., Cai, X., Zhang, S., Zhang, T., Zhu, D., Shen, D., Liu, T., Li, X.: Impressiongpt: An iterative optimizing framework for radiology report summarization with chatgpt (2023) find
- Maia, M., Handschuh, S., Freitas, A., Davis, B., McDermott, R., Zarrouk, M., Balahur, A.: Www’18 open challenge: financial opinion mining and question answering. In: Companion proceedings of the the web conference 2018. pp. 1941–1942 (2018) find
- Makridakis, S., Petropoulos, F., Kang, Y.: Large language models: Their success and impact. Forecasting 5(3), 536–549 (2023) find
- Malo, P., Sinha, A., Korhonen, P., Wallenius, J., Takala, P.: Good debt or bad debt: Detecting semantic orientations in economic texts. Journal of the Association for Information Science and Technology 65(4), 782–796 (2014) find
- Maple, C., Szpruch, L., Epiphaniou, G., Staykova, K., Singh, S., Penwar-den, W., Wen, Y., Wang, Z., Hariharan, J., Avramovic, P.: The ai revolution: opportunities and challenges for the finance sector. arXiv preprint arXiv:2308.16538 (2023) — [arXiv:2308.16538](https://arxiv.org/abs/2308.16538) find
- Mittal, A., Goel, A.: Stock prediction using twitter sentiment analysis. Standford University, CS229 (2011 http://cs229.stanford. edu/proj2011/GoelMittal-StockMarketPredictionUsingTwitterSentimentAnalysis. pdf) 15, 2352 (2012) ↗
- Mohan, S., Mullapudi, S., Sammeta, S., Vijayvergia, P., Anastasiu, D.C.: Stock price prediction using news sentiment analysis. In: 2019 IEEE fifth international conference on big data computing service and applications (BigDataService). pp. 205–208. IEEE (2019) find
- Nasar, Z., Jaffry, S.W., Malik, M.K.: Named entity recognition and relation extraction: State-of-the-art. ACM Computing Surveys (CSUR) 54(1), 1–39 (2021) find
- Nelson, B.K.: Time series analysis using autoregressive integrated moving average (arima) models. Academic emergency medicine 5(7), 739–744 (1998) find
- Nguyen, T.H., Shirai, K., Velcin, J.: Sentiment analysis on social media for stock movement prediction. Expert Systems with Applications 42(24), 9603–9611 (2015) find
- Nourallah, M.: One size does not fit all: Young retail investors’ initial trust in financial robo-advisors. Journal of Business Research 156, 113470 (2023) find
- Orderud, F.: Comparison of kalman filter estimation approaches for state space models with nonlinear measurements. In: Proc. of Scandinavian Conference on Simulation and Modeling. pp. 1–8 (2005) find
- Paulson, F.L., et al.: What makes a portfolio a portfolio?. Educational leadership 48(5), 60–63 (1991) find
- Radford, A., Narasimhan, K., Salimans, T., Sutskever, I., et al.: Improving language understanding by generative pre-training (2018) find
- Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., et al.: Language models are unsupervised multitask learners. OpenAI blog 1(8), 9 (2019) find
- Radha, S., Thenmozhi, M.: Forecasting short term interest rates using arma, arma-garch and arma-egarch models. In: Indian Institute of Capital Markets 9th Capital Markets Conference Paper (2006) find
- Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P.J.: Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research 21(1), 5485–5551 (2020)
- Rezayi, S., Dai, H., Liu, Z., Wu, Z., Hebbar, A., Burns, A.H., Zhao, L., Zhu, D., Li, Q., Liu, W., et al.: Clinicalradiobert: Knowledge-infused few shot learning for clinical notes named entity recognition. In: International Workshop on Machine Learning in Medical Imaging. pp. 269–278. Springer (202… find
- Rezayi, S., Liu, Z., Wu, Z., Dhakal, C., Ge, B., Dai, H., Mai, G., Liu, N., Zhen, C., Liu, T., et al.: Exploring new frontiers in agricultural nlp: Investigating the potential of large language models for food applications. arXiv preprint arXiv:2306.11892 (2023) — [arXiv:2306.11892](https://arxiv.org/abs/2306.11892) find
- Rezayi, S., Liu, Z., Wu, Z., Dhakal, C., Ge, B., Zhen, C., Liu, T., Li, S.: Agribert: knowledge-infused agricultural language models for matching food and nutrition. In: Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence. vol. 7, pp. 5150–5156 (2022) find
- Roy, A., Sun, J., Mahoney, R., Alonzi, L., Adams, S., Beling, P.: Deep learning detecting fraud in credit card transactions. In: 2018 systems and information engineering design symposium (SIEDS). pp. 129–134. IEEE (2018) find
- Scherer, B., Lehner, S.: Trust me, i am a robo-advisor. Journal of Asset Management 24(2), 85–96 (2023) find
- Sert, O.C., Şahin, S.D., Özyer, T., Alhajj, R.: Analysis and prediction in sparse and high dimensional text data: The case of dow jones stock market. Physica A: Statistical Mechanics and its Applications 545, 123752 (2020) find
- Shah, D., Isah, H., Zulkernine, F.: Predicting the effects of news sentiments on the stock market. In: 2018 IEEE International Conference on Big Data (Big Data). pp. 4705–4708. IEEE (2018) find
- Shah, R.S., Chawla, K., Eidnani, D., Shah, A., Du, W., Chava, S., Raman, N., Smiley, C., Chen, J., Yang, D.: When flue meets flang: Benchmarks and large pre-trained language model for financial domain. arXiv preprint arXiv:2211.00083 (2022) find
- Shi, Y., Xu, S., Liu, Z., Liu, T., Li, X., Liu, N.: Mededit: Model editing for medical question answering with external knowledge bases (2023) find
- Soun, Y., Yoo, J., Cho, M., Jeon, J., Kang, U.: Accurate stock movement prediction with self-supervised learning from sparse noisy tweets. In: 2022 IEEE International Conference on Big Data (Big Data). pp. 1691–1700. IEEE (2022) find
- Sun, L., Huang, Y., Wang, H., Wu, S., Zhang, Q., Gao, C., Huang, Y., Lyu, W., Zhang, Y., Li, X., et al.: Trustllm: Trustworthiness in large language models. arXiv preprint arXiv:2401.05561 (2024)
- Tan, C., Cao, Q., Li, Y., Zhang, J., Yang, X., Zhao, H., Wu, Z., Liu, Z., Yang, H., Wu, N., et al.: On the promises and challenges of multimodal foundation models for geographical, environmental, agricultural, and urban planning applications. arXiv preprint arXiv:2312.17016 (2023) — [arXiv:2312.17016](https://arxiv.org/abs/2312.17016) find
- Tang, C., Liu, Z., Ma, C., Wu, Z., Li, Y., Liu, W., Zhu, D., Li, Q., Li, X., Liu, T., Fan, L.: Policygpt: Automated analysis of privacy policies with large language models (2023) find
- Tang, R., Chuang, Y.N., Hu, X.: The science of detecting llm-generated texts. arXiv preprint arXiv:2303.07205 (2023) — [arXiv:2303.07205](https://arxiv.org/abs/2303.07205) find
- Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al.: Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023)
- Usha, M., Devi, M.I.: Analysis of sentiments using unsupervised learning techniques. In: 2013 International Conference on Information Communication and Embedded Systems (ICICES). pp. 241–245. IEEE (2013) find
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention is all you need. Advances in neural information processing systems 30 (2017)
- Visintin, A., Conti, M.: Leveraging social networks for mergers and acquisitions forecasting. In: International Conference on Web Information Systems Engineering. pp. 144–159. Springer (2023) find
- Wang, J., Liu, Z., Zhao, L., Wu, Z., Ma, C., Yu, S., Dai, H., Yang, Q., Liu, Y., Zhang, S., Shi, E., Pan, Y., Zhang, T., Zhu, D., Li, X., Jiang, X., Ge, B., Yuan, Y., Shen, D., Liu, T., Zhang, S.: Review of large vision models and visual prompt engineering (2023) find
- Wang, J., Wu, Z., Li, Y., Jiang, H., Shu, P., Shi, E., Hu, H., Ma, C., Liu, Y., Wang, X., et al.: Large language models for robotics: Opportunities, challenges, and perspectives. arXiv preprint arXiv:2401.04334 (2024) — [arXiv:2401.04334](https://arxiv.org/abs/2401.04334) find
- Wang, S., Yuan, H., Zhou, L., Ni, L.M., Shum, H.Y., Guo, J.: Alpha-gpt: Human-ai interactive alpha mining for quantitative investment (2023) find
- Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., Zhou, D., et al.: Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35, 24824–24837 (2022)
- Wu, S., Irsoy, O., Lu, S., Dabravolski, V., Dredze, M., Gehrmann, S., Kambadur, P., Rosenberg, D., Mann, G.: Bloomberggpt: A large language model for finance (2023)
- Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q.L., Tang, Y.: A brief overview of chatgpt: The history, status quo and potential future development. IEEE/CAA Journal of Automatica Sinica 10(5), 1122–1136 (2023) find
- Wu, Z., Zhang, L., Cao, C., Yu, X., Dai, H., Ma, C., Liu, Z., Zhao, L., Li, G., Liu, W., Li, Q., Shen, D., Li, X., Zhu, D., Liu, T.: Exploring the trade-offs: Unified large language models vs local fine-tuned models for highly-specific radiology nli task (2023) find
- Xie, Q., Han, W., Zhang, X., Lai, Y., Peng, M., Lopez-Lira, A., Huang, J.: Pixiu: A large language model, instruction data and evaluation benchmark for finance (2023) find
- Yang, H., Liu, X.Y., Wang, C.D.: Fingpt: Open-source financial large language models. arXiv preprint arXiv:2306.06031 (2023)
- Yang, L., Ng, T.L.J., Smyth, B., Dong, R.: Fact check: Analyzing financial events from multilingual news sources. arXiv preprint arXiv:2106.15221 (2021) — [arXiv:2106.15221](https://arxiv.org/abs/2106.15221) find
- Yang, Y., Uy, M.C.S., Huang, A.: Finbert: A pretrained language model for financial communications. arXiv preprint arXiv:2006.08097 (2020) find
- Yoon, S.: Design and implementation of an llm system to improve response time for smes technology credit evaluation. International journal of advanced smart convergence 12(3), 51–60 (2023) find
- Yu, J.H., Kang, J., Park, S.: Information availability and return volatility in the bitcoin market: analyzing differences of user opinion and interest. Information Processing & Management 56(3), 721–732 (2019) find
- Yu, X., Chen, Z., Ling, Y., Dong, S., Liu, Z., Lu, Y.: Temporal data meets llm – explainable financial time series forecasting (2023) find
- Yu, Y., Li, H., Chen, Z., Jiang, Y., Li, Y., Zhang, D., Liu, R., Suchow, J.W., Khashanah, K.: Finme: A performance-enhanced large language model trading agent with layered memory and character design. arXiv preprint arXiv:2311.13743 (2023) — [arXiv:2311.13743](https://arxiv.org/abs/2311.13743) find
- Zhang, B., Yang, H., Zhou, T., Ali Babar, M., Liu, X.Y.: Enhancing financial sentiment analysis via retrieval augmented large language models. In: Proceedings of the Fourth ACM International Conference on AI in Finance. pp. 349–356 (2023) find
- Zhao, H., Ling, Q., Pan, Y., Zhong, T., Hu, J.Y., Yao, J., Xiao, F., Xiao, Z., Zhang, Y., Xu, S.H., et al.: Ophtha-llama2: A large language model for ophthalmology. arXiv preprint arXiv:2312.04906 (2023) — [arXiv:2312.04906](https://arxiv.org/abs/2312.04906) find
- Zhao, L., Zhang, L., Wu, Z., Chen, Y., Dai, H., Yu, X., Liu, Z., Zhang, T., Hu, X., Jiang, X., et al.: When brain-inspired ai meets agi. Meta-Radiology p. 100005 (2023) find
- Zhao, L., Li, L., Zheng, X., Zhang, J.: A bert based sentiment analysis and key entity detection approach for online financial texts. In: 2021 IEEE 24th International Conference on Computer Supported Cooperative Work in Design (CSCWD). pp. 1233–1238. IEEE (2021) find
- Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al.: A survey of large language models. arXiv preprint arXiv:2303.18223 (2023)
- Zheng, W., Jin, M.: The effects of class imbalance and training data size on classifier learning: an empirical study. SN Computer Science 1, 1–13 (2020) find
- Zheng, Z., Chen, K.Y., Cao, X.Y., Lu, X.Z., Lin, J.R.: Llm-funcmapper: Function identification for interpreting complex clauses in building codes via llm. arXiv preprint arXiv:2308.08728 (2023) — [arXiv:2308.08728](https://arxiv.org/abs/2308.08728) find
- Zhong, T., Wei, Y., Yang, L., Wu, Z., Liu, Z., Wei, X., Li, W., Yao, J., Ma, C., Li, X., et al.: Chatabl: Abductive learning via natural language interaction with chatgpt. arXiv preprint arXiv:2304.11107 (2023) — [arXiv:2304.11107](https://arxiv.org/abs/2304.11107) find
- Zhou, M., Liu, X., Liu, D., Wu, Z., Liu, Z., Zhao, L., Zhu, D., Guo, L., Han, J., Liu, T., et al.: Fine-grained artificial neurons in audio-transformers for disentangling neural auditory encoding. In: Findings of the Association for Computational Linguistics: ACL 2023. pp. 7943–7956 (2023) find
- Zivot, E., Wang, J.: Vector autoregressive models for multivariate time series. Modeling financial time series with S-PLUS® pp. 385–429 (2006) find
- Zumente, I., Lāce, N.: Esg rating—necessity for the investor or the company? sustainability, 13 (16), 8940 (2021) find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/zhao-2024-revolutionizing-finance-llms-overview-applications/