FinGPT: Open-source for Open-finance.

TensorLet

Why FinGPT?

TensorLet · 2023-04-21T06:49:45+00:00

Why FinGPT? 1). 金融是高度动态的。BloombergGPT使用金融和通用数据源的混合数据集重新训练LLM，这太昂贵了（130万GPU小时，成本约为500万美元）。每月或每周对LLM模型进行再培训的成本很高，因此轻量级适应在金融领域非常有利。 2). 互联网规模的金融数据民主化至关重要，这应该允许...

1). 金融是高度动态的。BloombergGPT使用金融和通用数据源的混合数据集重新训练LLM，这太昂贵了（130万GPU小时，成本约为500万美元）。每月或每周对LLM模型进行再培训的成本很高，因此轻量级适应在金融领域非常有利。
2). 互联网规模的金融数据民主化至关重要，这应该允许使用自动数据管理管道及时更新（每月或每周更新）。但是，BloombergGPT拥有特权数据访问和API。
3). 关键技术是“RLHF（从人类反馈中强化学习）”，这在BloombergGPT中是缺失的。RLHF使LLM模型能够学习个人偏好（风险规避水平、投资习惯、个性化机器人顾问等），这是ChatGPT和GPT4的“秘密”优势。

News

Columbia Perspectives on ChatGPT
[MIT Technology Review] ChatGPT is about to revolutionize the economy. We need to decide what that looks like
[BloombergGPT] BloombergGPT: A Large Language Model for Finance
[Finextra] ChatGPT and Bing AI to sit as panellists at fintech conference

ChatGPT at AI4Finance

[YouTube video] I Built a Trading Bot with ChatGPT, combining ChatGPT and FinRL.
Hey, ChatGPT! Explain FinRL code to me!
ChatGPT Robo Advisor v2
ChatGPT Robo Advisor v1
- A demo of using ChatGPT to build a Robo-advisor
ChatGPT Trading Agent V2
- A FinRL agent that trades as smartly as ChatGPT by using the large language model behind ChatGPT
ChatGPT Trading Agent V1
- Trade with the suggestions given by ChatGPT
ChatGPT adds technical indicators into FinRL

Introductory

Sparks of artificial general intelligence: Early experiments with GPT-4
[GPT-4] GPT-4 Technical Report
[InstructGPT] Training language models to follow instructions with human feedback NeurIPS 2022.

The Journey of Open AI GPT models. GPT models explained. Open AI's GPT-1, GPT-2, GPT-3.

[GPT-3] Language models are few-shot learners NeurIPS 2020.
[GPT-2] Language Models are Unsupervised Multitask Learners
[GPT-1] Improving Language Understanding by Generative Pre-Training
[Transformer] Attention is All you Need NeurIPS 2017.

(Financial) Big Data

[BloombergGPT] BloombergGPT: A Large Language Model for Finance
WHAT’S IN MY AI? A Comprehensive Analysis of Datasets Used to Train GPT-1, GPT-2, GPT-3, GPT-NeoX-20B, Megatron-11B, MT-NLG, and Gopher
FinRL-Meta Repo and paper FinRL-Meta: Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning. Advances in Neural Information Processing Systems, 2022.
[AI4Finance] FinNLP Democratizing Internet-scale financial data.

Interesting Demos

GPT-3 Creative Fiction Creative writing by OpenAI’s GPT-3 model, demonstrating poetry, dialogue, puns, literary parodies, and storytelling. Plus advice on effective GPT-3 prompt programming & avoiding common errors.