事情，⼤家通过试图改变
scaling
law
⾥的具体关系来获得更 ⾼的
efficiency，多出来的
efficiency
就是各⾃的优势。
现在很多⼈觉得做出
MoE
就可以实现
GPT-4。我觉得这是⽚⾯的说法，最终更实质的可能还是如何有 ⼀个统⼀的表⽰空间以及可规模化的数据⽣产。


海外独⻆兽：如果算⼒⾜够，会有⼈想做⼀个万亿参数的
dense
model
吗？
杨植 制化去完全取代微调？
我认为现在正在往这个⽅向⾛，未来模型不需要微调，⽽是通过强⼤的上下⽂⼀致性和指令跟随能⼒ 来解决问题，⻓期趋势应该是底层技术个性化，这会是⼀个很重要的变化。 ⽐如，GPT-4
带来的新的计算范式，创建
GPTs
并不需要微调。以前的定制化是通过
programming
实 现的，今天实际上是通过让模型的
prefix
变得⾮常复杂，从这个通⽤的集合中抽出你想要的东西。通 ⽔平之后的模型完全可以⾃我进化，这样才能突破⼈类已有 能⼒的边界。
海外独⻆兽：你怎么看追平
GPT-4
的难度和时间？
杨植麟：Benchmarking
刷到
GPT-4
⾮常简单，但是达到它的实际效果肯定有难度的，⽽且靠的不只 是资源，Google
已经验证了这⼀点。其实
GPT-4
的训练成本也没那么⾼，⼤⼏千万美元不是⼀个很吓 ⼈的数字，对我们来说是好事，并且我们已经有⽐较好的进展。

“Llama 2 一开源，全球范围内进入了百模混战阶段”， 这个说法一点也不为过。 年底的“虚假宣传” Gemini 与“磁力链开源” Mistral 8x7B 两大神作，也凭借不输 GPT-4 的实力，将 LLM 狂 潮卷到天际。 四、 Stable Diffusion 和 Midjourney 这两大图像生成系统 的出现，极大地拓展和加速了 LLM 在计算机视觉领域的应 用 研究 设计：张琪  07 | AIGC  11 | 1024 黄金眼  13 | 项目停更  16 | 生产事故  18 | 开源治理 1 1 OpenAI 正式发布GPT-4 AIGC 回顾 2023 大语言模型 LLM 元年的重磅事件。 开源开发者事件回顾 Anthropic 推出Claude 2023 年 3 月，百度全新一代知识增强大语言模型、文心大模型家族的新成 据多了 40%，上下文 谷歌发布最强 AI 大模型Gemini 2023 年 12 月，谷歌发布了其认为规模最大、功能最强大的多模态 AI 大模型— —Gemini，称比 OpenAI 的 GPT-4 更先进。 Meta 开源Llama 2 2023 年 3 月 15 日，由 OpenAI 前成员创立的 Anthropic 发布对话 AI 产品 Claude，包含 520 亿个参数。 与 ChatGPT

有出色的表现。 GitHub Copilot 16 / 32 大模型应用现状：知名大模型 在全球范围内，已经发布了多款知名大模型，这些大模 型在各个领域都取得了突破性的进展。 处理文本数据的 GPT-4，能同时处理和理解多种类型数 据的多模态模型 DALL-E 3，以及开源大模型的代表 Lllama 2 都在短时间内获得了大量关注和用户，构成了 大模型领域的「第一梯队」。 讯飞星火 17 Agent。在给定 AutoGPT 一个自然 语言目标后，它会尝试将其分解为多个子任务，并在自动循环中使用 互联网和其他工具来实现该目标。它使用的是 OpenAI 的 GPT-4 或 GPT-3.5 API，是首个使用 GPT-4 执行自主任务的应用程序实例。 AutoGPT 最大的特点在于能根据任务指令自主分析和执行，当收到 一个需求或任务时，它会开始分析这个问题，并且给出执行目标和具 体任务，然后开始执行。

. . . . . . . . 12 2.6.1 AgentGPT . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.6.2 GPT-4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.6.3 Gemma . . . . . . . . . . . . 模型提示词的工具，旨在快速获取和使用最新的 AI 提示进行内容 创作。 2.6 AI 大模型 2.6.1 AgentGPT 一个基于浏览器的自主 AI 工具，专为交互式任务和自动化操作设计。 2.6.2 GPT-4 由 OpenAI 开发的最新大型语言模型，继承了 GPT-3 的能力，功能更加强大和 精确，但为闭源产品。 12 Figure 10: AI 大模型 2.6.3 Gemma 描述：谷歌推出的一款轻量级开源

are freely available as open- source projects at https://github.com/StefanSalewski. ChatGPT and GPT-4 You might have already heard about ChatGPT, an AI (Artificial Intelligence) chatbot devel­ oped prevent misuse. The basic service is still free. A professional ver­ 6 sion, now also known as GPT-4, is available with a monthly payment, but the free basic ver­ sion still functions. When you log value of `i`. Since spring 2023, GPT-4 has been available to paying subscribers, offering more helpful informa­ tion and less irrelevant content. We recently used GPT-4 to create a short Nim info page:

are freely available as open-source projects at https://github.com/StefanSalewski. ChatGPT and GPT-4 You might have already heard about ChatGPT, an AI (Artificial Intelligence) chatbot developed by to prevent misuse. The basic service is still free. A professional version, now 6 also known as GPT-4, is available with a monthly payment, but the free basic version still func­ tions. When you log value of `i`. Since spring 2023, GPT-4 has been available to paying subscribers, offering more helpful information and less irrelevant content. We recently used GPT-4 to create a short Nim info page:

are freely available as open- source projects at https://github.com/StefanSalewski. ChatGPT and GPT-4 You might have already heard about ChatGPT, an AI (Artificial Intelligence) chatbot devel­ oped prevent misuse. The basic service is still free. A professional ver­ 6 sion, now also known as GPT-4, is available with a monthly payment, but the free basic ver­ sion still functions. When you log value of `i`. Since spring 2023, GPT-4 has been available to paying subscribers, offering more helpful informa­ tion and less irrelevant content. We recently used GPT-4 to create a short Nim info page:

are freely available as open-source projects at https://github.com/StefanSalewski. ChatGPT and GPT-4 You might have already heard about ChatGPT, an AI (Artificial Intelligence) chatbot developed by to prevent misuse. The basic service is still free. A professional version, now 6 also known as GPT-4, is available with a monthly payment, but the free basic version still func­ tions. When you log value of `i`. Since spring 2023, GPT-4 has been available to paying subscribers, offering more helpful information and less irrelevant content. We recently used GPT-4 to create a short Nim info page:

are freely available as open-source projects at https://github.com/StefanSalewski. ChatGPT and GPT-4 You might have already heard about ChatGPT, an AI (Artificial Intelligence) chatbot developed by to prevent misuse. The basic service is still free. A professional version, now 6 also known as GPT-4, is available with a monthly payment, but the free basic version still func­ tions. When you log value of `i`. Since spring 2023, GPT-4 has been available to paying subscribers, offering more helpful information and less irrelevant content. We recently used GPT-4 to create a short Nim info page:

are freely available as open-source projects at https://github.com/StefanSalewski. ChatGPT and GPT-4 You might have already heard about ChatGPT, an AI (Artificial Intelligence) chatbot developed by to prevent misuse. The basic service is still free. A professional version, now 6 also known as GPT-4, is available with a monthly payment, but the free basic version still func­ tions. When you log value of `i`. Since spring 2023, GPT-4 has been available to paying subscribers, offering more helpful information and less irrelevant content. We recently used GPT-4 to create a short Nim info page: