现在创业公司 的
LLM
训练，在
GPU
和算⼒资源有限的条件下，还能实现登⽉吗？
杨植麟：“登⽉”有⼏个不同的⽣产要素，算⼒肯定是⼀个核⼼，但还有其他的。 你需要⼀个同时满⾜
scalability
和
generality
这两点的架构，但今天其实很多架构已经不满⾜这两条 了。transformer
在已知的
token
space
符合这两条，但放⼤到⼀个更通⽤的场景，也不太符合。数据 做。
19
年最流⾏的是架构是
BERT，后来⼤家问为什么没有⼈去
scale
BERT，其实是因为值得被
scale
的 架构需要具备
scalability
和
generality
这两个条件。我不认为
BERT
没有
scalability，但是你能明显 看到它没有
generality
⸺
不管
scale
到多⼤，它都不可能给你写⼀篇⽂章。多模态过去⼏年也是卡在 架构上，缺少

. 77 Ending a list . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 Horizontal rules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 Tables . . . 0-6. If a slide level of 0 is specified, slides will not be split automatically on headings, and horizontal rules must be used to indicate slide boundaries. If a slide level is not specified explicitly, symbols (default is empty for no navigation symbols; other valid values are frame, vertical, and horizontal) section-titles enables “title pages” for new sections (default is true) theme, colortheme, fonttheme

mouse button and hold, while dragging it to the desired position (hold Ctrl to move the shape in horizontal or vertical direction only); release the mouse button. Drag to move the selection. Transformations the mouse button. To skew an object: select it, then click it again; position the mouse over a horizontal or vertical two-way arrow; press the mouse button and hold, while dragging it to the desired amount the size of the ellipse in vertical and horizontal direction, respectively. To create a circle with a specific size, you can use the fields for the horizontal and vertical radius Rx and Ry in the tool

mouse button and hold, while dragging it to the desired position (hold Ctrl to move the shape in horizontal or vertical direction only); release the mouse button. Drag to move the selection. Transformations the mouse button. To skew an object: select it, then click it again; position the mouse over a horizontal or vertical two-way arrow; press the mouse button and hold, while dragging it to the desired amount the size of the ellipse in vertical and horizontal direction, respectively. To create a circle with a specific size, you can use the fields for the horizontal and vertical radius Rx and Ry in the tool

mouse button and hold, while dragging it to the desired position (hold Ctrl to move the shape in horizontal or vertical direction only); release the mouse button. Drag to move the selection. Transformations the mouse button. To skew an object: select it, then click it again; position the mouse over a horizontal or vertical two-way arrow; press the mouse button and hold, while dragging it to the desired amount the size of the ellipse in vertical and horizontal direction, respectively. To create a circle with a specific size, you can use the fields for the horizontal and vertical radius Rx and Ry in the tool

mouse button and hold, while dragging it to the desired position (hold Ctrl to move the shape in horizontal or vertical direction only); • release the mouse button. Fig. 1: Drag to move the selection. mouse button. To skew an object: • select it, then click it again; • position the mouse over a horizontal or vertical two-way arrow; • press the mouse button and hold, while dragging it to the desired while pressing Ctrl. The top and left square handles change the size of the ellipse in vertical and horizontal direction, respectively. 64 , Release 1.0 Fig. 2: The round handles convert the shape into an

mouse button and hold, while dragging it to the desired position (hold Ctrl to move the shape in horizontal or vertical direction only); • release the mouse button. Fig. 1: Drag to move the selection. mouse button. To skew an object: • select it, then click it again; • position the mouse over a horizontal or vertical two-way arrow; • press the mouse button and hold, while dragging it to the desired while pressing Ctrl. The top and left square handles change the size of the ellipse in vertical and horizontal direction, respectively. 66 , Release 1.0 Fig. 2: The round handles convert the shape into an

mouse button and hold, while dragging it to the desired position (hold Ctrl to move the shape in horizontal or vertical direction only); • release the mouse button. 57 Ink s c ap e B eg i nners ’ G u mouse button. To skew an object: • select it, then click it again; • position the mouse over a horizontal or vertical two-way arrow; • press the mouse button and hold, while dragging it to the desired the size of the ellipse in vertical and horizontal direction, respectively. To create a circle with a specific size, you can use the fields for the horizontal and vertical radius Rx and Ry in the tool

of the cloud is a resource rental (Hosting), where users buy on-demand, making open source scalability possible. 开源软件商应该加强自身产品差异化的能力，若开源产品做的足够复杂，云服务商就不能进行 简单的打包销售，必须要同开源软件商进行合作。云厂商可以进行底层整套生态的培育。云、

time. 256 The outstanding work (or backlog) is often on the vertical axis, with time along the horizontal. That is, it is a run chart of outstanding work. It is useful for predicting when all of the