Economical, and Efficient Mixture-of-Experts Language Model DeepSeek-AI research@deepseek.com Abstract We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training Evaluations on Math and Code 33 G Evaluation Formats 34 3 1. Introduction In the past few years, Large Language Models (LLMs) (Anthropic, 2023; Google, 2023; OpenAI, 2022, 2023) have undergone rapid development to tackle this problem, we introduce DeepSeek-V2, a strong open-source Mixture-of-Experts (MoE) language model, characterized by economical training and efficient inference through an innovative Transformer

instructions Weblate deployments Upgrading Weblate Authentication Access control Translation projects Language definitions Continuous translation Translation process Checks and fixups Machine translation Configuration keep this information accurate. Note All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Example can be seen on following image, where Slovak language is shown as secondary: Default dashboard view On the Preferences

instructions Weblate deployments Upgrading Weblate Authentication Access control Translation projects Language definitions Continuous translation Translation process Checks and fixups Machine translation Configuration keep this information accurate. Note All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Example can be seen on following image, where Slovak language is shown as secondary: Default dashboard view On the Preferences

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85 4.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . keep this information accurate. Note: All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Ex- ample can be seen on following image, where Slovak language is shown as secondary: 2.2. Registration and user profile 7 Weblate

instructions Weblate deployments Upgrading Weblate Authentication Access control Translation projects Language definitions Continuous translation Translation process Checks and fixups Machine translation Configuration keep this information accurate. Note All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Example can be seen on following image, where Slovak language is shown as secondary: Default dashboard view On the Preferences

instructions Weblate deployments Upgrading Weblate Authentication Access control Translation projects Language definitions Continuous translation Translation process Checks and fixups Machine translation Configuration keep this information accurate. Note All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Example can be seen on following image, where Slovak language is shown as secondary: Default dashboard view On the Preferences

instructions Weblate deployments Upgrading Weblate Authentication Access control Translation projects Language definitions Continuous translation Translation process Checks and fixups Machine translation Configuration keep this information accurate. Note All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Example can be seen on following image, where Slovak language is shown as secondary: Default dashboard view On the Preferences

instructions Weblate deployments Upgrading Weblate Authentication Access control Translation projects Language definitions Continuous translation Translation process Checks and fixups Machine translation Configuration keep this information accurate. Note All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Example can be seen on following image, where Slovak language is shown as secondary: Default dashboard view On the Preferences

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84 4.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . keep this information accurate. Note: All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Ex- ample can be seen on following image, where Slovak language is shown as secondary: 2.2. Registration and user profile 7 Weblate

projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84 4.8 Language definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . keep this information accurate. Note: All language selections offers only languages which are currently being translated. If you want to translate to other language, please request it first on the project which will be shown you while translating together with source language. Ex- ample can be seen on following image, where Slovak language is shown as secondary: 2.2. Registration and user profile 7 Weblate