is also optimized based on an improved version of FlashAttention-2 (Dao, 2023). We conduct all experiments on a cluster equipped with NVIDIA H800 GPUs. Each node in the H800 cluster contains 8 GPUs connected ({?1, ?2, · · · , ??}) s??({?1, ?2, · · · , ??}) . (34) Training Strategy. In our preliminary experiments, we find that the RL training on reasoning data, such as code and math prompts, exhibits unique with DeepSeek-V2 Chat (SFT) and train them with either a point-wise or a pair-wise loss. In our experiments, we observe that the RL training can fully tap into and activate the potential of our model, enabling

1-2 Years Fully Implemented Plan on Start Testing Within 12 Months Running Initial Tests / Experiments Note: Survey question asked about the extent to which marketing executives worldwide are using