 Hadoop 迁移到阿里云MaxCompute 技术方案Alibaba Cloud MaxCompute 解决方案 6 1 概要 Hadoop 在企业构建第一代大数据平台中成为主流的技术框架,但是随着企业信息化的高 速发展,在数字化、智能化的转型过程中,Hadoop 越来越复杂的技术架构和运维成本、平台 的稳定性和安全性、资源的弹性伸缩能力都遇到了瓶颈,严重阻碍了客户数据业务的发展。随着 提供了 Spark on MaxCompute 的解决 方案,使 MaxCompute 提供的兼容开源的 Spark 计算 服务,让它在统一的计算资源和数据集权限体系之上,提 供 Spark 计算框架,支持用户以熟悉的开发使用方式提 交运行 Spark 作业。 * 支持原生多版本 Spark 作业:Spark1.x/Spark2.x 作业 都可运行; * 开源系统的使用体验:Spark-submit 学习,扩展应用场景; 机器学习 PAI MaxCompute 内建支持的上百种机器学习算法,目前 MaxCompute 的机器学习能力由 PAI 产品进行统一提供 服务,同时 PAI 提供了深度学习框架、Notebook 开发 环境、GPU 计算资源、模型在线部署的弹性预测服务。 MaxCompute 的数据对 PAI 产品无缝集成。 存储 Pangu 阿里自研分布式存储服务,类似 HDFS。MaxCompute0 码力 | 59 页 | 4.33 MB | 1 年前3 Hadoop 迁移到阿里云MaxCompute 技术方案Alibaba Cloud MaxCompute 解决方案 6 1 概要 Hadoop 在企业构建第一代大数据平台中成为主流的技术框架,但是随着企业信息化的高 速发展,在数字化、智能化的转型过程中,Hadoop 越来越复杂的技术架构和运维成本、平台 的稳定性和安全性、资源的弹性伸缩能力都遇到了瓶颈,严重阻碍了客户数据业务的发展。随着 提供了 Spark on MaxCompute 的解决 方案,使 MaxCompute 提供的兼容开源的 Spark 计算 服务,让它在统一的计算资源和数据集权限体系之上,提 供 Spark 计算框架,支持用户以熟悉的开发使用方式提 交运行 Spark 作业。 * 支持原生多版本 Spark 作业:Spark1.x/Spark2.x 作业 都可运行; * 开源系统的使用体验:Spark-submit 学习,扩展应用场景; 机器学习 PAI MaxCompute 内建支持的上百种机器学习算法,目前 MaxCompute 的机器学习能力由 PAI 产品进行统一提供 服务,同时 PAI 提供了深度学习框架、Notebook 开发 环境、GPU 计算资源、模型在线部署的弹性预测服务。 MaxCompute 的数据对 PAI 产品无缝集成。 存储 Pangu 阿里自研分布式存储服务,类似 HDFS。MaxCompute0 码力 | 59 页 | 4.33 MB | 1 年前3
 PlantUML 1.2021.2 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] < PlantUML 1.2021.2 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <- > Guía de Referencia del Lenguaje PlantUML 0 码力 | 389 页 | 4.12 MB | 1 年前3
 PlantUML 1.2021.1 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] < PlantUML 1.2021.1 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <- > Guía de Referencia del Lenguaje PlantUML 0 码力 | 384 页 | 4.07 MB | 1 年前3
 PlantUML 1.2023.11 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components ArrowFontName Impact ArrowColor #FF6655 ArrowFontColor #777777 } () "Data Access" as DA Component "Web Server" as WS << Apache >> DA - [First Component] [First Component] ..> () HTTP : use HTTP - WS @enduml0 码力 | 531 页 | 7.53 MB | 1 年前3 PlantUML 1.2023.11 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components ArrowFontName Impact ArrowColor #FF6655 ArrowFontColor #777777 } () "Data Access" as DA Component "Web Server" as WS << Apache >> DA - [First Component] [First Component] ..> () HTTP : use HTTP - WS @enduml0 码力 | 531 页 | 7.53 MB | 1 年前3
 PlantUML 1.2021.3 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] < PlantUML 1.2021.3 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 7.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <- > Guía de Referencia del Lenguaje PlantUML 0 码力 | 407 页 | 4.28 MB | 1 年前3
 PlantUML 1.2020.23 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> Guía de Referencia del Lenguaje PlantUML (1.2020.23) 111 / 304 6.13 Personalización0 码力 | 305 页 | 3.11 MB | 1 年前3 PlantUML 1.2020.23 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> Guía de Referencia del Lenguaje PlantUML (1.2020.23) 111 / 304 6.13 Personalización0 码力 | 305 页 | 3.11 MB | 1 年前3
 PlantUML 1.2020.22 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> Guía de Referencia del Lenguaje PlantUML (1.2020.22) 100 / 292 6.13 Personalización0 码力 | 293 页 | 3.02 MB | 1 年前3 PlantUML 1.2020.22 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.12 Using Sprite in Stereotype You can use sprites within stereotype components #777777 } () "Data Access" as DA DA - [First Component] [First Component] ..> () HTTP : use HTTP - [Web Server] << Apache >> Guía de Referencia del Lenguaje PlantUML (1.2020.22) 100 / 292 6.13 Personalización0 码力 | 293 页 | 3.02 MB | 1 年前3
 PlantUML 1.2019.4 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.4) 81 / 165 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] < PlantUML 1.2019.4 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.4) 81 / 165 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <- > [BB] < - > [CC] < - > 0 码力 | 166 页 | 1.82 MB | 1 年前3
 PlantUML 1.2019.3 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.3) 81 / 157 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] < PlantUML 1.2019.3 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.3) 81 / 157 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <- > [BB] < - > [CC] < - > 0 码力 | 158 页 | 1.72 MB | 1 年前3
 PlantUML 1.2019.2 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.2) 81 / 157 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] < PlantUML 1.2019.2 Guía de Referencia del Lenguaje"Data Access" as DA DA - [First Component] [First Component] ..> HTTP : use note left of HTTP : Web Service only note right of [First Component] A note can also be on several lines end note @enduml individuales Puedes especificar un color despues de la definición del componente. @startuml component [Web Server] #Yellow @enduml 6.10 Using Sprite in Stereotype You can use sprites within stereotype components PlantUML (1.2019.2) 81 / 157 6.11 Personalización (Skinparam) 6 DIAGRAMA DE COMPONENTES HTTP - [Web Server] << Apache >> @enduml @startuml [AA] <- > [BB] < - > [CC] < - > 0 码力 | 158 页 | 1.72 MB | 1 年前3
共 17 条
- 1
- 2













