数据湖开源-阿里云

阿里云EMR数据湖文件系统: 面向开源和云打造下一代 HDFS

前言最近，阿里云EMR重磅推出新版数据湖Datalake，100%兼容社区大数据开源组件，具备极强的弹性能力，支持数据湖构建DLF、对象存储OSS和OSS-HDFS，支持 Delta Lake、Hudi、Iceberg 三种湖格式。结合阿里云DataWorks，可以为用户提供从入湖、建模、开发、调...

认识数据湖——拥抱开源大数据技术的前提

世界对数据湖的兴趣依然在不断增长，但如果说对数据湖的宣传都是烟雾弹的话，这就贬低了数据湖真正的能力。“数据仓库”和“大数据”等概念都逐渐深入人心，但“数据湖”仍然是让IT和业务相关者头疼的一件事情。随着人们对于数据湖的清晰定义、使用案例、最佳实践等信息的需求不断增长，IT专业人士需要一则明确的数据...

大数据知识图谱系列—如何选择合适的OLAP引擎进行数据湖分析

4 课时 |

110 人已学 |

加入学习

[帮助文档] 开源自建Spark和DLASpark在3种测试场景下的测试结果及性能对比分析

本次测试采用3种不同的测试场景，针对开源自建的Hadoop+Spark集群与阿里云云原生数据湖分析DLA Spark在执行Terasort基准测试的性能做了对比分析。本文档主要展示了开源自建Spark和DLA Spark在3种测试场景下的测试结果及性能对比分析。

共有3条

< 1 >

跳转至： GO

更新时间 2024-05-09 22:09:05

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

产品推荐

{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"数据湖构建","iconImg":"https://img.alicdn.com/tfs/TB1aU0U1oT1gK0jSZFrXXcNCXXa-200-200.png","contentLink":"https://www.aliyun.com/product/bigdata/dlf","title":"数据湖构建","des":"数据湖构建服务作为云原生数据湖架构核心组成部分，帮助用户简单快速地构建云原生数据湖解决方案。数据湖构建提供湖上元数据统一管理、企业级权限控制，并无缝对接多种计算引擎，打破数据孤岛，洞察业务价值。","link1":"https://common-buy.aliyun.com/?commodityCode=dlf_post_public_cn#/buy","btn1":"免费试用","link2":"https://dlf.console.aliyun.com/","btn2":"管理控制台","btn3":"","link3":"","infoGroup":[{"infoName":"产品文档","infoContent":{"firstContentLink":"https://help.aliyun.com/document_detail/183492.html","firstContentName":"产品简介","lastContentLink":"https://help.aliyun.com/document_detail/183498.html","lastContentName":"用户指南"}},{"infoName":"相关推荐","infoContent":{"firstContentName":"对象存储 OSS","firstContentLink":"https://www.aliyun.com/product/oss","lastContentName":"大数据计算","lastContentLink":"https://www.aliyun.com/product/emapreduce"}}]}],"card":[],"search":[],"infoCard":[],"title":{"mainTitle":"数据湖构建","subtitle":"数据湖是一个集中式存储库，可存储任意规模结构化和非结构化数据，支持大数据和AI计算。数据湖构建服务（Data Lake Formation，DLF）作为云原生数据湖架构核心组成部分，帮助用户简单快速地构建云原生数据湖解决方案。数据湖构建提供湖上元数据统一管理、企业级权限控制，并无缝对接多种计算引擎，打破数据孤岛，洞察业务价值。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":""},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"optioninfo":{"dynamic":"ture","static":"true"},"simplifiedDisplay":"newEdition","newCard":[{"ifIcon":"img","link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"数据湖构建","iconImg":"https://img.alicdn.com/tfs/TB1aU0U1oT1gK0jSZFrXXcNCXXa-200-200.png","contentLink":"https://www.aliyun.com/product/bigdata/dlf","title":"数据湖构建","des":"数据湖构建服务作为云原生数据湖架构核心组成部分，帮助用户简单快速地构建云原生数据湖解决方案。数据湖构建提供湖上元数据统一管理、企业级权限控制，并无缝对接多种计算引擎，打破数据孤岛，洞察业务价值。","link1":"https://common-buy.aliyun.com/?commodityCode=dlf_post_public_cn#/buy","btn1":"免费试用","link2":"https://dlf.console.aliyun.com/","btn2":"管理控制台","btn3":"","link3":"","infoGroup":[{"infoName":"产品文档","infoContent":{"firstContentLink":"https://help.aliyun.com/document_detail/183492.html","firstContentName":"产品简介","lastContentLink":"https://help.aliyun.com/document_detail/183498.html","lastContentName":"用户指南"}},{"infoName":"相关推荐","infoContent":{"firstContentName":"对象存储 OSS","firstContentLink":"https://www.aliyun.com/product/oss","lastContentName":"大数据计算","lastContentLink":"https://www.aliyun.com/product/emapreduce"}}]}],"card":[],"search":[],"infoCard":[],"title":{"mainTitle":"数据湖构建","subtitle":"数据湖是一个集中式存储库，可存储任意规模结构化和非结构化数据，支持大数据和AI计算。数据湖构建服务（Data Lake Formation，DLF）作为云原生数据湖架构核心组成部分，帮助用户简单快速地构建云原生数据湖解决方案。数据湖构建提供湖上元数据统一管理、企业级权限控制，并无缝对接多种计算引擎，打破数据孤岛，洞察业务价值。","linkUrl":"https://www.aliyun.com/product/mobilepaas/mpaas-miniprogram","btnText":""},"visual":{"topbg":"https://img.alicdn.com/tfs/TB1bQuBIYH1gK0jSZFwXXc7aXXa-3840-740.gif","icon":"","textColor":"dark"},"dataList":[{"summary":"啦啦啦","author":"wuwu","linksUrl":"#"}],"sceneCard":[],"txt":[]}}