It’s one of the most memorable day of my lifetime,
And it had been a great experience with you.
We are not always lucky to find good friends among colleagues,
May our friendship remains even after we change the path.
Good Times + Crazy Friends = Amazing Memories,
Forever Friends, Boss, Broth……
The Full-Stack Data Engineering skill-map:
[来源：史蒂夫·乔布斯在斯坦福大学的演讲]
当我十七岁的时候,我读到了一句话：“如果你把每一天都当作生命中最后一天去生活的话,那么有一天你会发现你是正确的。”这句话给我留下了一个印象。从那时开始,过了33年，我在每天早晨都会对着镜子问自己:“如果今天是我生命中的最后一天,你会不会完成你今天想做的事情呢？……
使用 PolyBase 是将大量数据加载到高吞吐量 Azure SQL 数据仓库的有效方法。 使用 PolyBase 而非默认 BULKINSERT 机制可以实现吞吐量的巨大增加。
如果源数据位于 Azure Data Lake Storage Gen2 中，且格式与 PolyBase 兼容，则可使用复制活动直接调用 PolyBase，让 Azure SQL 数据仓库从源拉取数据。
如果 PolyBase 最……
将数据复制到 Azure SQL 数据库时，可能需要不同的写入行为：
追加：我的源数据只包含新记录。
更新插入：我的源数据包含插入和更新内容。
覆盖：我需要每次都重新加载整个维度表。
使用自定义逻辑进行写入：在将数据最终插入目标表之前，我需要额外的处理。
有关如何在 Azure 数据工厂中进行配置和最佳做法，请参阅相……
The field of Artificial Intelligence (AI) is growing rapidly, with algorithms evolving to match and even surpass human capabilities. One example of this is Deep Learning (DL), an advanced subfield of machine learning that can continue to evolve on its own, without the need for continued pr……
What is Hadoop?
Apache Hadoop is an open source software framework used to develop data processing applications which are executed in a distributed computing environment.
Applications built using HADOOP are run on large data sets distributed across clusters of commodity computers. Commodity comput……
What is Data Warehouse?
A Data Warehouse collects and manages data from varied sources to provide meaningful business insights.
It is a collection of data which is separate from the operational systems and supports the decision making of the company. In Data Warehouse data is stored from a histori……
Lately, we have been dealing with some new interesting conditions and requirements that involve data lake security. It’s an apparently simple concept. But break it into its two sub-concepts and you would quickly notice plenty of complexity and detail within these three words.
On the one hand……
