Warm tip: This article is reproduced from serverfault.com, please click

azure azure-data-factory azure-databricks azure-purview

Azure Purview support for Delta Format sink in Data flow of ADF

发布于 2020-12-10 05:52:43

I was recently exploring Azure Purview and was trying to push lineage information from ADF to Azure purview. However, it seems when we sink data in Delta Format using dataflow in ADF (Which is a inline format for data flow), it doesn't capture the lineage information. Whereas, it captures the lineage information when sinking using "dataset" in "Parquet" format. Is it that I am missing something here or its a bug or a feature that needs to be addressed?

Questioner

Anish Kumar Sarangi

Viewed

0

DanielPerlovsky-MSFT 2020-12-11 11:59:51

Delta Lake lineage from ADF data flow is not supported in Azure Purview right now. This is a known limitation and we are working to get it released. There is no ETA at this time.

热门帖子

1

求推荐 3k 左右的烘干机

2

老板问我为什么不加班，我要怎么回他

3

胖猫，你又不是第一次没人要

4

求助一个排查了半年没解决的 MySQL order by 子句导致索引失效的问题， 500 多万条记录的小表要查快两分钟

5

Surge ponte 如何实现异地访问家里的内网设备

6

[TestFlight] 月更：竹蜻蜓 0.17.4 现已释出

7

Macbook M1 升级 M3 MAX

8

电信疯狂 QoS 香港的下行？

9

请假一个关于一加 12 电池优化的问题

10

我是一个设计师自学了 Swift 语言，做了一个 App，当做给自己做一个广告，大家可以给点建议和鼓励

热门github

1

A multi-platform library for OpenGL, OpenGL ES, Vulkan, window and input

2

Dev tool that writes scalable apps from scratch while the developer oversees the implementation

3

shadcn/ui, but for Svelte. ✨

4

The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.

5

Performance-portable, length-agnostic SIMD with runtime dispatch

6

ZK Credo

7

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

8

Joplin - the secure note taking and to-do app with synchronisation capabilities for Windows, macOS, Linux, Android and iOS.

9

Mamba is a new state space model architecture showing promising performance on information-dense data such as language modeling, where previous subquadratic models fall short of Transformers. It is based on the line of progress on structured state space models, with an efficient hardware-aware design and implementation in the spirit of FlashAttention.

10

This repository contains System Design resources which are useful while preparing for interviews and learning Distributed Systems

11

Curso para aprender el lenguaje de programación Python desde cero y para principiantes. 75 clases, 37 horas en vídeo, código, proyectos y grupo de chat. Fundamentos, frontend, backend, testing, IA...

12

🎓 Path to a free self-taught education in Computer Science!

13

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

14

A collective list of free APIs

15

📚 Freely available programming books