The Weekly Data Engineering Newsletter
>Please comment if you know any library that parses Spark's logical plan for lineage.
Spark send lineage to Apache Atlas via Kafka by this: https://github.com/hortonworks-spark/spark-atlas-connector
oh this is very cool. Thanks for sharing it.
>Please comment if you know any library that parses Spark's logical plan for lineage.
Spark send lineage to Apache Atlas via Kafka by this: https://github.com/hortonworks-spark/spark-atlas-connector
oh this is very cool. Thanks for sharing it.