用 Gudu SQLFlow 可视化以CSV格式存储的的数据血缘关系

2022/01/18 马哈鱼 教程 共 2497 字,约 8 分钟

马哈鱼数据血缘分析器 作为一个数据血缘关系分析工具, 除了对 SQL 脚本文件进行分析,得到 data lineage,并进行可视化展示外,还可以让用户自己提供CSV格式的数据血缘关系, 并进行可视化展示。

CSV 文件的结构

一种最基本的格式:

SOURCE_DB,SOURCE_SCHEMA,SOURCE_TABLE,SOURCE_COLUMN,TARGET_DB,TARGET_SCHEMA,TARGET_TABLE,TARGET_COLUMN
各字段含义
  • SOURCE_DB:源数据所在数据库,如果没有,请填写 DEFAULT
  • SOURCE_SCHEMA: 源数据所在SCHEMA, 如果没有,请填写 DEFAULT
  • SOURCE_TABLE: 源数据所在表,必须填写。
  • SOURCE_COLUMN: 源数据所在的字段,必须填写。
  • TARGET_DB:目标数据所在数据库,如果没有,请填写 DEFAULT
  • TARGET_SCHEMA: 目标数据所在SCHEMA, 如果没有,请填写 DEFAULT
  • TARGET_TABLE: 目标数据所在表,必须填写。
  • TARGET_COLUMN: 目标数据所在的字段,必须填写。

一个例子

SOURCE_DB,SOURCE_SCHEMA,SOURCE_TABLE,SOURCE_COLUMN,TARGET_DB,TARGET_SCHEMA,TARGET_TABLE,TARGET_COLUMN
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,technical_metadata
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,tu_directmail_consent,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_ONLINE_ACCOUNT_SCVSSP_LINK,tu_directmail_consent
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_SCVECS_SAT_01,enterprise_customer_nk1,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_SCVECS_SAT,enterprise_customer_nk1
ADW_DEV,ADW_CUSTOMER_TRAN,ADW_CUSTOMER_TRAN.FOODSCV_RDV_ENTERPRISE_CUSTOMER_SCVECS_SAT_01,enterprise_customer_nk1,ADW_DEV,ADW_RDV,ENTERPRISE_CUSTOMER_SCVECS_SAT,enterprise_customer_nk1
可视化以后的效果
  • 通过创建 job 递交 CSV 文件

  • 可视化的血缘关系

参考

马哈鱼数据血缘关系分析工具中文网站: https://www.sqlflow.cn

马哈鱼数据血缘关系分析工具在线使用: https://sqlflow.gudusoft.com

文档信息

Search

    Table of Contents