Fivetran's Platform Connector provides valuable metadata about connectors and logs, offering crucial insights into data pipelines. However, currently, access to lineage metadata is limited to Enterprise and Business Critical plans. This feature request proposes including lineage metadata in the standard Fivetran plan to enhance data governance and transparency for all users.

Benefits

• Improved Data Governance: Lineage metadata allows users to understand the origin and transformations applied to data throughout the pipeline. This facilitates data quality checks, impact analysis, and regulatory compliance.
• Enhanced Transparency: Having access to lineage information empowers data analysts and business users to trust the data they're working with. They can easily trace data points back to their source, fostering better decision-making.
• Democratized Data Management: Including lineage metadata in the standard plan removes a barrier for smaller teams or those starting with Fivetran. This fosters a more data-driven culture by allowing everyone to understand the data lineage.

Proposed Solution

We propose including essential lineage information in the starter Fivetran plan. This could encompass:

• Table-level lineage: Track the source tables for each destination table, enabling users to understand the data's origin.
• Basic column-level lineage: Map corresponding columns between source and destination tables, providing a foundational view of data transformations.

Conclusion

Providing lineage metadata in the starter Fivetran plan would significantly improve data governance, transparency and empower users across the organization. This aligns with Fivetran's mission of democratizing data access and simplifying data management for all users.