Connector Improvement: Notion - Add all BLOCKs (regardless of depth) and full JSON on the page record
the way notion connector is working any block bellow level 3 is not shown. Also converting a page to its full JSON for subsequent markdown is nearly impossible with SQL. I propose the following changes:
- Add full exploded JSON on the page record
- Add blocks for full depth
In addition I think the structure of blocks is not consistent with the API I propose the following change:
- single base with BLOCK to represent every block on Notion
- field called BLOCK_PARENT_ID which represents the parent child relation (points to its parent)
Rationale:
- Clients that want to process notion pages for RAG usecases can simply use the notion JSON full expanded to convert to MD or similar with a single SQL function
- Clients that want to track changes to blocks can use the BLOCK last updated field for that
- Clients wanting to navigate the hierarchy can leverage CONNECT BY clause in snowflake for that purspose without endless joins.
Thanks
Pietro
Please sign in to leave a comment.
Comments
0 comments