Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Row Filtering for child tables

Answered
Adam North User

It would be great to be able to apply row filters on child tables.

Which connector?:

rippling

Additional details:

I have a table that is a long, key-value-type table, where each custom column added in the upstream is added as a row. I want to exclude specific columns (rows) which is not possible in the current implementation.

Ref support ticket: 391577

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Unnikrishnan Nair Fivetranner

    Hi Adam,
    Can you help with more details like the tables you would want this? Filtering on the parent table would be the quickest option, but would love to know more details to see how we can improve the connector as well.

    Thanks,
    Unni

  • Adam North User

    Hi Unni,

    Absolutely, the `worker_custom_field` table is a long table containing tuples (name/value/type) of all custom fields/values added to the worker object.

    So, the columns are stored as data rows, which makes hashing the data unviable. 

    I would like to define a row filter for this table so we only ingest the data we need.

    An example filter in SQL would be something like
    ```

    SELECT worker_id, name, value, type

    WHERE name IN ('Proficient Languages', 'Favorite Movie')

    ```

    And then pivot these to actual columns downstream. 

    Some of the data in these custom fields can be sensitive, and we want to filter to only what we need.

    Thanks,

    Adam