[Bug] Some Salesforce objects are missing fields when built using the DBT formula field utility

[Ryan-Bliss]

Is there an existing issue for this?

• I have searched the existing issues

Describe the issue

The dbt formula field utility and by extension the query model provided in the fivetran_formula_model table is missing some field on particular objects. For example on our object "account" there are 30-50 fields which exist on the raw account table coming from fivetran, but the fields are not present in the query provided in the fivetran_formula_model table for account. There doesn't seem to be anything different about these fields, many are not even formula fields. The fields are not showing in the failure reason table at all.

Relevant error log or model output

Some examples of fields missing from the final account table are active_nda_c, is_taxable_c, exclusivity_c, etc.

Expected behavior

I would expect that all available fields in the raw table coming from fivetran would also be present in the final output created by the formula field util and by extension the model within the formula field model table.

dbt Project configurations

  salesforce:
    +snowflake_warehouse: "{{ 'DBT_WH' if target.name == 'prod' else target.warehouse }}"
    base:
      +schema: salesforce_base
    staging:
      +schema: salesforce_staging 

Package versions

• package: fivetran/salesforce_formula_utils
  version: [">=0.9.0", "<0.10.0"]

What database are you using dbt with?

snowflake

dbt Version

dbt: 1.6.6

Additional Context

No response

Are you willing to open a PR to help address this issue?

• Yes.
• Yes, but I will need assistance and will schedule time during our office hours for guidance
• No.

[fivetran-joemarkiewicz]

Hi @Arby77 thanks for opening this issue and I see your concern in not having all fields in the objects generated by the formula field utility!

Unfortunately, the dbt package in this context only materializes the transformation logic provided in the connector. As a result the dbt package does not have much say in what is included within the fivetran_formula_model table. As a result, we won't be able to address the issue in this GitHub repo. Instead, I would encourage you open a support ticket so our support and connector team will be able to work directly with you to get this sorted out in the table synced by the connector. Once that is resolved, the package will be able to capture the latest changes in a subsequent run.

Let me know if you have any questions. Thanks!