You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We have upgraded from v0.25.0 to a higher version lately and see issues with newly created tables.
We use options.InferSchema(msg) to create and update schemas for our tables.
We use options.Marshal(msg) to marshal the messages.
With version v.26.0+, some rows cannot be ingested and BQ rejects them with an error:
some.field._some_one_of: no such field: _some_one_of."; Reason: "invalid"
When calling options.Marshal(msg), the nested map[string]bigquery.Value will contain the _some_one_of field.
When calling options.InferSchema(msg) the nested bigquery.Schema will not contain the _some_one_of field anymore.
I added a PR: #369 to fix it. Let me know if this works for you.
Starting next week, we will vendor our branch with the fix to fill our DWH. 🤞🏼
I will post the results here too.
We have upgraded from v0.25.0 to a higher version lately and see issues with newly created tables.
We use
options.InferSchema(msg)
to create and update schemas for our tables.We use
options.Marshal(msg)
to marshal the messages.With version v.26.0+, some rows cannot be ingested and BQ rejects them with an error:
We use these Options:
When calling
options.Marshal(msg)
, the nestedmap[string]bigquery.Value
will contain the_some_one_of
field.When calling
options.InferSchema(msg)
the nestedbigquery.Schema
will not contain the_some_one_of
field anymore.When I disable this change:
everything works as expected.
How do you handle this case?
The text was updated successfully, but these errors were encountered: