Error: The custom source table structure doesn't match the expected schema. The table was created with a valid schema, but the structure has changed (columns added, removed, renamed, or data types modified).
What you need to do:
Check your custom source table in BigQuery and compare it to the original schema definition.
Ensure all required columns are present with the correct names and data types.
Remove any columns that weren't part of the original schema (unless they're optional).
If you need to modify the schema, recreate the custom source with the updated structure.
Once the schema matches the expected format, the pipeline will automatically retry processing on the next daily run.
Common causes:
Columns were manually added or removed from the table.
Column names were changed or contain typos
Data types were modified (e.g., STRING changed to INTEGER)
Need help?
If you're unsure about the expected schema, contact support or refer to the custom source documentation.