fixix(tinybird): Align MV columns and fix downstream pipe queries #2397
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
=
Deployment was failing due to mismatches between materialized view
pipe outputs and target datasource schemas, as well as downstream
pipes referencing columns that were no longer being materialized.
dub_click_events_pipe
final node with the schemaof
dub_click_events_mv.datasource
. Added missing fields likeregion
,latitude
,longitude
,engine
,ua
,identity_hash
,and
referer_url
.dub_lead_events_pipe
final node with the schemaof
dub_lead_events_mv.datasource
. Initially added missing fields,then removed fields (
bot
,metadata
,engine_version
, etc.) thatwere not actually present in the target MV schema according to later
deployment errors.
dub_sale_events_pipe
final node with the schemaof
dub_sale_events_mv.datasource
. Added missing fields likeregion
,latitude
,longitude
,engine
,ua
, andreferer_url
.metadata
column fromNODE lead_events
and
NODE sale_events
withinv2_customer_events.pipe
, as thiscolumn was no longer present in
dub_lead_events_mv
ordub_sale_events_mv
.UNION ALL
structure inNODE endpoint
ofv2_customer_events.pipe
to ensure all branches selected thesame number and order of columns after the removal of
metadata
.