Optimizing Google BigQuery Service Connector
We are currently funneling our Google Analytics 4 (GA4) data into BigQuery, and then connecting to BigQuery with 'Google BigQuery Service Connector' in Domo. We are partitioning using date keys and bringing in the past 3 days of data (to account for attribution in GA4) with an append. However, our daily updated rows ranges between 1MM - 2MM+ every day - which is not the best for consumption purposes. Has anyone experienced similar issues, and if so, how did you optimize? Any/all recommendations would be helpful here! Thank you!
Comments
-
Out of curiosity, why are you going the route of BQ instead of using the native GA4 connector?
0 -
@PMLeema we're using the BQ route since the native GA4 connector is (and was when we were implementing) in Beta. We were seeing discrepancies from the native view, but saw accurate data flowing in from BQ.
Simple: 'SELECT * FROM…' our BQ account in Domo.
Within BQ itself, we are selecting user_pseudo_id, event_timestamp, event_date, country, creating groupings based on traffic sources and mediums, 'page_title', 'ga_session_id', traffic source name, medium and source (and labeling as campaign, medium, and source respectively), event_name, event_key, and event_value.Let me know what you think here.
Thanks!0 -
@Tasleema - I wanted to follow up on this discussion for any possible ways to optimize/improve this process.
0
Categories
- All Categories
- 1.9K Product Ideas
- 1.9K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 302 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 104 SQL DataFlows
- 636 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 761 Beast Mode
- 65 App Studio
- 42 Variables
- 702 Automate
- 182 Apps
- 458 APIs & Domo Developer
- 52 Workflows
- 10 DomoAI
- 39 Predict
- 16 Jupyter Workspaces
- 23 R & Python Tiles
- 401 Distribute
- 116 Domo Everywhere
- 277 Scheduled Reports
- 8 Software Integrations
- 132 Manage
- 129 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 111 Community Announcements
- 4.8K Archive