Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Pub/Sub ordering key
HiThere is a specific point regarding ordering key that I don't understand.After a message is being published ...
Composer 3 - Monitoring frequently offline
Hello,I've been using Cloud Composer 3 for some time now. Recently I've noticed that my Environment Overview t...
BigQuery Location Mismatch Error with Datastream
I'm getting a location constraint error when trying to create a table that queries data from my Datastream-rep...
BQ Billing
Hey guys! I have 3 queries below, I'm struggling to understand why the bytes billed are so different between Q...
schedule the upload of a local file to a GCP bucket
Hi,How can I create a pipeline to schedule the upload of a local file to a GCP bucket?I used this documentatio...
Importing Google Sheets into a BigQuery Table
Hi I am importing a table into a BigQuery Dataset from a Google Sheet, using the URL from Google Drive. Is the...
getting error while creating dataproc cluster
cant able to create cluster i also did vpc subnet also still getting same error cluster uuid was removed by me...
GA4 backfill - data transfer service
Hello,Like many GA4-BigQuery users I've misunderstood the GA4 data "backfilling" capabilities. This is partial...
DTS facebook ads to bigquery - table AdInsightsActions UNUSEFUL
Hello,I’ve started using the native Facebook Ads to BigQuery data transfer.The transfer populates 3 tables:AdA...
How to install python packages during runtime in dataproc serverless
In Dataproc, we have metadata option to install python packages in a dataproc cluster created through Composer...
Dataform "Illegal base64 character 2d" for Bitbucket SSH connection
I am attempting to connect a Dataform repository to a private Bitbucket repository using SSH authentication. T...
Error Collector in DataForm
Hello everyone! I have a question about Dataform.My question is: how does this environment handle errors in th...
Is it true that cross-project views block partition filter pushdown?
We’re seeing unexpected performance issues in BigQuery when querying views across projects. Context:We're que...
BigQuery 403: IPv4 requests blocked, but IPv6 works normally
Hi everyone, Since March 29, 2025, all requests to BigQuery made over IPv4 (from within Dockerized Airflow 2.9...
Looker Reports GA --> AI for BI Innovation Roadmap 2025
I am currently using Looker original. I recently attended the AI for BI Innovation Roadmap webinar: https://ww...
How to Pull from a GitHub Branch in Google Dataform (Development Workspaces)?
Hello!I've set up a repository in Google Dataform and successfully connected it to GitHub. After creating a de...
Share the DB connection pool across all Dataflow workers
We have 50 Google Cloud SQL instances, each running PostgreSQL. Each of these instances contains 100 individua...
Exporting Cloud Messaging to BigQuery doesn't work
On Google Firebase I enabled BigQuery and selected Cloud Messaging. firebase_messaging dataset was automatical...
Globalstate in Dataflow
I need to implement a Globalstate in Dataflow which can be accessed throughout an entire pipeline using Java s...
Accurately estimating BigQuery storage costs per table – usage timeline underestimates, TABLE_STORAG
Hi everyone,I’m working on optimizing BigQuery usage and need to calculate storage costs per table to identify...
BigQuery & GA4 - session source / medium
Hi, I am working on a dashboard that is based on BigQuerythere are several conversions I am sending to BigQuer...
Salesforce to BigQuery - Data Transfer
Hello,Have anyone tested the new data transfer from Salesforce ? https://cloud.google.com/bigquery/docs/salesf...
Apps Script to BigQuery Fails: "Unexpected token [ProjectID]^"
Hello, I'm encountering a persistent error when trying to call `BigQuery.Jobs.query()` from Google Apps Script...
OperationalError when using TriggerDagRunOperator
Hi, I'm newly setting up Cloud Composer on composer-3-airflow-2.10.2-build.12 and have encountered some errors...
Dataflow template - Streaming - Mongo DB CDC to Bigquery
Hey Team,I want to synchronize atlas mongodb data to bigquery in real time.I tried to use this template to rep...
Transfer bigquery dataset from one account to another
I would like to copy Company A Bigquery's Dataset to Company B Bigquery.What is a good way to transfer Bigquer...
Public Report Sharing in Looker Pro
Hello,I am currently using Looker Pro to enhance my reports. However, I’ve encountered a limitation where I ca...
Composer - multiple environments in dev tier
Hi all, We are currently using multiple composers instances when we need additional dev tiers(dev1, dev2 etc)....
Composer Airflow Dataset Error
Hi there! We met a scheduler error in Composer Airflow where scheduler does not work can continuously meet suc...
What Latency to expect when using datastream to push changes from mysql to google storage?
Hello ,I have setup datastream to push events from a GCP Cloud mysql instance to google storage.With no load o...
Articles from Product Experts and Googlers
Configuring GKE rollout sequencing
You can manage the order of automatic cluster upgrades across Google Kubernetes Engine (GKE) clusters in multiple environments using rollout sequencing. For example, you can qualify a new version in pre-production clusters before upgrading production clusters.
MCP x ADK - Engineering Agents That Execute, Not Just Predict
Unlock the power of AI agents by connecting them to real-world tools and data. This guide explores the Model Context Protocol (MCP) for seamless integration. Follow the code-centric tutorial to build a Financial Advisory Agent with Google's ADK. Learn to equip your agents with external capabilities for complex, real-world tasks.
BigQuery Advanced Runtime and Enhanced Vectorization
BigQuery Advanced Runtime's Enhanced Vectorization expands on vectorized query execution by applying it to key aspects of query processing, such as filter evaluation in BigQuery storage, support for parallel execution of query algorithms, and through specialized data encodings and optimization techniques.
