---
title: How to Configure a BigQuery Data Pipeline
description: Read the article and follow the step-by-step instructions for configuring the BigQuery data pipeline with Intentwise analytics Cloud
---

[Skip to content](https://help.intentwise.com/configuring-bigquery-data-pipeline#main-content)

![footer-logo.png\]](https://help.intentwise.com/hs-fs/hubfs/footer-logo.png?width=210&height=40&name=footer-logo.png)

Open main navigation

Close main navigation

 Advice and answers from Intentwise

- There are no suggestions because the search field is empty.

1. [Knowledge Base](https://help.intentwise.com/?hsLang=en)
2. [Intentwise Analytics Cloud](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en)
3. [Configuring Data Pipeline](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#configuring-data-pipeline)

# How to Configure a BigQuery Data Pipeline

## Read the article and follow the step-by-step instructions for configuring the BigQuery data pipeline with Intentwise analytics Cloud

### Steps for Configuring a BigQuery Data Pipeline

To configure a BigQuery data pipeline with Intentwise Analytics Cloud, follow these steps:

1. Sign in to your Google console at [https://console.cloud.google.com](https://console.cloud.google.com)
2. In the top-left corner, click **Menu** \> **IAM & Admin** \> **Create a Project**

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-34-59-1558-AM.png?width=670&height=410&name=image-png-Jun-26-2026-09-34-59-1558-AM.png)
3. Now, enter the project name, choose the organization & location, and click Create. Project Name and Location can be of your choice

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-35-29-7644-AM.png?width=670&height=458&name=image-png-Jun-26-2026-09-35-29-7644-AM.png)
4. Navigate to the BigQuery page. Choose the newly created project and create datasets as mentioned below:

     - amazon\_source\_data
     - intentwise\_ecommerce\_graph
     - amazon\_marketing\_cloud (*recommended if you are currently using or intend to use Amazon Marketing Cloud*)
     - criteo\_source\_data (*recommended if you are currently using or intend to use Criteo*)
     - instacart\_source\_data (*recommended if you are currently using or intend to use Instacart*)
     - walmart\_source\_data (*recommended if you are currently using or intend to use Walmart*)
5. You can add the datasets under Explorer and clicking on the three vertical dots icon against the newly created project

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-43-02-7457-AM.png?width=670&height=682&name=image-png-Jun-26-2026-09-43-02-7457-AM.png)

### Create a cloud storage bucket

To create the bucket in Google Cloud Storage, follow these steps:

1. Choose the newly created project.
2. Navigate to the **Cloud Storage Buckets** page.
3. Click **Create a bucket**
4. In the **Get Started** Page, enter a globally unique name of your choice for the folder.

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-38-47-8968-AM.png?width=670&height=826&name=image-png-Jun-26-2026-09-38-47-8968-AM.png)![](https://downloads.intercomcdn.com/i/o/ddgxx02g/1206892862/0df9034bb476d827d2ce0bd36aef/image.png?expires=1739358900&signature=3fa2e877f2de1be768e3003a581ecac08b87324560c18457cef117c53474011f&req=dSInEMF3n4lZW%2FMW1HO4zZgZawpyc%2Bd9uZ9h7p5tfagNrQdcTpgEBU%2FfIRrf%0Ag1%2Bp%0A)
5. Click **Continue**
6. In the "**Choose where to store your data**" section, select the **same location as the project**, for example: us-west1.

Click "**Create**" at the bottom of the page. You can skip the other options like "Choose Storage Class" and "Control Access."

![](https://help.intentwise.com/hubfs/Knowledge%20Base%20Import/downloads.intercomcdn.comioddgxx02g1206893350fedc7f56820b020cd31482a993eaimage.png)<https://downloads.intercomcdn.com/i/o/ddgxx02g/1206893350/fedc7f56820b020cd31482a993ea/image.png?expires=1739358900&signature=65779640dbbcc2168051bfc8c8ef936a77766fcf82a27f16e95b57b2380ea771&req=dSInEMF3noJaWfMW1HO4zYIA7r1ZsH4VEmWG60ujayAsqiZeweA9P0FHa5xq%0AlYBFDyuYGY2Zx7o5Jfc%3D%0A>

### Steps for creating a service account

1. Choose the newly created project.
2. Open the Burger Menu on the side and Go to IAM -\> Service Accounts.
3. In the Service Accounts page, Click on the **Create Service Account** button on the top. You should now see a form to create a service account. Fill in any Service Account Name, Service Account ID, Service Account Description. Below is an example –

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-43-58-9012-AM.png?width=670&height=661&name=image-png-Jun-26-2026-09-43-58-9012-AM.png)
4. Click "Create and Continue." You should now see an option to assign Service Account permissions. Under that, there will be a dropdown. Search for the roles listed below and add them. Use "Add Another Role" to include each of the following roles:

     1. BigQuery Data Editor
     2. BigQuery Job User
     3. Storage Object User
     4. BigQuery Read Session User
     5. Storage Admin:

            1. When adding Storage Admin Click on Add IAM Condition
            2. Enter any title
            3. In the Condition builder choose below options:

                     1. Condition type - Name
                     2. Operator - is
                     3. Value - projects/\_/buckets/**bucket-name*.*** *Replace only the bucket*-name with the bucket created in the previous step. **Example:** projects/\_/buckets/iw\_bucket

                        ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-44-47-9448-AM.png?width=670&height=341&name=image-png-Jun-26-2026-09-44-47-9448-AM.png)
5. Once all the Roles are assigned, click **Done**

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-45-33-8097-AM.png?width=670&height=712&name=image-png-Jun-26-2026-09-45-33-8097-AM.png)
6. On the next screen, Click on the newly created Service account email. Choose the **KEYS** tab. Click on Add Key

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-46-23-6332-AM.png?width=670&height=509&name=image-png-Jun-26-2026-09-46-23-6332-AM.png)
7. Choose **Key type** JSON and click Create.

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-46-53-8319-AM.png?width=670&height=421&name=image-png-Jun-26-2026-09-46-53-8319-AM.png)
8. Now, login to the Intentwise platform and navigate to **My Connections** under **Intentwise Analytics Cloud.** Clickon **"+ Add Destination",** choose **Big Query** as the destinationand **click Next.**

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-49-07-8184-AM.png?width=670&height=416&name=image-png-Jun-26-2026-09-49-07-8184-AM.png)
9. Enter the **Project ID** and the **Location, Bucket Name, and upload the Service account private key**  in the next window and click on **Save**.

   ![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-50-16-1430-AM.png?width=670&height=815&name=image-png-Jun-26-2026-09-50-16-1430-AM.png)
   
    
   
   You can get the Project ID and Location from the Explorer, by clicking on the three vertical dots icon against the dataset and then choosing the option "Open"![](https://help.intentwise.com/hs-fs/hubfs/image-png-Jun-26-2026-09-53-44-9998-AM.png?width=1046&height=1000&name=image-png-Jun-26-2026-09-53-44-9998-AM.png)
10. On successful completion, you will see a success message.
11. For any further questions on the pipeline setup, please reach out to us on *chat* or at help@intentwise.com.

- [Getting started](https://help.intentwise.com/getting-started?hsLang=en)
- [Intentwise AI Gateway](https://help.intentwise.com/intentwise-ai-gateway?hsLang=en)
- [Intentwise Ad Optimizer](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#main-content)

    - [Account and Campaign Setup](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#account-and-campaign-setup)
    - [Optimization](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#optimization)
    - [Reporting](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#reporting)
    - [Dashboard Overview](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#dashboard-overview)
    - [Resources](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#resources)
    - [Amazon DSP](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#amazon-dsp)
    - [Additional Features](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#additional-features)
    - [Walmart](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#walmart)
    - [Criteo](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#criteo)
    - [Instacart](https://help.intentwise.com/intentwise-ad-optimizer?hsLang=en#instacart)
- [Intentwise Explore (AMC)](https://help.intentwise.com/intentwise-explore-amc?hsLang=en#main-content)

    - [AMC](https://help.intentwise.com/intentwise-explore-amc?hsLang=en#amc)
    - [Instructional Queries](https://help.intentwise.com/intentwise-explore-amc?hsLang=en#instructional-queries)
- [Intentwise Analytics Cloud](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#main-content)

    - [Kickstart Guide](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#kickstart-guide)
    - [Configuring Reporting Tools](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#configuring-reporting-tools)
    - [Configuring Data Pipeline](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#configuring-data-pipeline)
    - [Data Sources](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#data-sources)
    - [Looker (Google Data) Studio Tutorials](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#looker-google-data-studio-tutorials)
    - [Intentwise Templates](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#intentwise-templates)
    - [Intentwise Analytics Cloud features](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#intentwise-analytics-cloud-features)
    - [White Label](https://help.intentwise.com/intentwise-analytics-cloud?hsLang=en#white-label)
- [Intentwise Marketplace Intelligence](https://help.intentwise.com/intentwise-marketplace-intelligence?hsLang=en#main-content)

    - [Content Analytics (CA)](https://help.intentwise.com/intentwise-marketplace-intelligence?hsLang=en#content-analytics-ca)
    - [Share Of Voice (SOV)](https://help.intentwise.com/intentwise-marketplace-intelligence?hsLang=en#share-of-voice-sov)
- [Frequently Asked Questions (FAQs)](https://help.intentwise.com/frequently-asked-questions-faqs?hsLang=en#main-content)

    - [Access and Setup](https://help.intentwise.com/frequently-asked-questions-faqs?hsLang=en#access-and-setup)
    - [Billing](https://help.intentwise.com/frequently-asked-questions-faqs?hsLang=en#billing)
    - [Platform](https://help.intentwise.com/frequently-asked-questions-faqs?hsLang=en#platform)
    - [Reporting](https://help.intentwise.com/frequently-asked-questions-faqs?hsLang=en#reporting)

intentwise.com Help Center

Copyright © 2026, Intentwise Inc.