BigQuery and Google Cloud Storage

BigQuery and Google Cloud Storage

If you want to use BigQuery and Google Cloud Storage for your data warehouse, you need the following prerequisites:

Create a service account

Y42 needs a service account to establish a secure connection to Google Cloud. In the Google Cloud Platform console, navigate to the IAM & Admin section and select Service accounts. Provide the following configuration values (or similar):

Configuration optionValue
Service account nameY42
Service account IDDefault (auto-generated)
Service account descriptionService account used by Y42 to read/write to BigQuery and Google Cloud Storage

Grant service account access

Required service account access roles in Google Cloud.

Required service account access roles in Google Cloud.

In the next section, grant the service account access to your Google Cloud project with the following roles:

  1. BigQuery Admin
  2. Storage Object Admin
  3. Storage Admin

Add a service account key

Add a service account key in Google Cloud.

Add a service account key in Google Cloud.

Select the service account and add a new JSON-formatted key. Download the JSON file.

Connect Y42

Back on Y42, select BigQuery as the provider and upload the service account key.

Choose a hosting location

Choose a location or region where Y42 will create a Google Cloud Storage bucket and a BigQuery dataset.

Minimum required permissions

To run Y42 with minimal permissions within your Google Cloud Project, create a custom role with the following policies. Assign this custom role to the service account you have created, replacing the three ... Admin roles.

gcp_min_permissions

_22
bigquery.datasets.create
_22
bigquery.datasets.get
_22
bigquery.datasets.getIamPolicy
_22
bigquery.jobs.create
_22
bigquery.routines.get
_22
bigquery.routines.list
_22
bigquery.tables.create
_22
bigquery.tables.delete
_22
bigquery.tables.get
_22
bigquery.tables.getData
_22
bigquery.tables.list
_22
bigquery.tables.update
_22
bigquery.tables.updateData
_22
_22
storage.buckets.create
_22
storage.buckets.get
_22
storage.buckets.getIamPolicy
_22
storage.buckets.list
_22
storage.objects.create
_22
storage.objects.delete
_22
storage.objects.get
_22
storage.objects.list

Up next

You can now continue with configuring the Git repository for your Y42 space.