Snowflake and Azure Blob Storage

If you want to use Snowflake and Azure Blob Storage for your data warehouse, you need the following prerequisites:

Access to Snowflake
A Microsoft Azure account with an active subscription

Configure Snowflake

How to configure Snowflake.

In Snowflake, create a new SQL worksheet and paste in the query shown below. The query will create a Snowflake database, a warehouse, and a user with the required permissions.

After changing the MY_NAME, MY_COMMENT, and MY_PASSWORD variables, run the entire query.

configure_snowflake.sql


_27-- Set up variables
_27SET MY_NAME = UPPER('Y42_DEMO');
_27SET MY_COMMENT = 'Y42 platform demo';
_27SET MY_PASSWORD = 'my_secret_password';
_27
_27-- Your current role will get access to the role and database we create here
_27SET EXECUTING_ROLE = CURRENT_ROLE();
_27
_27-- Set up user and role
_27CREATE ROLE IDENTIFIER($MY_NAME) COMMENT = $MY_COMMENT;
_27CREATE USER IDENTIFIER($MY_NAME) COMMENT = $MY_COMMENT PASSWORD = $MY_PASSWORD MUST_CHANGE_PASSWORD = false DEFAULT_ROLE = $MY_NAME;
_27GRANT ROLE IDENTIFIER($MY_NAME) TO ROLE IDENTIFIER('ACCOUNTADMIN');
_27GRANT ROLE IDENTIFIER($MY_NAME) TO ROLE IDENTIFIER($EXECUTING_ROLE);
_27GRANT ROLE IDENTIFIER($MY_NAME) TO USER IDENTIFIER($MY_NAME);
_27
_27-- Set up database
_27CREATE DATABASE IDENTIFIER($MY_NAME) COMMENT = $MY_COMMENT;
_27GRANT CREATE SCHEMA ON DATABASE IDENTIFIER($MY_NAME) TO ROLE IDENTIFIER($MY_NAME);
_27GRANT ALL ON DATABASE IDENTIFIER($MY_NAME) TO ROLE IDENTIFIER($MY_NAME);
_27GRANT OWNERSHIP ON DATABASE IDENTIFIER($MY_NAME) TO ROLE IDENTIFIER($MY_NAME) REVOKE CURRENT GRANTS;
_27
_27-- Set up warehouse
_27CREATE WAREHOUSE IDENTIFIER($MY_NAME) COMMENT = $MY_COMMENT WAREHOUSE_SIZE = 'X-Small' AUTO_RESUME = true AUTO_SUSPEND = 120 WAREHOUSE_TYPE = 'STANDARD';
_27GRANT USAGE ON WAREHOUSE IDENTIFIER($MY_NAME) TO ROLE IDENTIFIER($MY_NAME);
_27
_27-- Create network policy if required
_27-- CREATE NETWORK POLICY y42_allow_list ALLOWED_IP_LIST=('35.198.72.34/24');

The example query will generate the following credentials:

Field	Example value
User	`Y42_DEMO`
Password	`my_secret_password`
Account [1]	`https://<account_locator>.<cloud_region_id>.snowflakecomputing.com`
Warehouse	`Y42_DEMO`
Database	`Y42_DEMO`

[1] Region-specific account locator (opens in a new tab). You can retrieve this by hovering over your account in the account list and clicking on the 🔗 link icon that pops up.

Store these credentials in a secure location.

Configure Azure

Create storage account

In the Azure console, go to Storage Accounts and create a new storage account. Select the Subscription and Resource group to which you'd like to tie your storage account, and provide an appropriate name (e.g., y42demo). Select the region you want to use. Leave all other settings unchanged and click Create.

Create storage container

Next, navigate to the storage account and head to the Containers tab under Data storage. Create a new container with an appropriate name (e.g., y42demo), leaving the other settings unchanged.

Retrieve access keys

Lastly, also from the Security + networking section, select the Access keys tab. Here you will see two keys, each with their own Connection string. Store the values of key1 in a secure location.

Connect Y42

Back on Y42, select Snowflake as the provider. Add all the Snowflake credentials generated by the query above: User, Password, Account URL, Warehouse, and Database.

Under Storage, select Azure Blob Storage. Enter the Account Key, Account name, and Container name credentials from the previous step.

Choose a hosting location

Choose a location or region where Y42 will create the Azure Blob Storage bucket.

Up next

You can now continue with configuring the Git repository for your Y42 space.

Snowflake and Amazon Web Services S3 3. Ingest data