DocsData WarehouseSnowflake Integration

Snowflake Integration

2.1 Connecting Snowflake to SyncSage

After selecting a connector (e.g., Salesforce, PostgreSQL) via Fivetran, follow these steps to sync data to Snowflake:

1. Provide Snowflake Credentials

Access your Snowflake account at https://app.snowflake.com/#/homepage

Snowflake Account Details

All required credentials can be found in view account details

  • Account Name: Your Snowflake account identifier (e.g., xy12345)
  • Username: Credentials
  • Password: Credentials with read/write access
  • Warehouse Name: Compute resource for query execution (e.g., ANALYTICS_WH)
  • Destination Schema/Table: Define where data will be stored (e.g., PRODUCTION.CUSTOMERS)

2. Test Connection

Validate credentials and permissions.

3. Sync Data

Initiate automatic data ingestion.

2.2 Post-Ingestion Actions

  • Data Validation: Use the SQL Query Editor to verify data completeness
  • Schema Adjustments: Rename columns or modify data types via the UI

2.3 Snowflake Environment Setup

Once connected, SyncSage will help you configure your Snowflake environment for optimal performance:

  • Warehouse Configuration: Set up appropriate warehouse sizes based on your workload
  • Database Creation: Automatically create databases and schemas for your data
  • Role and User Management: Configure proper access controls for your team
  • Virtual Warehouses: Set up separate compute resources for different workloads

Recommended Snowflake Settings

-- Create a warehouse for data loading
CREATE WAREHOUSE IF NOT EXISTS LOADING_WH
WITH WAREHOUSE_SIZE = 'MEDIUM'
AUTO_SUSPEND = 300
AUTO_RESUME = TRUE;

-- Create a warehouse for analytics queries
CREATE WAREHOUSE IF NOT EXISTS ANALYTICS_WH
WITH WAREHOUSE_SIZE = 'LARGE'
AUTO_SUSPEND = 300
AUTO_RESUME = TRUE;

-- Set up resource monitors
CREATE RESOURCE MONITOR IF NOT EXISTS credit_monitor
WITH CREDIT_QUOTA = 100
FREQUENCY = MONTHLY
START_TIMESTAMP = IMMEDIATELY
TRIGGERS ON 75 PERCENT DO NOTIFY
         ON 90 PERCENT DO NOTIFY
         ON 100 PERCENT DO SUSPEND;