Snowflake Support Now Includes Import in Addition to Export.
It is now possible to import data into the TMMData System from Snowflake.
1. Create Snowflake Import Connection:
1.3. Fill out the 'Add New Wizard' modal.
- Name: The name of this Connector.
- Description: An explanation of this Connector.
- Wizard Type: Choose 'Connection'.
- Type: Choose 'Snowflake Export'
- Beacon: The beacon to use with this Connector.
- Snowflake Account Name: The account name for Snowflake.
- User Name: The user name for the Snowflake account.
- Password: The password for the Snowflake account.
1.6. Congratulations, you have successfully created a Snowflake Connector!
2. Create New Table From Snowflake Connection.
2.1. Navigate to the 'Tables' System Tool:
2.3. Fill out the 'Add New Table' modal.
- Name: The name that this table will be labeled in the TMMData System.
- Description: An overview of this table. Any additional information about this table can be entered here.
- Folder: The folder in which to place the table.
- Type: The type of table that this is. (Choose 'From Connection' for this example)
- Backup: Whether or not this table should be backed up.
Click 'Next' when finished.
2.4. Fill out the 'Add New Table' modal. (continued)
- Connection: The Connection to use to Import data into the new Table. (Choose 'Snowflake Connector Documentation' for this example)
- Table Update Frequency: How often should the Table be updated from the source. (Choose 'Once' to do a one-time pull of data)
- Table: The Table that we will be importing. (Choosing 'LYCHEE RELEASE NOTE TABLE' for this example)
- Stage: What staging area to be used during the data transfer. (Choose 'DEFAULT' for this example)
Click 'Next' when finished.
2.5. Fill out the 'Add New Table' modal. (continued)
2.6. Fill out the 'Add New Table' modal. (final)
- Select Statement: The SELECT statement that has been generated to pull the data from Snowflake. Last minute adjustments can be made here.
- Truncate Table Before Import: Should the Table data be deleted before the import from Snowflake?
- Are there Custom Field types that need to be run?: Only select 'Yes' if there will be custom field types(in the new table) that need executed.
- Type of Import: What type of import are we running? There are three different options:
- Import All Records: Import all records from the Snowflake Table into the new Table.(Choose for this example)
- Import Only New Records: Import ONLY records that have been added since the last time the table was imported.(Takes much less time on periodical imports with large data sets)
- Import New Records and Update Existing (Merge): Same as above but, in addition to Importing new records, it updates any records in the Import Table wherever data was updated in Snowflake.
Click 'Save' when finished to create the Table.