Documentation and SupportReleases Lychee Release Notes 2016-12-10Snowflake Support Now Includes Import in Addition to Export.

Snowflake Support Now Includes Import in Addition to Export.

It is now possible to import data into the TMMData System from Snowflake.

1. Create Snowflake Import Connection:

1.1. Open the 'Wizards' System Tool

  1. Click the 'System' Icon.
  2. Click the 'Wizards' System Tool.
Open the 'Wizards' System Tool

1.2. Click the 'Add New Wizards' Button (+)

Click the 'Add New Wizards' Button (+)

1.3. Fill out the 'Add New Wizard' modal.

  1. Name: The name of this Connector.
  2. Description: An explanation of this Connector.
  3. Wizard Type: Choose 'Connection'.
  4. Type: Choose 'Snowflake Export'
  5. Beacon: The beacon to use with this Connector.
  6. Snowflake Account Name: The account name for Snowflake.
  7. User Name: The user name for the Snowflake account.
  8. Password: The password for the Snowflake account.

Click 'Next'

Fill out the 'Add New Wizard' modal.

1.4. Select the Warehouse and Database to use.

Click 'Next'

Select the Warehouse and Database to use.

1.5. Select the Schema to use.

Click 'Save'.

Select the Schema to use.

1.6. Congratulations, you have successfully created a Snowflake Connector!

2. Create New Table From Snowflake Connection.

2.1. Navigate to the 'Tables' System Tool:

  1. Click on the 'System' icon.
  2. Click on the 'Tables' System Tool.
Navigate to the 'Tables' System Tool:

2.2. Click on the 'Add New Tables' button. (+)

This will open the 'Add New Table' modal.

Click on the 'Add New Tables' button. (+)

2.3. Fill out the 'Add New Table' modal.

  1. Name: The name that this table will be labeled in the TMMData System.
  2. Description: An overview of this table. Any additional information about this table can be entered here.
  3. Folder: The folder in which to place the table.
  4. Type: The type of table that this is. (Choose 'From Connection' for this example)
  5. Backup: Whether or not this table should be backed up.

Click 'Next' when finished.

Fill out the 'Add New Table' modal.

2.4. Fill out the 'Add New Table' modal. (continued)

  1. Connection: The Connection to use to Import data into the new Table. (Choose 'Snowflake Connector Documentation' for this example)
  2. Table Update Frequency: How often should the Table be updated from the source. (Choose 'Once' to do a one-time pull of data)
  3. Table: The Table that we will be importing. (Choosing 'LYCHEE RELEASE NOTE TABLE' for this example)
  4. Stage: What staging area to be used during the data transfer. (Choose 'DEFAULT' for this example)

Click 'Next' when finished.

Fill out the 'Add New Table' modal. (continued)

2.5. Fill out the 'Add New Table' modal. (continued)

  1. Fields: Place a check-mark in the box beside all fields you wish to add to the new table.
  2. Filter Group: Set up any filters here to limit the data entering the new table.

Click 'Next' to continue.

Fill out the 'Add New Table' modal. (continued)

2.6. Fill out the 'Add New Table' modal. (final)

  1. Select Statement: The SELECT statement that has been generated to pull the data from Snowflake. Last minute adjustments can be made here.
  2. Truncate Table Before Import: Should the Table data be deleted before the import from Snowflake?
  3. Are there Custom Field types that need to be run?: Only select 'Yes' if there will be custom field types(in the new table) that need executed.
  4. Type of Import: What type of import are we running? There are three different options:

 

  • Import All Records: Import all records from the Snowflake Table into the new Table.(Choose for this example)
  • Import Only New Records: Import ONLY records that have been added since the last time the table was imported.(Takes much less time on periodical imports with large data sets)
  • Import New Records and Update Existing (Merge): Same as above but, in addition to Importing new records, it updates any records in the Import Table wherever data was updated in Snowflake.

Click 'Save' when finished to create the Table.

Fill out the 'Add New Table' modal. (final)

2.7. Congratulations! You have successfully created a Table from a Snowflake Connection.