Documentation and SupportReleases Lychee Release Notes 2016-12-10AWS S3 Support Now Includes Import in Addition to Export.

AWS S3 Support Now Includes Import in Addition to Export.

AWS S3 Connectors can now be used to created in addition to our existing S3 export connector.

1. Create the S3 Import Connection:

1.1. Navigate to the 'Wizards' System Tool:

  1. Click on the 'System' icon.
  2. Click on the 'Wizards' System Tool.
Navigate to the 'Wizards' System Tool:

1.2. Click the 'Add New Wizards' button. (+)

This will open the 'Add New Wizard' modal.

Click the 'Add New Wizards' button. (+)

1.3. Enter information into the 'Add New Wizard' modal.

  1. Name: The name that this Connection will be stored under.
  2. Description: An overview of the Connection. Any additional information can be stored here.
  3. Wizard Type: The type of Wizard to be used. (Choose 'Connection' for this example)
  4. Type: The type of Connection to be used. (Choose 'AWS S3' for this example)
  5. Beacon: Which beacon to use with this Connection. (Choose 'default' for this example)
  6. Access Key ID: Your AWS Access Key ID. (This is assigned to you by AWS)
  7. Secret Access Key: Your AWS Secret Access Key. (This is assigned to you by AWS)

When finished filling out the information, click 'Save' to have the system save the Connection.

Enter information into the 'Add New Wizard' modal.

1.4. Congratulations! You are now ready to use this Connection to create a new Table in the TMMData System.

Congratulations! You are now ready to use this Connection to create a new Table in the TMMData System.

2. Create a New Table Using an AWS S3 Connection:

2.1. Navigate to the 'Tables' System Tool:

  1. Click on the 'System' icon.
  2. Click on the 'Tables' System Tool.
Navigate to the 'Tables' System Tool:

2.2. Click on the 'Add New Tables' button. (+)

This will open the 'Add New Table' modal.

Click on the 'Add New Tables' button. (+)

2.3. Fill out the 'Add New Table' modal.

  1. Name: The name that this table will be labeled in the TMMData System.
  2. Description: An overview of this table. Any additional information about this table can be entered here.
  3. Folder: The folder in which to place the table.
  4. Type: The type of table that this is. (Choose 'From Connection' for this example)
  5. Backup: Whether or not this table should be backed up.

Click 'Next' when finished.

Fill out the 'Add New Table' modal.

2.4. Fill out the 'Add New Table' modal (continued).

  1. Connection: The Connection that the Table will import from. (Choose the 'AWS S3 Import Connection' that we created earlier)
  2. Table Update Frequency: The schedule of when this table should be automatically updated, or should it only be updated once?
  3. Bucket: The AWS S3 Bucket that the file is in.
  4. Separator: Character separator to simulate directories. (for example the default value '/' would separate prefixes as prefix/prefix2/etc...)

Click 'Next' when finished.

Fill out the 'Add New Table' modal (continued).

2.5. Fill out the 'Add New Table' modal (continued).

Search for the Key that you wish to use.

Click 'Next' when finished.

Fill out the 'Add New Table' modal (continued).

2.6. Fill out the 'Add New Table' modal (continued).

Search for the Key that you wish to use.

Click 'Next' when finished.

Fill out the 'Add New Table' modal (continued).

2.7. Finalize 'Table Configuration'.

  1. Delete Files: This will automatically remove files from the S3 Bucket to prevent the files from getting picked up again.
  2. Truncate Table Before Import: This will permanently delete all records in the table before importing.
  3. Skip Row(s): The number of rows, if any, that need to be skipped to get to the 'Header Row' (The Header Row is the row containing the field/column names/labels)
  4. Skip Column(s): To omit specific columns from the import, enter the column numbers separated by commas [,]. (For example to skip the first and third columns you would enter 1,3)
  5. Are there Custom Field types that need to be run?: Select 'Yes' if your table contains custom field types that need to be triggered by the import.
  6. File Encoding: Self Explanatory, enter the file encoding type.
  7. File Pattern: This will be used to match files for subsequent data pulls. Please use % for wild cards. Leave blank to import the same file(s) every time.

Click 'Save' when finished.

Finalize 'Table Configuration'.

2.8. Congratulations! You have successfully created a Table from an AWS S3 Import Connector.

Congratulations! You have successfully created a Table from an AWS S3 Import Connector.