Import Step

The information on this page relates to the new upgraded interface of the IConduct platform. To view information about the Classic version of the user interface, follow this link.

 

This section describes how to add and set up the connection for the Import step applicable to the tasks in the interface. For more information about steps, see Defining Steps

 

Import step is used to import data into the IConduct Schema for transfer or further manipulation. To create the Import step, navigate to Interfaces> {Specific Interface}> Tasks> {Specific Task}> Steps >New>New Import Step.

 

To import your data from Data File Folder, follow the steps below:

 

  1. Select your target connection from the Connection drop-down list. Click Open for your reference, or if modifications or any changes are required in the pre-defined connection.

If you can't find the necessary Connection in the list, go to your Connection by clicking Open and make sure the Is Active checkbox is enabled.

  1. Select the required action from the Action drop-down list:
  • Insert: Import new data into an empty Schema’s table.
  • Update: Add the latest data to the existing schema fields.
  • Delete: Delete data from the Schema’s table.
  • Upsert: Select to either update or insert rows of data depending upon whether a specific set of conditions are met (or not).

On selecting Update, Delete, Upsert from drop-down list, the Schema Column and Source Column appear. These fields associate a specific field in the source system to a specific field in the Schema. The rows from the source system will Update/Delete or Upsert rows in the Schema based on this association. Select required columns to enable automatic updates. Press Refresh to update the list of source columns.

  1. Fill in the Query box using an SQL syntax. As defined by the Data File Folder connection mechanism, the software will apply the query to all files that comply with the File Pattern at a destination mentioned as Data Source={Value} in the ConnectionString (see Configuration Instructions).

Query examples:

 
  1. Get all data from files in the folder that comply with the pattern:

select * from samplefile

  1. Get addresses from all files in the folder that comply with the set pattern:

select Address from samplefile

  1. Get the quantity, name, price data from all files in the folder that comply with the set pattern:

select quantity,name,price from samplefile

  1. Get the quantity, name, price data for the sale ID 23 from all files in the folder that comply with the set pattern:

select quantity,name,price from samplefile

where saleID=‘23’

  1. Get the quantity, name, price data for the sales made on August 01, 2019 from all files in the folder that comply with the set pattern:

select quantity,name,price from samplefile

where SaleDate=‘20190801’

Once done, press Create and proceed with mappings.