clsExecuteETLJob Step

Use this step to run ETL jobs from the process

Last published at: November 15th, 2024

Description:

This step is used to execute an ETL job from the process workflow. 

 

Inputs

  • etlDef – select ETL definition
  • variablesToPass – pass selected variables
  • globalsToPass – pass selected globals
  • variableToStoreID – variables/globals to store ETL Instance ID
 

 

Returns

  • True – step executed successfully
  • False – step failed to execute 
 

 

Usage:

 

 

Example:

Let’s build and execute the “clsExecuteETLJobDef” example.          

  • Create a new definition called “clsExecuteETLJobDef”
  • Select the definition and click the “design” button
  • Drag "UpdateVariable, UpdateGlobal, and clsExecuteETLJob” steps from the toolbox
  • Connect the dots between the Start and other steps as above
  • Define variables/globals required for the execution
  • Click the "updateVariable" step to configure its "Settings" properties. Provide a name to the step.
  •  Click the "updateVariable" step to configure its "Advanced" properties. Click the button to initialize multiple variables required for the process or provide the reference and the value for a single variable. Select the Expression as No if the variable value has no expression to evaluate. Click the Save button to confirm the configuration. In the example below, the variable value stores the input file path required for the ETL definition.  

 

  • Click the "updateGlobal" step to configure its "Settings" properties. Provide a name to the step. 
  • Click the "updateGlobal" step to configure its "Advanced" properties. Click the button to configure multiple global references. Click the Add Row(+) button to insert an empty row. Provide the global name and value. Click the Save button. You may insert multiple global references by adding more rows. Select Expression as No if the global value has no expression to evaluate. 

 

  • Click the "clsExecuteETLJob" step to configure its "Settings" properties. Provide a name to the step. Select the ETL definition to execute from the drop-down list.  Click the Save button to confirm the configuration. 

 

  • Click the "clsExecuteETLJob" step to configure its "Advanced" properties. Click the button to configure multiple variables to pass to the ETL Definition during execution. Click the Add Row (+) button to insert an empty row. Select the pre-configured variable from the drop-down list. Click the Save button. You may insert multiple variable references by adding new rows. Provide a variable/global reference to store the ETL Instance ID value. 

 

  • Click the button to configure multiple globals to pass to the ETL Definition during execution. Click the Add Row (+) button to insert an empty row. Select the pre-configured global from the drop-down list. Click the Save button. You may insert multiple global references by adding new rows. 

 

  • The “Logging” setting configuration is necessary for documentation and also measures the workflow progress and the percent complete. This is achieved by configuring the step state and percent fields individually, as shown in the images below. Configure the “Logging” using the following properties.

 

  • Navigate to the ETL - Definition page and select the above-referenced definition from the table. Click the Actions - Design menu option. The definition design is rendered on the new page for modifications. Select the CSV Input File step. On the Settings tab, provide the variable reference passed from the process definition for the input file path.  Click the Save button to confirm the configuration. 

 

  • Select the CSV Output File step. On the Settings tab, provide the global reference passed from the process definition for the output file path.  Click the Save button to confirm the configuration. 

 

  • Navigate to the Process Definition page. Save the process definition, create a new instance, and execute. Render the process instance. The process step has executed the ETL job as shown below. 

 

  • Navigate to the ETL Instances page. Render the above instance to view. The ETL process step has been executed using the variable and global references passed from the Process instance as shown below.  

 

Definition Sample:

You may download the sample definition(s) from the link here and later import it (drag-drop) to your FlowWright Process Definition (XML file) or Form Definition (HTML file) page.

NOTE: Please verify and complete the process steps for any missing configurations, such as file path references and database connections after import. Then, save the definition to confirm the changes.

Click here to download the Process sample file.

Click here to download the ETL Process sample file.