Description:
This step is used to validate an ETL job.
Inputs
- etlDef – select ETL definition
- variablesToPass - pass selected variables
- globalsToPass - pass selected globals
- variableToStoreID – variables/globals to store ETL Instance ID
Returns
- AllRowsGood – returns all good rows
- GoodBadRows - returns good and bad row
- AllBadRows - returns all bad rows
Usage:
Example:
Let’s build and execute the “clsExecuteETLValidationJobDef” example.
- Create a new definition called “clsExecuteETLValidationJobDef”
- Select the definition and click the “design” button
- Drag “clsExecuteETLValidationJob” step from the toolbox
- Connect the dots between the Start and “clsExecuteETLValidationJob” as above
- Provide appropriate workflow paths for the step returns - AllRowsGood, AllBadRows, and GoodBadRows
- Define variables/globals required for the execution
- Click the "clsExecuteETLValidationJob" step to configure its "Settings" properties. Provide a name to the step. Select the ETL definition from the drop-down list. Click the Save button.
- Click the "clsExecuteETLValidationJob" step to configure its "Advanced" properties. Click the button to configure multiple variables and globals to pass to the ETL instance during execution. Provide the variable/global reference to store the ETL instance ID. Click the Save button
- Click the button to configure variables to pass to the ETL instance as below.
- Click the button to configure globals to pass to the ETL instance as below.
- The “Logging” setting configuration is necessary for documentation and also measures the workflow progress and the percent complete. This is achieved by configuring the step state and percent fields individually, as shown in the images below. Configure the “Logging” using the following properties.
- Navigate to the Process Definition page. Save the process definition, create a new instance, and execute. Render the process instance. This “clsExecuteETLValidationJob” step shall validate the ETL job as configured.
- Navigate to the ETL Instances page. Render the above instance to view. The ETL process execution is shown below.
Definition Sample:
You may download the sample definition(s) from the link here and later import it (drag-drop) to your FlowWright Process Definition (XML file) or Form Definition (HTML file) page.
NOTE: Please verify and complete the process steps for any missing configurations, such as file path references and database connections after import. Then, save the definition to confirm the changes.