The Log Record Error step is used to record processing events in terms of successfully completed records, records that are in error, records that were skipped or excluded due to filtering, and other dataset line items that represent headers and footers.
Let's first create and run a flow that contains a CSV reader step for the data source, a Filter step to deliberately exclude or skip specific records, and a Calculator step to deliberately introduce an error into the flow. View how this error is introduced into the flow here.
Ensure the Log Record Error step is configured to log all records.
Click on a link below to view more information:
Viewing the log information after a simulation Test
Click the blue play ▶ button adjacent to the Calculator step.
📝 This option tests the flow up to the Calculator step on the flow.
Select the options below, select your CSV source file then click the test option.
The debug data dialog will display the resultant data.
Now close this dialog and analyze the statistics on the flow.
Click on the little bug icon to drill down and expand into each record list that is displayed in the Debug Data tabs.
Related statistics
Each step object in the flow shows the number of records that were:
(C) Completed - These are successfully completed records.
(E) Error - These are records that are in error.
(O) Other - These are line items in the data file representing skipped records, headers, and footers.In the CSV step, there a total of 50 records, no error, and one other, which is the header line.
In the Filter step, there are 45 completed records, no errors, and five others that are deliberately skipped records.
In the Calculator step, there are 28 completed records, 17 error records, and no other records.
Viewing the log information after a live run
Next, you can drill down deeper into a log if we run the Execute Flow option which is the actual flow run.
Select the options below, select your CSV source file.
📝 You can get some sample CSV files to test your flow at this URL.
Click the Create Run option to execute the entire flow.
The Execute Flow run also displays the statistics in each flow step as shown above.
View Completed record details
Now, let's drill down into the Completed records.
Click the Total Records Completed button.
Click on any record number above to view the current and original record details.
View Error record details
Now, let's drill down into the Error records.
Click the Total Record Errors button.
Click on any record number above to view the error message, current, and original record details.
View Historical Flow runs
Select the Runs option to display a list of historical Flow runs.
A list of all historical runs is displayed which you can filter on Status, Parent Runs, and a Date range.
Click on any item in the data column above to open the relevant run and view the results as normal