The DataBee Set Extractor Rule Statistics Tab

The primary function of the Set Extractor Rule Statistics tab is to provide a record of the status of individual extraction rules as the extraction set is executed. The current execution state and statistics are presented for each rule individually. Aggregate statistics for the extraction set as a whole and specific statistics for those extraction rules currently executing, can be found on the Set Extractor Run Statistics tab.

The panel on the Rule Statistics tab lists all rules in the current extraction set. There are eight vertical columns in the extraction rule statistics display. These columns provide specific information on various components of the rule. All of the statistics fields are "live" and will constantly update as the rule is executing. The columns can be sorted by clicking in the column header above each type of statistic.

What the columns in the Rules Panel mean

Rule#

This column indicates the rule block and ID number of the rule and also contains a small icon which indicates the extraction rule type.

Rule Controller

Table-To-Table rule

Cross Schema Table-To-Table rule

Where Clause rule

All Rows rule

Stage 1 Command rule

Stage 3 Command rule

For some rules, a modifier is applied to the icon to indicate how the rule was created. For example, here is the icon for an All Rows rule which was created in bulk: . Rules like this are usually created by the Bulk Rule Generator or other tools found on the Rule Tools tab of the Set Designer application.

The rule block and ID number are displayed as a sequence of digits in the form XX-YYYY. The XX value is the rule block and the YYYY component is the rule ID. The ID of the rule is not particularly significant and serves only to provide a unique identification number for the rule. The rule block, however, is of considerable significance since it controls the execution order of the rule. The DataBee Set Extractor software is multi-threaded and can run up to eight rules in parallel. It is almost always the case within a extraction set that most rules cannot run simultaneously and must run sequentially one after the other as a chain. The rule block value controls the execution sequence. Please see the discussion of Rule Blocks in the extraction set overview help page and view the Creating a New Loader Set tutorial [(local) (internet)] in order to understand how to explicitly control the execution order of the extraction rules. Note that the extraction rules can be sorted in any order by clicking on the column headers. The presentation order on the display will not change the execution order in any way since the execution order is totally dependent on the rule block configuration. The rule block and the rule ID can be modified in the Set Designer application (not in the Set Extractor) by clicking it with the mouse and editing the value as appropriate.

Only Table-To-Table rules can be used as stage 2 rules and in that case a rule block of fk means the rule was derived from a foreign key and a rule block of tt indicates the rule was manually added to enforce a logical relationship. The Table-To-Table rules in stage 2 execute as required according to an internal scheduling algorythm and the rule block value cannot be adjusted for them.

Rule Type

This column contains descriptive text indicating the type of extraction rule which is represented by that line of the display.

Status

This area lists the current execution status of the rule. The currently executing rules are always listed as running. A Rule Controller with an actively executing extraction rule will also be shown as running until all of the extraction rules it contains have been processed. Note that a Table-To-Table rule listed with a state of Not Run after the extraction set completes its operations is not necessarily an error. It means that the rule did not need to activate because no rows were extracted for the source table in the relationship.

Rows Processed

This column indicates the number of unique rows extracted by the extraction rule - it is unused by all other rule types. Note this value will not necessarily be the same as the total number of rows extracted for the target table in the rule unless there are no other rules extraction rows for that target table.

Run Time (sec)

This is the total run time in seconds for the rule. This field will update continuously while a rule is executing.

Rows/Sec

Extraction rules will execute at a variety of rates depending on the rule type, database configuration and a large number of other factors. This field provides an indication of how many rows the rule is extracting per second. The value is derived from the other statistics via the formula: (Rows Processed)/(Time in Seconds). If the Time in Seconds field is less than 1 then a value of 1 second is assumed. Since fractional seconds are not tracked, this can make the calculated rows per second value seem much lower than it really is for small numbers of rows. This field is unused for rules such as Command rules which do not extract rows.

Passes

Rules executing in Stage 1 and Stage 3 will only ever execute once so this value will always be equal to 0 or 1 for them. Table-To-Table rules executing in stage 2 can, and will, activate many times to ensure that a referentially correct set of rows is extracted for the target table. For those rules this value indicates the number of times the rule has activated.

Errors

Each line describing a rule has a button in the Errors column. If an error occurred during execution, this button will change to a red X indicating that the rule had errors. Pressing on the button will launch a diagnostic form which displays diagnostic and debugging information regarding the error.