Staging Activity (2.9)
Introduction
A staging activity loads data from one or more data schemas, loading data for each schema to its own generated staging table. For each schema, you can control which fields are copied, as well as how the load operation is performed. Within a staging activity, all schemas must belong to a single data source.
Options
For each data schema used in a staging activity, the following options apply:
-
Primary Key Fields—Indicates the primary key fields of the schema. This option is controlled by the schema definition and cannot be changed within a recipe.
-
Extraction Strategy—Indicates how data is extracted from this schema. This option is controlled by the schema definition and cannot be changed within a recipe.
-
Staging Table—Specifies the table into which this activity loads data. This table name is generated and cannot be changed.
-
Stage on Target Table—Enables you to copy data to the table name of your choice. The table is generated for you. If you select this, you are prompted for a full table name.
-
Use SQLQuickload—Enables the system to perform a bulk load for this step. If you select this, also specify the following options:
-
Action On Dropped Records—Specifies the action to take when the bulk load encounters more than the specified number of dropped records. The Use SQLQuickload option drops a record if that record cannot be inserted, which can occur if the record is invalid in some way (such as not having a required field or having a value in an incorrect format). For Action On Dropped Records, select one of the following, to specify how the system should behave if the maximum number of dropped records is reached:
-
Abort—The recipe is automatically aborted, without any workflow intervention.
-
WorkflowStrict—The recipe is stopped and a workflow task is generated. The workflow task provides the options Abort and Retry.
-
Workflow—The recipe is stopped and a workflow task is generated. The workflow task provides the options Abort, Retry, and Ignore and Proceed.
-
Proceed—The recipe continues.
-
-
Max Dropped Records—Specifies the maximum number of dropped records before the specified action is triggered.
-