Transformation general settings

The General step opens the transformation editor, ahead of Query, Dependencies, Mapping and Validation. It holds the choices the later steps build on: the table the transformation loads, the source system it reads and the pattern it writes with. Fill it in first. The full create, test and finalize flow is on Build, test and finalize a transformation.

Fill in the General step

1. Open a transformation and stay on Transformation > General. If you started from a table's Transformations tab, the table is already chosen.
2. Choose the Table. Only Dimension and Fact tables are listed. Use Search tables… to find yours. Pick carefully: Table is available only while the transformation is new, and it locks after the first save.
3. Choose the Source System. Until you pick a table, the field reads First make table selection; then it lists the source systems of the table you chose.
4. Choose the Pattern. The choices depend on the table type, and Diff Delete and Diff Update appear only when the source system already has a transformation. See Transformation patterns and load settings.
5. Set the periodic options if they appear. A periodic pattern shows Synchronize Days, set to 1. Depending on the pattern, you also get Full Reload When Partition Empty, Loop Increment Value and Full Reload Start Date. Transformation patterns and load settings describes each one.
6. Add a Suffix if the table and source system already have a transformation. It is what tells the two names apart.
7. Check the Name. It is built from your choices and cannot be edited; the field shows Auto-generated. Add a Description if you want optional notes about the transformation.
8. Set Schedule if a workflow should run the transformation. It starts off; turning it on has a check of its own, described below.
9. Save with Apply, or click Next to move on.

What you can still change later

To open a copy, click Open copy on the Duplicate transformation row. Its tip reads: "Open a copy with the same configuration - set a new suffix to save". A copy starts with Schedule off and Synchronize Days 1.

Save the step

• The footer holds Previous, Revert, Apply and Next. Apply saves the step and keeps you on it; Revert drops the unsaved changes.
• Next moves on. If the step has unsaved changes, the Unsaved Changes dialog appears first: pick Save and continue to save and carry on, or Confirm to drop the changes and carry on.
• The first save of a new transformation registers it: Transformation registered successfully. Later saves show Transformation updated successfully.
• A failed save shows Failed to register Transformation or Failed to update Transformation with the reason. If the name is already taken, the message adds a hint such as Try adding a suffix to make the name unique.
• General errors appear as a toast and on the fields; the red banner at the top of the popup does not show them.

Schedule the transformation

• Schedule sits on the General step and starts off. Turn it on so the workflows that contain the transformation can run it; see Schedules and when a workflow starts.
• Turning it on checks the transformation's dependencies. If the transformation lies on a dependency cycle, switching on is refused and it stays off; switching it off is always allowed. Resolve the loop first, as described on Build, test and finalize a transformation.
• Save the step after switching.

Open the query execution settings

The Query execution settings row appears under the configuration fields once you choose a Table. Click Configure to open the settings dialog, where the performance presets, the settings history and the two toggles live. Transformation patterns and load settings describes them.

Fix a validation error

Saving checks the step's values first. A problem appears as a Validation Error toast and is marked on the field. The messages are:

• "Table is required", "Source System is required" or "Pattern is required": pick the missing value.
• "Synchronize days are required for the selected pattern": set Synchronize Days.
• "Full Reload When Partition Empty is required for the selected pattern": set this option for the selected pattern.
• "Loop Increment Value must be at least 1": enter a whole number of 1 or more.
• "Loop Increment Value is required for Truncate Insert Periodic Loop pattern": fill in the loop value.
• "Loop Increment Value is required when Full Reload When Partition Empty is enabled": fill in the loop value for this switch.
• "Use the format YYYY-MM-DD" and "Date must be between 1970-01-01 and 2106-02-07": correct Full Reload Start Date.
• "fill required fields in configuration": a required value inside Configuration is missing.

Fix the value and save again.

Questions, answered

Why can't I change the Table on a saved transformation?

A saved transformation is tied to its table. Table is available only while the transformation is new; it locks after the first save, and in a copy as well. To load another table, create a new transformation from that table.

I saved the wrong Suffix. How do I fix it?

Open a copy: click Open copy on the Duplicate transformation row, set a new Suffix in the copy and save it. The row's tip reads "Open a copy with the same configuration - set a new suffix to save". See Build, test and finalize a transformation.

Why is Source System disabled?

Until you pick a Table, the field reads First make table selection, because source systems belong to the table. After the transformation is saved, the field locks, and you change the source system in a copy. If the list is empty instead, add the source system to the table first; see Semantic sources, source systems and logical models.

What happens when I turn Schedule on?

The transformation becomes available to the workflows that contain it, so a scheduled run can execute it; see Schedules and when a workflow starts. Turning the switch on also checks the transformation's dependencies: if it lies on a dependency cycle, switching on is refused, while switching it off is always allowed.

Where are the query execution settings?

Under the configuration fields of the General step. The Query execution settings row appears once you choose a Table; click Configure to open the dialog. Transformation patterns and load settings describes the presets and toggles.

Why is my Full Reload Start Date refused?

The date must use the format YYYY-MM-DD and sit between 1970-01-01 and 2106-02-07. Clear the field to let the system find the earliest date itself. See Transformation patterns and load settings for the periodic options.