Deploy, run, truncate and monitor tables

Use this page to deploy, run, check, truncate and drop Warehouse tables day to day. To build a table first, see Create a dimension or fact table and Build, test and finalize a transformation.

Deploy a table

Deploying creates the table in the warehouse from its current definition. Until then, the table shows Pending in the tree.

  1. In the tree, right-click the table and choose Deploy. This works for undeployed Fact, Dimension, View and Static tables.
  2. Or open the table, go to Settings and click Deploy.
  3. Read the message. A successful deploy shows Table deployed successfully. If it fails, you see Table deployment failed. Table partially deployed means only some of the work succeeded.

Deploying also builds the table's access layer and reapplies its Mind grants, so access is ready as soon as the table exists. Sync a table with the database covers the structure side of the deploy.

A Dictionary has no Deploy in the tree. Open it instead: its data mapping step shows a Deploy button until the table is deployed.

Run a transformation

From the table:

  1. Open the table and go to Transformations.
  2. Click Run transformation on the transformation's card.
  3. In Execute Transformation, choose the date and set any values under Run Parameters. Click Execute.
  4. The popup opens the Settings tab, where the run appears under Transformation Runs.

From the transformation:

  1. Open the transformation and go to Execution.
  2. Click Execute Now, choose the date and set the run parameters, then click Execute.

To see what a run writes, see How Dimension and Fact runs write data.

Run history for one source system

A Dimension with Store History keeps its versions current through a history run. It normally runs with the table's workflow, and a run can also be started on its own for one source system and a date. Dimension history explains what a run writes and the reasons a history step stops.

For it to run, the table must be a deployed Dimension with Store History on, and the source system must have a transformation with its schedule on. When it starts, DataMind shows History transformation started on JobId: followed by the job's ID.

The start is refused with the reason when something is missing or busy:

Read runs and statistics

The Transformation Runs table on Settings lists each run with its ID, Name, Status, Note, Rows, Error, Duration, User, Start, Finish and Snap Date. It refreshes by itself while the tab stays open: every two seconds while a run is active, and every ten seconds otherwise. Click Refresh runs in the table toolbar to reload the list yourself.

The Status column carries the run's state: Running, Finished, Failed, Aborted, Error, Running Error or Skipped. A skipped step is not an error; Skipped runs and restarts explains why runs skip or are refused.

The statistics strip at the top of Settings shows Size, Rows and Partitions. Click Refresh to reload them. The transformation's own Execution tab keeps a Run Log; Run a transformation and read the Run Log explains it.

Stop a running transformation

  1. In the table's Settings tab, click the stop button at the end of the running row. This tab does not ask you to confirm.
  2. Or open the transformation, go to Execution, click the stop button on the running row, and confirm Abort Transformation Run.

Truncate data for one source system

Truncate removes the data of one source system from a Dimension or Fact table. The table itself stays.

  1. Open the table, go to Settings and click Truncate in the statistics strip. The button appears only when the table is deployed.
  2. In Truncate Partitions, pick a source system under Source Systems.
  3. For a Fact, pick the dates under Partition Dates. For a Dimension that keeps history, pick a Truncate Target: Main (the default) clears the current data, History clears the versioned rows, and All clears both. Dimension history explains what those versions are.
  4. Read the summary and click Truncate. It counts the partitions you are about to remove and states This action cannot be undone.

When the truncate finishes, DataMind shows Partitions truncated successfully. The full dialog is described with the rest of the tab in Dimension and fact settings.

Drop a table

Drop removes the stored table but keeps its definition, so you can deploy it again.

  1. Open the table, go to Settings and click Drop in the statistics strip. The button appears only for deployed tables.
  2. Read the dialog. It warns that all data is permanently deleted, and that the definition stays so you can deploy again. Anything depending on the table is not dropped and breaks until you fix it or redeploy the table.
  3. Click Drop table.

When the drop finishes, DataMind shows The table has been dropped from the database. A dropped table is no longer deployed, so it shows Pending again.

Warning

Dropping a table does not remove what depends on it. Those objects break until you fix them or redeploy the table. Check the Dependants tab first.

Check what depends on a table

Open the table and go to Dependants. The tab lists downstream objects grouped by kind. If nothing uses the table, you see No dependants found.

Objects you cannot open are summarised as, for example, "2 Minds you cannot access". Ask their owners before you change the table. Dependencies and dependants describes the full tab, and Explore and trace lineage shows the wider picture.

Delete a table or transformation

Deleting removes a table or a transformation for good. Delete Warehouse objects covers the single and batch flows, the dependants check, refusals and retries.

Permissions

ActionPermission
Deploy, truncate, drop and delete a transformationAdd/Modify Warehouse Objects
Run and abort transformationsExecute/Abort Warehouse Objects
Run history for a source systemExecute/Abort Warehouse Objects
Delete tablesRemove Warehouse Objects
Read statistics and runsView Warehouse Objects

For the full picture, see Warehouse permissions and row-level security.

Limits

Questions, answered

What is the difference between Truncate and Drop?

Truncate removes the data of one source system, and for a Fact, the dates you pick. The table stays. Drop removes the stored table but keeps its definition, so you can deploy it again.

Why is Execute Now missing?

Execute Now appears only after the transformation is finalized. Finish validation first, as described in Build, test and finalize a transformation.

How do I stop a running transformation?

Click the stop button on the running row, either in the table's Settings tab, which stops the run without a confirmation, or in the transformation's Execution tab, where you confirm Abort Transformation Run.

Can I truncate only last week of a Fact?

Yes. Pick the source system, then pick only the dates from last week under Partition Dates.

What does the History truncate target clear?

The versioned rows, not the current ones. Main clears the current data, History clears the versioned rows, and All clears both. Dimension history explains what the versions hold.

I truncated the history by mistake. Can I undo it?

No. Truncation cannot be undone, and the confirmation says so before you click Truncate.

Do runs refresh by themselves?

Yes, while the tab stays open: every two seconds while a run is active, and every ten seconds otherwise. Refresh runs reloads the list on demand.

Can I delete a transformation without Remove Warehouse Objects?

Yes. Deleting a transformation needs Add/Modify Warehouse Objects. Deleting a table needs Remove Warehouse Objects.