Workflow diagram

The workflow diagram shows one run as a graph of its steps, so you can follow the work and see where a run broke. Open it when a run fails or runs slower than usual.

Open the diagram for a run

  1. Open Workflows in the sidebar and find the run in the runs table. See Job runs.
  2. Open the menu at the end of the run's row and choose WF diagram.
  3. The window opens on the Diagram view, in Flow, for that run. It is titled with the workflow name.
Note

The diagram needs a desktop-sized window. On a small screen the window shows the runs without it.

The window at a glance

The header carries the run selector, the run's status badge, the filter box and the Export button. The SETTINGS PANEL on the left holds the view switch, the highlight block, the Runs list and the timeline. Click Hide panel to close it and Show runs panel to bring it back; the window remembers your choice.

Three buttons switch the view:

Switch between runs

The selector reads Select a job.... It groups the workflow's runs under Current Run and Previous Runs, newest first, and a badge beside it shows the status of the run on screen. Pick another run to redraw the diagram for it.

Current Workflow is not a past run: it shows the workflow as it is now, and it is the only run option where you can change a step's schedule. The Runs list in the panel does the same as the selector: click a run to show it.

Read the steps

Each box is one step of the run. Its short badge shows the step type:

BadgeStep type
DIMDimension
FACTFact
HISTHistory
ANDAnd
STARTStart
ENDFinish
INITInitialize
TASKTask

A Task step has no Warehouse transformation behind it; it is a step such as a Lake table load or a write-back.

The statuses you meet on a step are Finished, Running, Failed, Running Error, Aborted, Skipped and Pending. A work step's card shows Table: and Source: rows, with - for a missing value, and a Disabled tag on a switched-off transformation; Less and More fold the rest of the card open.

Inspect a step

  1. Double-click a step. A single click only selects it; a selected step shows its action buttons above it.
  2. Read the panel on the right. Table: and Source: name the step's table and source system. The sections below are:
    • Schedule, with the switch described in the next section.
    • Timing: Start, Finish, Duration and Avg Duration.
    • Pipeline: ETL Type, Semantic Source and Processed Rows.
    • Notes, Error and Execution Logs, shown only when the step has them. See Run logs and step messages for what the step messages mean.
  3. In the header, Edit Transformation opens the step's transformation in Warehouse, Edit History opens the table behind the step, and Close closes the panel.

The action buttons on a selected step are View Node Details, Trace lineage (or Clear lineage trace), Edit Transformation, Edit Table and the schedule switch. Trace lineage keeps only the steps connected to this one, before and after it; Clear lineage trace shows everything again.

When a step carries an error, an Error block reads click to expand ↗; open it to read Error Details, and click Copy to copy the text.

Change a step's schedule

Each Warehouse transformation step with a schedule has a switch under Schedule in its details, and the same switch on its action bar. The label beside it reads Enabled or Disabled.

  1. In the run selector, choose Current Workflow. A schedule can only be changed when no specific past run is on screen.
  2. Open the step's details, or select the step.
  3. Switch it on or off.

Highlight steps

The highlight window works from left to right: "Pick from the left - items cascade into transformations on the right. Apply hides everything else."

  1. In the panel, click Highlight nodes. The block reads {n} filter(s) active while a highlight is on.
  2. Pick items under Transformations, Tables, Source Systems or Semantic Sources. They collect under Collected transformations.
  3. Click Apply. The diagram keeps the collected steps and the steps connected to them, and hides everything else.

Filter and search steps

Replay a run with the timeline

The Timeline appears when the run has at least two steps with times. It comes in two places: the floating slider at the right of the canvas and the Timeline section in the panel.

  1. Drag the slider, or type a moment in a time box.
  2. Read the diagram at that moment. Steps that had not started are hidden, and steps between their start and finish show as Running.
  3. Click the reset button, tooltip Reset timeline or Reset to latest, to return to the end of the run.

Export a picture

  1. Click Export in the header, or the export button at the bottom of the canvas.
  2. While it works, the button reads Exporting... and an overlay reads Generating PNG…; a PNG file downloads.
  3. A notification reads Export successful. If the export fails it reads Export failed; if it is stopped early it reads Export cancelled.

Who can see and change what

ToYou need
See a run's diagramView for the run's type, for example View Warehouse Workflow Objects
See a Warehouse run's diagramThe View permission, plus View Warehouse Objects or Add/Modify Warehouse Objects
Change a step's scheduleAdd/Modify Warehouse Objects

Without the view permission, WF diagram is greyed out in the run's menu. The extra Warehouse permissions sit in the Data Layer category. See Workflow permissions and Warehouse permissions and row-level security.

Limits and edge cases

Questions, answered

How do I compare today's run with yesterday's?

Open the run selector and choose the other run. The diagram shows one run at a time, so you switch between the two.

What is Current Workflow in the run list?

Current Workflow shows the workflow as it is now, not a past run. It is listed under Current Run, and it is the only run option where you can change a step's schedule.

What do the two numbers in a step's time row mean?

The first number is the time the step has taken in this run. The number after ~ is an estimate from the step's earlier runs. While a step is still waiting, only the estimate shows.

What does Trace lineage do?

It keeps the steps connected to the selected step, before and after it, and hides everything else, so you can follow one path through the run. Click Clear lineage trace to show all steps again.

Can I see which step was running at 03:15?

Yes. Drag the timeline to 03:15. Steps running at that moment show as Running, and steps that had not started are hidden. Click the reset button, tooltip Reset to latest, to go back.

I dragged steps around and lost the layout. How do I restore it?

Click Reset Layout in the panel, tooltip Restore original node positions. It is shown in Flow only.

Can I save the diagram for a report?

Yes. Click Export in the header. The diagram downloads as a PNG file named after the run.

Why did my diagram export fail?

One of three common reasons: the image is too large for the browser (The diagram is too large for this browser to export), the export took too long (Diagram export timed out), or the diagram kept moving while it was prepared (The diagram kept changing during export). Leave the diagram alone during the export and try again.

Why did the schedule switch go back to its old position?

The change was refused and rolled back. You see Failed to update node. Changes have been reverted., or Failed to update schedule. The usual causes are a missing Add/Modify Warehouse Objects permission, or a transformation on a dependency cycle that cannot be turned on.

Why is WF diagram greyed out for a Warehouse run?

A Warehouse diagram also needs access to Warehouse tables: View Warehouse Objects or Add/Modify Warehouse Objects, from the Data Layer category. Workflow bundles such as Workflow Administrator do not include them. Lake and WriteBack runs need only the view permission for their own type.

Why can't I filter by transformation name in the header?

The header filter covers table names, source systems and semantic sources. To narrow the diagram by transformation, use Highlight nodes.

Why does the diagram say No Workflow Data?

The workflow has no runs to draw yet. The diagram appears after the workflow's first run; see Run a workflow by hand.