Home Mold

workflow-brief-to-galaxy-test-plan

Synthesize a Galaxy workflow test plan from a reviewed Workflow Brief, its Galaxy design briefs, and available source evidence.

Mold health

ok
  • Source layout

    Every file beside index.md is one the mold kind declares.

  • Axis fields

    target-specific fields are coherent.

  • Eval plan

    Abstract oracle: the properties any cast of this Mold must satisfy.

    eval.md declares properties and check type.

    eval.md ↗
  • Scenarios

    Concrete cases bound to fixtures, run against the eval properties.

    scenarios.md declares cases bound to fixtures.

    scenarios.md ↗
  • Typed refs

    9 typed references; 0 resolver issues.

  • On-demand triggers

    All on-demand references describe triggers.

  • Evidence checks

    Hypothesis references include verification.

axis
target-specific
target
galaxy
name
workflow-brief-to-galaxy-test-plan
contract

Reference Loading

Typed references describe what casting consumes, and when the generated skill should load each artifact.

Research workflow-brief-design

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Keep reviewed acceptance criteria authoritative while treating source summaries as supporting evidence.
Verify
Confirm synthesized tests do not assert excluded analyses or silently alter expert acceptance criteria.
Schema galaxy-workflow-test-plan

Structured contract copied for validation or lookup.

Purpose
Output contract: the emitted plan conforms to [[galaxy-workflow-test-plan]]. Cast bundles the JSON Schema so the skill carries its output shape; validate with `foundry validate-galaxy-workflow-test-plan`.
Verify
Cast the skill, run on a representative reviewed brief with source evidence, confirm the emitted YAML validates and downstream [[implement-galaxy-workflow-test]] consumes it without re-deriving acceptance criteria.
Schema tests-format

Structured contract copied for validation or lookup.

Purpose
Use the Galaxy workflow tests schema as the assertion-family vocabulary referenced by the plan's assertion intent.
Trigger
When naming an assertion family or compare operator for a synthesized expected output.
Research galaxy-workflow-testability-design

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Choose which workflow outputs and promoted checkpoints make meaningful assertions when no upstream test evidence exists.
Trigger
When deciding which outputs to assert, which checkpoints to promote, and which labels the plan should assume.
Research iwc-test-data-conventions

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Describe job-input fixtures, remote-URL-first locations, hashes, and collection input shapes the plan should record as fixture provenance.
Trigger
When recording job inputs or fixture provenance, or deciding whether a fixture belongs in test-data, Zenodo, ENA/SRA, or CVMFS.
Research iwc-shortcuts-anti-patterns

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Distinguish accepted IWC-style test shortcuts from assertion smells while synthesizing assertions from intent.
Trigger
When considering existence-only, size-only, image-dimension, or tolerant output checks, or recording an omission.

Cast artifacts

  • Claude skill workflow-brief-to-galaxy-test-plan — Synthesize a Galaxy workflow test plan from a reviewed Workflow Brief, its Galaxy design briefs, and available source evidence.

How to install →

Artifact handoffs

/ pipeline contract

Produces

Consumes

Inputs sharing a role are alternatives — one producer satisfies it.

workflow-brief-to-galaxy-test-plan

Synthesize a Galaxy workflow test plan from the reviewed Workflow Brief and the Galaxy interface and data-flow briefs. Consult retained source evidence when available. The output is a reviewable handoff conforming to galaxy-workflow-test-plan, not a concrete tests-format file: it records test cases, job inputs, expected outputs, assertion intent, fixture provenance, label assumptions, unresolved mappings, and intentional omissions so implement-galaxy-workflow-test can author the final Galaxy test artifact.

Synthesized, not translated

This is the structural difference from nextflow-test-to-galaxy-test-plan and cwl-test-to-galaxy-test-plan. Those Molds translate existing upstream test evidence into a Galaxy plan. This Mold synthesizes the common brief-driven plan from reviewed acceptance criteria and the testable structure the interface/data-flow briefs and nearest IWC exemplar imply. When retained evidence contains concrete fixtures, snapshots, parameters, or expected results, cite and use them within the selected scope; their presence does not let evidence override the brief.

Set the plan’s source.derived_from to intent (not test-evidence) and each synthesized assertion’s evidence to intent; most synthesized assertions are confidence: medium or low. Where the brief or retained evidence carries a concrete expected value (a known count, a named output token, a published figure), record it as expected_value and raise the confidence.

Labels and fixtures are assumed, not bound

This Mold consumes the template-era briefs, not the concrete workflow draft or the resolved test-data refs — those exist in the harness run-state by the time the plan is authored, but they are reconciled downstream rather than here. So:

  • Bind assertions to the labels the interface brief pins, and set label_status to assumed (or unresolved when even the brief is silent) and the plan’s workflow.label_source to interface-brief. implement-galaxy-workflow-test reconciles these against the real draft labels and the workflow-label cross-check.
  • Record fixtures with storage: unresolved and location: null when the brief or evidence names test data only by description; capture what is known (a dataset name, an accession, a Zenodo DOI, a rough size) in fixture.provenance so test-data resolution and the implement Mold can act on it. Use iwc-test-data-conventions for the storage classes and the remote-URL-first convention.

When a binding or fixture cannot be settled from the briefs, add an unresolved[] entry (with blocking: true when the final test cannot be authored without it) rather than inventing a label or a URL.

Choosing assertions from intent

For each expected output the briefs expose, pick the assertion family by output type per planemo-asserts-idioms and a defensible tolerance. When the only exposed output is weakly assertable (a stochastic plot, an opaque binary), consult galaxy-workflow-testability-design: prefer recording assertion intent against a stronger promoted checkpoint, and when you settle for a weak check, record the weaker outputs in omissions[] with a rationale rather than asserting around them. Check each shortcut against iwc-shortcuts-anti-patterns so an existence-only or size-only intent is a deliberate choice.

Keep the plan addressable by stable labels and artifacts (planemo-workflow-test-architecture) so the downstream test, run, and debug Molds can connect assertions back to invocations and outputs.

Incoming References (4)

  • implement-galaxy-workflow-test related note — Assemble Galaxy workflow test fixtures and assertions.
  • WORKFLOW BRIEF → GALAXY phase of pipeline — Consume an expert-reviewed, unchanged Workflow Brief directly through the Galaxy design and implementation chain.
  • Galaxy workflow test plan related note — JSON Schema for the intermediate Galaxy workflow test-plan handoff produced by the test-plan Molds and consumed by implement-galaxy-workflow-test.
  • Galaxy workflow test format related note — JSON Schema for the planemo workflow test format (`<workflow>-tests.yml`), vendored from `@galaxy-tool-util/schema`.