Home Mold

freeform-summary-to-galaxy-test-plan

Synthesize a Galaxy workflow test plan from a free-form summary and the Galaxy design briefs.

Mold health

ok
  • Source layout

    Every file beside index.md is one the mold kind declares.

  • Axis fields

    source-specific fields are coherent.

  • Eval plan

    Abstract oracle: the properties any cast of this Mold must satisfy.

    eval.md declares properties and check type.

    eval.md ↗
  • Scenarios

    Concrete cases bound to fixtures, run against the eval properties.

    scenarios.md declares cases bound to fixtures.

    scenarios.md ↗
  • Typed refs

    7 typed references; 0 resolver issues.

  • On-demand triggers

    All on-demand references describe triggers.

  • Evidence checks

    Hypothesis references include verification.

axis
source-specific
source
freeform
name
freeform-summary-to-galaxy-test-plan
contract

Reference Loading

Typed references describe what casting consumes, and when the generated skill should load each artifact.

Schema galaxy-workflow-test-plan

Structured contract copied for validation or lookup.

Purpose
Output contract: the emitted plan conforms to [[galaxy-workflow-test-plan]]. Cast bundles the JSON Schema so the skill carries its output shape; validate with `foundry validate-galaxy-workflow-test-plan`.
Verify
Cast the skill, run on a representative paper/interview-derived summary, confirm the emitted YAML validates and downstream [[implement-galaxy-workflow-test]] consumes it without re-reading the source summary.
Schema tests-format

Structured contract copied for validation or lookup.

Purpose
Use the Galaxy workflow tests schema as the assertion-family vocabulary referenced by the plan's assertion intent.
Trigger
When naming an assertion family or compare operator for a synthesized expected output.
Research galaxy-workflow-testability-design

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Choose which workflow outputs and promoted checkpoints make meaningful assertions when no upstream test evidence exists.
Trigger
When deciding which outputs to assert, which checkpoints to promote, and which labels the plan should assume.
Research iwc-test-data-conventions

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Describe job-input fixtures, remote-URL-first locations, hashes, and collection input shapes the plan should record as fixture provenance.
Trigger
When recording job inputs or fixture provenance, or deciding whether a fixture belongs in test-data, Zenodo, ENA/SRA, or CVMFS.
Research iwc-shortcuts-anti-patterns

Background synthesis loaded by explicit progressive-disclosure metadata.

Purpose
Distinguish accepted IWC-style test shortcuts from assertion smells while synthesizing assertions from intent.
Trigger
When considering existence-only, size-only, image-dimension, or tolerant output checks, or recording an omission.

Cast artifacts

How to install →

Artifact handoffs

/ pipeline contract

Produces

Consumes

freeform-summary-to-galaxy-test-plan

Synthesize a Galaxy workflow test plan from a free-form source summary and the Galaxy interface and data-flow briefs. The output is a reviewable handoff conforming to galaxy-workflow-test-plan, not a concrete tests-format file: it records test cases, job inputs, expected outputs, assertion intent, fixture provenance, label assumptions, unresolved mappings, and intentional omissions so implement-galaxy-workflow-test can author the final Galaxy test artifact.

Synthesized, not translated

This is the structural difference from nextflow-test-to-galaxy-test-plan and cwl-test-to-galaxy-test-plan. Those Molds translate existing upstream test evidence — nf-test snapshots, CWL job files and expected outputs — into a Galaxy plan. A free-form source has no upstream test fixtures to convert, so this Mold synthesizes the plan from workflow intent and scenario-level expected outputs: the methods, sample data, parameters, and “expected results” recorded in the free-form summary, plus the testable structure the interface/data-flow briefs and the nearest IWC exemplar imply.

Set the plan’s source.derived_from to intent (not test-evidence) and each synthesized assertion’s evidence to intent; most synthesized assertions are confidence: medium or low. Where the summary does carry a concrete expected value (a known count, a named output token, a published figure), record it as expected_value and raise the confidence.

Labels and fixtures are assumed, not bound

This Mold consumes the template-era briefs, not the concrete workflow draft or the resolved test-data refs — those exist in the harness run-state by the time the plan is authored, but they are reconciled downstream rather than here. So:

  • Bind assertions to the labels the interface brief pins, and set label_status to assumed (or unresolved when even the brief is silent) and the plan’s workflow.label_source to interface-brief. implement-galaxy-workflow-test reconciles these against the real draft labels and the workflow-label cross-check.
  • Record fixtures with storage: unresolved and location: null when the free-form summary names test data only by description; capture what is known (a dataset name, an accession, a Zenodo DOI, a rough size) in fixture.provenance so test-data resolution and the implement Mold can act on it. Use iwc-test-data-conventions for the storage classes and the remote-URL-first convention.

When a binding or fixture cannot be settled from the briefs, add an unresolved[] entry (with blocking: true when the final test cannot be authored without it) rather than inventing a label or a URL.

Choosing assertions from intent

For each expected output the briefs expose, pick the assertion family by output type per planemo-asserts-idioms and a defensible tolerance. When the only exposed output is weakly assertable (a stochastic plot, an opaque binary), consult galaxy-workflow-testability-design: prefer recording assertion intent against a stronger promoted checkpoint, and when you settle for a weak check, record the weaker outputs in omissions[] with a rationale rather than asserting around them. Check each shortcut against iwc-shortcuts-anti-patterns so an existence-only or size-only intent is a deliberate choice.

Keep the plan addressable by stable labels and artifacts (planemo-workflow-test-architecture) so the downstream test, run, and debug Molds can connect assertions back to invocations and outputs.

Incoming References (5)

  • implement-galaxy-workflow-test related note — Assemble Galaxy workflow test fixtures and assertions.
  • INTERVIEW → GALAXY phase of pipeline — Interview-driven path to a Galaxy gxformat2 workflow through the shared freeform-summary handoff.
  • PAPER → GALAXY phase of pipeline — Direct path from a paper to a Galaxy gxformat2 workflow. No CWL intermediate.
  • Galaxy workflow test plan related note — JSON Schema for the intermediate Galaxy workflow test-plan handoff produced by the test-plan Molds and consumed by implement-galaxy-workflow-test.
  • Galaxy workflow test format related note — JSON Schema for the planemo workflow test format (`<workflow>-tests.yml`), vendored from `@galaxy-tool-util/schema`.