Creating content in Markdown

Overview
Creative Commons License: CC-BY Questions:
  • How to write a tutorial with hands-on?

  • What are the different boxes?

  • How can I add a caption to an image?

Objectives:
  • Create hands-on

  • Use the different boxes

Time estimation: 15 minutes
Supporting Materials:
Published: Jun 25, 2017
Last modification: Nov 13, 2024
License: Tutorial Content is licensed under Creative Commons Attribution 4.0 International License. The GTN Framework is licensed under MIT
purl PURL: https://gxy.io/GTN:T00058
version Revision: 84

Once we have set up the infrastructure, we are ready to write the tutorial.

Agenda

In this tutorial, we will cover:

  1. Metadata
    1. Listing contributors
  2. Content
    1. Self Study Tutorials
    2. Adding images with captions
    3. Writing mathematical expressions
    4. Tables and Matrices
    5. Internally linking to other training material
  3. Improving the learning experience with Boxes
    1. Overview box
    2. Agenda box
    3. Hands-on box
    4. Questions and Solutions boxes
    5. Tips box
    6. Comments boxes
    7. Details box
    8. Key points box
    9. Warning box
    10. Nested boxes
    11. Code box
    12. Quote boxes
  4. Additional Features to Improve Learning
    1. Tool Links
    2. Example Histories
    3. Workflows
    4. FAQs (snippets)
    5. Footnotes
    6. Icons
    7. Abbreviations
    8. Choose Your Own Tutorial
  5. Citations
  6. Automatic Jupyter Notebooks & RMarkdown
    1. Notebook Schema
    2. Currently Supported Languages
    3. Restrictions
    4. Enabling the system
    5. JupyterLite & Pyodide
  7. Spanish Translation Project
    1. Other Languages
  8. Conclusion
    1. Footnotes (Rendered)

The tutorial’s content should be placed in the file tutorial.md. Its syntax and structure are simple, and will have the following structure:

---
layout: tutorial_hands_on

title: Title of the tutorial
zenodo_link: ''
questions:
- Which biological questions are addressed by the tutorial?
- Which bioinformatics techniques are important to know for this type of data?
objectives:
- The learning objectives are the goals of the tutorial
- They will be informed by your audience and will communicate to them and to yourself
  what you should focus on during the course
- They are single sentences describing what a learner should be able to do once they
  have done completed tutorial
- You can use Bloom's Taxonomy to write effective learning objectives
time_estimation: ''
key_points:
- The take-home messages
- They will appear at the end of the tutorial
contributors:
- contributor1
- contributor2
---

introduction text

> <agenda​-title></agenda​-title>
>
> In this tutorial we will deal with:
>
> 1. TOC
> {:toc}

# Section 1

blabla

## Subsection 1

blabla

# Section 2

blabla

## Subsection 2

blabla

# Conclusion

blabla

Metadata

The tutorial.md needs to start with some metadata at the top:

  • layout: tutorial_hands_on: keep the default
  • title: title of the tutorial (it will appear on the tutorial page and the topic page)
  • level: Introductory, Intermediate or Advanced
  • zenodo_link: link on Zenodo to the input data for the tutorial
  • contributions: eveybody who has contributed to this tutorial (usernames must match those in CONTRIBUTORS.yaml file)
Hands-on: Fill the basic metadata
  1. Update the tutorial information in the header section of your tutorial:

     title: "Similarity search with BLAST"
    
  2. (Optional) Add the Zenodo link (if created)

This information is used to display the data from the topic and tutorial page. They are also used to check which information is missing for the tutorials.

We also define metadata related to the pedagogical content of the tutorial, which will appear at the top (“Overview” box) and bottom of the online tutorial:

A dictionary/map

(Required) layout
Free Text

This must be set to tutorial_hands_on

Possible Values:

  • tutorial_hands_on

Example(s)

layout: "tutorial_hands_on"

(Required) title
Free Text

Title of the tutorial (it will appear on the tutorial page and the topic page)

Example(s)

title: Clustering in Machine Learning
title: Breve introducción a Galaxy - en español
title: Pangeo ecosystem 101 for everyone - Introduction to Xarray Galaxy Tools

(Required) contributions
A dictionary/map

List of tutorial contributors. Here we break them down into several broad categories to help contributors identify how they contributed to a specific tutorial.

Example(s)

contributions:
    authorship:
        - shiltemann
        - bebatut
    editing:
        - hexylena
        - bebatut
        - natefoo
    testing:
        - bebatut
    infrastructure:
        - natefoo
    translation:
        - shiltemann
    funding:
        - gallantries

List of Items

These entities wrote the bulk of the training material, they may have done the analysis, built the workflow, and wrote the text themselves.

List of Items

These entities provided data for this resource

List of Items

These entities edited the text, either for spelling and grammar, flow, GTN-fit, or other similar editing categories

List of Items

These entities provided funding support for the development of this resource

List of Items

These entities managed and provided infrastructure to the GTN or for training purposes

List of Items

This person reviewed this material for accuracy and correctness

List of Items

These entities tested the tutorial to ensure it works correctly for students, or reported issues with the tutorial.

List of Items

These entities did translation and localisation work on this resource

List of Items

These entities contributed UX or Design improvements to this tutorial or the GTN as a whole

(Required) time_estimation
Free Text

An estimation of the time needed to complete the hands-on.

Example(s)

time_estimation: 10M
time_estimation: 1H30M

Required Pattern: Must match the following regular expression

/^(?:([0-9]*)[Hh])*(?:([0-9]*)[Mm])*(?:([0-9.]*)[Ss])*$/

A dictionary/map

A dictionary of abbreviations and their expansions.

Example(s)

abbreviations:
    SQL: Structured Query Language
    API: Application Programming Interface

Free Text

The expansion of the abbreviated term.

List of Items

Example(s)

answer_histories:
- - label: "UseGalaxy.eu"
    history: https://humancellatlas.usegalaxy.eu/u/j.jakiela/h/generating-a-single-cell-matrix-using-alevin-3
  - label: "Older Alevin version"
    history: https://humancellatlas.usegalaxy.eu/u/wendi.bacon.training/h/cs1pre-processing-with-alevin---answer-key
    date: 2024-01-01
  

A dictionary/map

(Required) label
Free Text

(Required) history
Free Text

Required Pattern: Must match the following regular expression

/[0-9]{4,}-[0-9]{2}-[0-9]{2}/

List of Items

List of tutorial contributors. Please use contributions instead as it provides more detailed accounting of tutorial history.

Example(s)

contributors:
- hexylena
- shiltemann

Free Text

A copyright attribution string, as required by some licenses.

Example(s)

copyright: © Copyright 2021-2023 University of Technology Sydney, The University of Manchester UK and RO-Crate contributors

Boolean

true to hide your tutorial from the topic page (optional). This is useful if you need a tutorial for a workshop, but have not finished making it up to GTN standards.

List of Items

A dictionary/map

Any additional variables you want to set on the page

List of Items

list of resources that the reader of the material could follow at the end of the tutorial

Example(s)

follow_up_training:
- type: internal
  topic_name: statistics
  tutorials:
      - age-prediction-with-ml
  
- type: external
  title: The Unix Shell
  link: "http://swcarpentry.github.io/shell-novice/"
  
- type: none
  title: "A VM with at least 2 vCPUs and 4 GB RAM, preferably running Ubuntu 18.04 - 20.04."
  

(Required) Sequence Value (List of items)
A dictionary/map

(Required) type
Free Text

the type of link

Possible Values:

  • internal
  • external
  • none

Example(s)

type: "internal"
type: "external"
type: "none"

Free Text

URL of the external resource

Free Text

Title of the external resource

Free Text

[Internal Only] The name of the topic

List of Items

[Internal Only] List of required tutorials inside that topic

Decimal Number

Currently unused.

Free Text

Link to a gitter channel that is more relevant for the tutorial than the default. E.g. a single cell tutorial could use Galaxy-Training-Network/galaxy-single-cell to link to their specific chat room.

Example(s)

gitter: Galaxy-Training-Network/galaxy-single-cell
gitter: galaxy-genome-annotation/Lobby

Free Text

This must be set to external to link to an external tutorial

Possible Values:

  • external

Example(s)

hands_on: "external"

Free Text

link to the external tutorial

Example(s)

hands_on_url: https://docs.qiime2.org/jupyterbooks/cancer-microbiome-intervention-tutorial/index.html#

List of Items

Example(s)

input_histories:
- input_histories:
    - label: "UseGalaxy.eu"
      history: https://humancellatlas.usegalaxy.eu/u/wendi.bacon.training/h/cs1pre-processing-with-alevin---input-1
      date: "2021-09-01"
  

A dictionary/map

(Required) label
Free Text

(Required) history
Free Text

Required Pattern: Must match the following regular expression

/[0-9]{4,}-[0-9]{2}-[0-9]{2}/

List of Items

List of take-home messages. This information will appear at the end of the tutorial. These should really be a key point, something that should stick in their mind; what you want them to take home from the tutorial.

Example(s)

key_points:
- Pangeo ecosystem enables big data analysis in geosciences
- The MiModD suite of tools bundles most of the functionality required to perform mapping-by-sequencing analyses with Galaxy
- It can drastically simplify management of large numbers of VMs

Free Text

The document language.

Possible Values:

  • es
  • en
  • fr

Example(s)

lang: "es"
lang: "en"
lang: "fr"

Free Text

Here give a feeling of what level the material is at.

Possible Values:

  • Introductory
  • Intermediate
  • Advanced

Example(s)

level: "Introductory"
level: "Intermediate"
level: "Advanced"

Free Text

An SPDX identifier for the alternative license that is used for that particular material. This is only relevant for materials which have been imported from an external source and were originally licensed under another license. For new materials we strongly encourage contributors to not use this key as materials are CC-BY, by default.

Example(s)

license: MIT
license: Apache-2.0

A dictionary/map

Example(s)

notebook:
    language: python
    pyolite: true

notebook:
    language: python
    snippet: topics/climate/tutorials/pangeo-notebook/preamble.md

(Required) language
Free Text

Possible Values:

  • python
  • bash
  • r
  • sql

Example(s)

language: "python"
language: "bash"
language: "r"
language: "sql"

List of Items

A list of packages that must be installed before running this tutorial. This value is not currently used, but might be in the future.

Example(s)

packages:
- tidyverse

Boolean

The GTN has support for JupyterLite and the Pyodide kernel which runs Python in the browser via webassembly/javascript. This comes with some restrictions:

  • Python only
  • No filesystem access (so no wget prep steps)
  • Little to no cell magic

However, it means we can run a lot of our Python training directly in the GTN! And in the future, hopefully, we will be able to embed individual cells of the notebook directly in the Python training, so the user doesn’t even need to switch pages.

Enabling this field will enable pyolite links for this notebook.

Free Text

If you have an alternative preamble for your notebook that students should know before following (e.g. they must load X datasets in their history), it can be listed here.

This text will be shown in the GTN tutorial, but it will not be included in the notebook, giving you a bit better control over mixing setup content which is relevant for Galaxy, with notebook content that can be easy to run for students.

Example(s)

snippet: topics/climate/tutorials/pangeo-notebook/preamble.md

List of Items

list of learning objectives for the tutorial

A learning objective is a single sentence describing what a learner will be able to do once they have done the tutorial. Generally it is best to follow a 2C or 3C learning objective such as:

  • Compute (Skill)
  • multiple whole genome assemblies (Objective)
  • in such a way to develop big data processing skills (Result)

Example(s)

objectives:
- Understand the basic concepts behind phylogenetic trees, as applied to *Mycobacterium tuberculosis*
- Explore Biodiversity data with taxonomic, temporal and geographical informations
- Generate a DotPlot emulating the original paper using a different analysis tool

Free Text

A custom image to show on the link preview in external applications (e.g. when the URL is pasted into Twitter)

Example(s)

og_image: /assets/images/gat.png

Required Pattern: Must match the following regular expression

/^\/.*/

Integer Number

This field allows ordering tutorials within the tutorial list. Tutorials with lower numbered priority come before tutorials with higher numbers.

Example(s)

List of Items

list of questions that will be addressed in the tutorial

Example(s)

questions:
- How does Genome assembly work?
- How do I change Galaxy configs?
- How to detect and quantify differentially abundant proteins in a HEK-Ecoli Benchmark DIA datatset?
- What kinds of data do programs store?

List of Items

A dictionary/map

(Required) date
Free Text

Required Pattern: Must match the following regular expression

/[0-9]{4}-[0-9]{2}-[0-9]{2}/

Free Text

Integer Number

List of Items

Boolean

Free Text

Free Text

Required Pattern: Must match the following regular expression

/[0-9]{2}\.[0-9]{1,2}/

Free Text

Required Pattern: Must match the following regular expression

/^(?:([0-9]*)[Hh])*(?:([0-9]*)[Mm])*(?:([0-9.]*)[Ss])*$/

List of Items

Free Text

Free Text

Required Pattern: Must match the following regular expression

/[A-Za-z0-9_-]{11}/

List of Items

If a tutorial is renamed to a new location, use this field to list prior locations from which this tutorial was accessible.

Example(s)

redirect_from:
- /topics/sequence-analysis/tutorials/de-novo-rad-seq/tutorial

List of Items

List of resources that the reader of the material should be familiar with before starting this training. The structure is identical to follow_up_training.

Example(s)

requirements:
- type: internal
  topic_name: statistics
  tutorials:
      - age-prediction-with-ml
  
- type: external
  title: The Unix Shell
  link: "http://swcarpentry.github.io/shell-novice/"
  
- type: none
  title: "A VM with at least 2 vCPUs and 4 GB RAM, preferably running Ubuntu 18.04 - 20.04."
  

(Required) Sequence Value (List of items)
A dictionary/map

(Required) type
Free Text

the type of link

Possible Values:

  • internal
  • external
  • none

Example(s)

type: "internal"
type: "external"
type: "none"

Free Text

URL of the external resource

Free Text

Title of the external resource

Free Text

[Internal Only] The name of the topic

List of Items

[Internal Only] List of required tutorials inside that topic

Free Text

if the topic has multiple subtopics defined, you can assign your tutorial to one of those subtopics here. Without this, the tutorial will appear in the “Other tutorials” section on the topic page.

Example(s)

subtopic: single-cell

List of Items

A free form list of tags that are relevant for your tutorial.

Example(s)

tags:
- covid-19
- git-gat

List of Items

If alternative translations of a material are available, then use this key to indicate which languages have been manually translated.

Example(s)

translations:
- en

A dictionary/map

For materials which are automatically converted into videos via the available mechanisms, this field declares which voice should be used. If this field is not declared, a random voice will be chosen from a list of the best available voices from AWS Polly.

Example(s)

voice:
    id: Lupe
    lang: es-US
    neural: true

(Required) id
Free Text

(Required) lang
Free Text

(Required) neural
Boolean

Free Text

link on Zenodo to the input data for the tutorial

Example(s)

zenodo_link: https://zenodo.org/record/3706539

Required Pattern: Must match the following regular expression

/(^$|^https://zenodo.org/records?/[0-9]+/?$|^https://doi.org/10.5281/zenodo.[0-9]+/?$)/

For this category of metadata, we have taken inspiration from what Software Carpentry has done and particularly what they described in their Instructor training.

Hands-on: Fill out the pedagogical metadata
  1. Define 2 questions that will be addressed during the tutorial and add them to the metadata
  2. Define 2 learning objectives for the tutorial and add them to the metadata
Comment: When filling the pedagogical metadata

We recommend that you fill out the questions and the learning objectives before starting writing the tutorial content. You can still refine them afterwards, but it will help to guide you in developing your tutorial, and gives you some time to think beforehand on what topics are worth being covered.

For the take-home messages, it is easier to define them once the tutorial is written and you identified the issues.

Listing contributors

All tutorials and slides must give credit to all contributors. This can be any type of contribution, adding them in GitHub, creating images for it, etc.

  1. Make sure all contributors are listed in the CONTRIBUTORS.yaml file. Each contributor is defined in this file like:

    contributor-username:                 # GitHub username (if the contributor has one)
      name: Full Name                     # mandatory
      joined: 2020-06                     # mandatory
      email: saskia.hiltemann@gmail.com   # optional
      twitter: shiltemann                 # optional
      linkedin: shiltemann                # optional
      gitter: shiltemann                  # optional
      orcid: 0000-0003-3803-468X          # optional
      bio: Researcher at EMC              # optional
    
  2. Add all contributors to the metadata of the tutorial or slide deck:

    contributors:
      - contributor-username
      - shiltemann
      - hexylena
    

    Make sure these names match the usernames you used in the CONTRIBUTORS.yaml file.

  3. Optional: Specifying types of contributions. If you want to give more detailed credit for conributions, you can do the following (instead of step 2 above)

    contributions:
      authorship:
        - shiltemann
      editing:
        - bebatut
        - hexylena
      funding:
        - carpentries
      testing:
        - userX
      ux:
        - userY
      infrastructure:
        - userZ
    

    To define a funding body in the CONTRIBUTORS.yaml there are a few extra fields available:

    gallantries:
      name: Gallantries Project
      joined: 2020-09
      avatar: "https://www.erasmusplus.nl/assets/images/logo.png"
      github: false
      funder: true
      funding_id: 2020-1-NL01-KA203-064717
      funding_statement: |
         This project ([`2020-1-NL01-KA203-064717`](https://erasmus-plus.ec.europa.eu/projects/search/details/2020-1-NL01-KA203-064717)) is funded with the support of the Erasmus+ programme of the European Union. Their funding has supported a large number of tutorials within the GTN across a wide array of topics.
         <a href="https://gallantries.github.io/assets/images/logosbeneficaireserasmusright_en.jpg" rel="noopener noreferrer"><img src="https://gallantries.github.io/assets/images/logosbeneficaireserasmusright_en.jpg"  alt="eu flag with the text: with the support of the erasmus programme of the european union. "   loading="lazy"></a>
    

    Funding bodies will be credited at the bottom of the tutorial with the appropriate funding statement, and will get a page in the hall of fame listing all tutorials that list them as a funder.

    For an example of how this all looks, see the R basics tutorial (top and bottom of the tutorial).

(Required) Contributions Schema
A dictionary/map

List of tutorial contributors. Here we break them down into several broad categories to help contributors identify how they contributed to a specific tutorial.

Example(s)

contributions:
    authorship:
        - shiltemann
        - bebatut
    editing:
        - hexylena
        - bebatut
        - natefoo
    testing:
        - bebatut
    infrastructure:
        - natefoo
    translation:
        - shiltemann
    funding:
        - gallantries

List of Items

These entities wrote the bulk of the training material, they may have done the analysis, built the workflow, and wrote the text themselves.

List of Items

These entities provided data for this resource

List of Items

These entities edited the text, either for spelling and grammar, flow, GTN-fit, or other similar editing categories

List of Items

These entities provided funding support for the development of this resource

List of Items

These entities managed and provided infrastructure to the GTN or for training purposes

List of Items

This person reviewed this material for accuracy and correctness

List of Items

These entities tested the tutorial to ensure it works correctly for students, or reported issues with the tutorial.

List of Items

These entities did translation and localisation work on this resource

List of Items

These entities contributed UX or Design improvements to this tutorial or the GTN as a whole

A dictionary/map

Example(s)

hexylena:
    name: Helena
    twitter: hexylena
    bio: I wrote this documentation! I do super cool things.

A dictionary/map

This ideally is your GitHub handle. If you do not have, or do not wish to provide a GitHub username, you may make up another identifier here, but then you must set github: false as described below.

(Required) name
Free Text

Your preferred name. If you prefer an alias or another name, this is welcome, it does not need to be your legal name.

Example(s)

name: 张三
name: Alice
name: Jane Doe
name: Madame Tout-le-Monde
name: Γιάννης Παπαδόπουλος

(Required) joined
Free Text

The year and month in which you joined

Example(s)

joined: 2020-01

Required Pattern: Must match the following regular expression

/[0-9]{4,}-[0-9]{2}/

List of Items

A set of organisations or grants your are affiliated with

Free Text

Free Text

A short biography of yourself, if you wish to add additional details or context.

Example(s)

bio: Research at the [South African National Bioinformatics Institute](https://www.sanbi.ac.za/)

Free Text

Your bluesky handle

Example(s)

bluesky: gtn.bsky.social

Required Pattern: Must match the following regular expression

/[0-9a-zA-Z.]+/

Boolean

Are you open to being contacted for hosting training, or being involved with local training events? Instructors might use this to contact you, if they are looking for regional trainers who can help with their event.

Free Text

The 2 letter code identifying the ELIXIR node to which you are a member or are associated with. If you are from norway, you will need to quote your value, "no", unlike everyone else, due to the Norway Problem with YAML

Possible Values:

  • au
  • be
  • ch
  • cz
  • de
  • dk
  • ee
  • es
  • fi
  • fr
  • gr
  • hu
  • ie
  • il
  • it
  • lu
  • nl
  • no
  • pt
  • se
  • si
  • uk

Example(s)

elixir_node: "au"
elixir_node: "be"
elixir_node: "ch"
elixir_node: "cz"
elixir_node: "de"
elixir_node: "dk"
elixir_node: "ee"
elixir_node: "es"
elixir_node: "fi"
elixir_node: "fr"
elixir_node: "gr"
elixir_node: "hu"
elixir_node: "ie"
elixir_node: "il"
elixir_node: "it"
elixir_node: "lu"
elixir_node: "nl"
elixir_node: "no"
elixir_node: "pt"
elixir_node: "se"
elixir_node: "si"
elixir_node: "uk"

Free Text

Your email address, if you wish to provide it.

Example(s)

email: jane.doe@gmail.com

Required Pattern: Must match the following regular expression

/@/

Free Text

The URL to your fediverse profile

Example(s)

fediverse: http://genomic.social/@abretaud

Required Pattern: Must match the following regular expression

/^https:\/\/[0-9a-zA-Z.]+/@?[0-9a-zA-Z.]+$/

Free Text

The flavor of the fediverse server (used in our webfinger endpoint.)

Possible Values:

  • mastodon
  • akkoma

Example(s)

fediverse_flavor: "mastodon"
fediverse_flavor: "akkoma"

List of Items

A set of organisations you were previously affiliated with

Boolean

If your identifier in this file is not a GitHub account (or not your account), then this must be set to true, so we do not link to that account.

Free Text

Set this to no if you would like to be excluded from the hall of fame.

Possible Values:

  • no

Example(s)

halloffame: "no"

Free Text

If this community member is deceased, you can use this field to write a small in memoriam section that will display in their Hall of Fame profile.

Free Text

Required Pattern: Must match the following regular expression

/[0-9a-zA-Z]+/

A dictionary/map

Free Text

The country you work in, ISO-3166-2 code.

Example(s)

country: NL
country: DE

Decimal Number

Latitude in decimal numbers

Example(s)

lat: 4.12

Decimal Number

Longitude in decimal numbers

Example(s)

lon: 55.0

Free Text

Preferred contact method

Free Text

Your matrix identifier and home server

Example(s)

matrix: hexylena:matrix.org

Required Pattern: Must match the following regular expression

/[0-9a-zA-Z]+:.*/

Free Text

Your identifier at orcid.org

Example(s)

orcid: 0000-0001-9760-8992

Required Pattern: Must match the following regular expression

/[0-9A-Z]{4}-[0-9A-Z]{4}-[0-9A-Z]{4}-[0-9A-Z]{4}/

Free Text

Your twitter handle, without the @

Example(s)

twitter: gxytraining

Required Pattern: Must match the following regular expression

/[0-9a-zA-Z]+/

Content

The tutorial’s content is written directly after the section of metadata. This is written in Markdown, a simple markup language.

Comment: Markdown

Check this cheatsheet to learn more how to use Markdown.

The Markdown content is then transformed into a user friendly webpage through a templating system. With this approach, there is no need to add the name of every tutorial each time, since they are automatically added based on the tutorial’s metadata.

To help developing the tutorial, we recommend to create a workflow of the different steps of the tutorial inside Galaxy first, and then you can create the structure of the tutorial automatically from that:

Hands-on: Create the structure of the tutorial from a workflow
  1. Create a small workflow with one or two steps on a running Galaxy instance
  2. Add the topic name as Tag and the tutorial title as Annotation/Notes to the workflow using the workflow editor.
  3. Get the workflow id
    1. Go the “Share” page of the workflow
    2. Copy the information after id= in the URL of the page
  4. Get your API key for this Galaxy instance
    1. Click on User –> Preferences
    2. Click on Manage API key
    3. Click on Create a new key (if none is available)
    4. Copy the API key
  5. Generate the skeleton of the tutorial locally

    $ planemo training_generate_from_wf \
             --topic_name "my-topic" \
             --tutorial_name "my-new-tutorial" \
             --galaxy_url "URL to Galaxy instance in which you created the workflow" \
             --galaxy_api_key "Your API key on the Galaxy instance" \
             --workflow_id "ID of the workflow on the Galaxy instance" \
             --zenodo_link "URL to the Zenodo record (Optional)"
    
    Comment: Using a local workflow

    It is also possible to download the workflow locally (with the .ga extension), and then run a slightly different command:

    $ planemo training_generate_from_wf \
             --topic_name "my-topic" \
             --tutorial_name "my-new-tutorial" \
             -- workflow PATH/to/the/file.ga \
             --zenodo_link "URL to the Zenodo record (Optional)"
    
  6. Inspect the generated tutorial.md

The generated tutorial is structured with:

  • An introduction, to give an overview of the tutorial with its use cases, data, and methods
  • Multiple sections representing the steps of the analysis, complete with automatically generated hands-on blocks, as practicing is a vital part of the learning process
  • A conclusion to summarize what has been done in the tutorial (with a graphic)
Hands-on: Filling out the structure of the tutorial
  1. Fill out the “Introduction” with a general introduction of the tutorial and a small description of the dataset (goals)
  2. Rename/restructure the sections with several levels and more explication
  3. Add some theory about the tool used to introduce each section
  4. Add a small conclusion and relate the results to the original question

Self Study Tutorials

By following all of the guidelines in this file you can be sure that your tutorial will be optimised for self-study. The GTN framework encourages the use of snippets, and PTDK ensures tutorials have fully detailed parameters learners should configure. If you make use of snippets in appropriate places, learners can easily follow a tutorial despite different skill levels with Galaxy.

Additionally use of Question and Solution boxes can ensure that students can self-check their understanding and progress as they progress through the tutorial. Generally we recommend one or more questions (and associated correct solutions!) after every hands-on box (which might have a one or more steps to follow.) These questions will let students be sure their work is correct before they proceed too far. As such you should design your questions carefully in order to catch common and likely failure modes that learners may encounter. If a student might forget to select a less-common or deeply-nested parameter, be sure that your question following that hands on tests that properly, and if possible explain that in the solutions.

Adding images with captions

To add an image in Markdown file, we need to use the markdown syntax for this: !​[proper alt text describing the image for visually impaired learners](../../images/image.png).

We have also added a small plugin to handle captions for each image:

A textual description of the image. Open image in new tab

Figure 1: Example of an image with a caption

The prefix “Figure 1.” is automatically added before its caption. This is done with the following Markdown syntax:

!​[A textual description of the image](../images/image.png "Example of an image with a caption")

We can also cross-reference images inside our Markdown with an anchor. For example, we can link to the previous figure using [the display text]​(#figure-nb) (changing nb with the image’s number).

Guidelines on Alt vs Figcaption Text

While both the alt attribute and the figcaption element provide a way to describe images, the way we write for them is different. alt descriptions should be functional; figcaption descriptions should be editorial or illustrative.

As an example for this image:

alt text. Open image in new tab

Figure 2: Example of an image with a caption
!​[Alt text (shown when image cannot be displayed)](path/to/image.png "Example of an image with a caption")
Field Appropriate Contents
alt text Image of cell membrance with an embedded protein with central pore. DNA is shown splitting and entering the pore, an electrical signal comes out reading A C T or G.
figure caption Using nanopore sequencing, a single molecule of DNA or RNA can be sequenced without the need for PCR amplification or chemical labeling of the sample. (Image from: Nanopore sequencing: The advantages of long reads for genome assembly)

Writing mathematical expressions

Mathematical expressions can be written in LaTeX, and are automatically rendered with MathJax.

Surround your math expression with two $ signs on each side (like in LaTeX math blocks):

  • inline expressions, e.g. $$ 5 + 5 $$ will be rendered as \(5 + 5\)
  • block expressions, e.g. $$ 5 + 5 $$ will be rendered in its own line block as

    \[5 + 5\]
  • Note: if inline mode is not working correctly, you can force it by using the following delimiters instead of dollar signs: \\( 5 +5 \\)

Dollar signs are therefore reserved characters for instructing the templating system to open/close LaTeX math blocks. If you want to use a $ within your expression, you will need to escape it: $$ a + 3\$ = 5\$ $$ will be rendered as: \(a + 3\$ = 5\$\)

LaTeX code that uses the pipe symbol | in inline math statements may lead to a line being recognized as a table line by the templating system. This can be avoided by using the \vert command instead of |

Tables and Matrices

Tables can be generated using markdown by using the | symbol to indicate column dividers, and -- for table headers:

|       | Obs1 | Obs2 | Obs3 |
|------ |--------------------|
| Feat1 | 0    | 1    | 2    |
| Feat2 | 1    | 2    | 3    |
| Feat3 | 2    | 3    | 4    |

When rendered, they will take the full width of the page:

  Obs1 Obs2 Obs3
Feat1 0 1 2
Feat2 1 2 3
Feat3 2 3 4

This does not appear to be visually appealing when representing matrices, which is why a matrix box can be used instead:

> |       | Obs1 | Obs2 | Obs3 |
> | ----- |--------------------|
> | Feat1 | 0    | 1    | 2    |
> | Feat2 | 1    | 2    | 3    |
> | Feat3 | 2    | 3    | 4    |
{: .matrix}

The rendered table is then given as a minimum-width and centred matrix:

  Obs1 Obs2 Obs3
Feat1 0 1 2
Feat2 1 2 3
Feat3 2 3 4

Internally linking to other training material

If you want to link to other training material within your text, please use the {​% link path/to/file.ext %​} tag:

[link text]( {% link topics/single-cell/tutorials/scrna-case_monocle3-trajectories/tutorial.md %} )

(Note the .md extension, and not .html, always provide the file name here, it will automatically be converted to the correct link)

If you want to link to a specific section in a tutorial using an anchor (e.g. #getting-started), place it outside of the {​% link %​} tag:

[link text]({% link topics/single-cell/tutorials/scrna-case_monocle3-trajectories/tutorial.md %}#section-name)

Improving the learning experience with Boxes

To improve the learning experience in our tutorial, we define some boxes to highlight content.

These boxes are defined always with the same structure:

> <type​-title>Name of the box</type​-title>
> text goes here!
{: .type}

where type is something like tip, so <tip-title> and {: .tip}. You must follow this structure exactly for it to be rendered correctly.

Overview box

This box at the top of each tutorial is automatically generated using the metadata we defined in the topic’s metadata file:

: Overview

question Questions

  • Which biological questions are addressed by the tutorial?
  • Which bioinformatics techniques are important to know for this type of data?

objectives Objectives

  • The learning objectives are the goals of the tutorial
  • They will be informed by your audience and will communicate to them and to yourself what you should focus on during the course
  • They are single sentences describing what a learner should be able to do once they have completed the tutorial
  • You can use Bloom’s Taxonomy to write effective learning objectives

requirements Requirements

time Time estimation: ‘1H’

Hands-on: Checking the metadata
  1. Check that the metadata added previously are correctly filling the overview box

    Question

    What metadata hasn’t been added to this box?

    The take-home messages are not added to this box but into the last box of the tutorial

Agenda box

In most tutorials, the second box is the agenda box, placed at the end of the introduction. It shows the table of contents for the tutorial

> <agenda​-title></agenda​-title>
>
> In this tutorial we will deal with:
>
> 1. TOC
> {:toc}
>
{: .agenda}

There is no need to fill out the list; this will be done automatically based off of your tutorial’s section titles. First and second level headings (lines starting with # and ## in markdown) will be shown in the agenda.

If a section is not important enough to be shown in the agenda, consider making it a third-level heading (###) instead.

The agenda will be rendered as follows:

Agenda

In this tutorial we will deal with:

  1. TOC

Hands-on box

We find that having users walk through the tutorial, doing all of the steps is important for learning the concepts taught. We therefore emphasize this by regularly adding hands-on sections, where trainees are encouraged to do the analysis by themselves. We have designed some special boxes to make these sections easier to find.

> <hands​-on-title>Spliced mapping</hands​-on-title>
>
> 1. **RNA STAR** {% icon tool %}: Map your reads on the reference genome with
>    - *"Single-end or paired-end reads"*:  `Paired-end (as individual datasets)`
>    - *"RNA-Seq FASTQ/FASTA file, forward reads"*: the generated `trimmed reads pair 1` files (multiple datasets)
>    - *"RNA-Seq FASTQ/FASTA file, reverse reads"*: the generated `trimmed reads pair 2` files (multiple datasets)
>    - *"Custom or built-in reference genome"*: `Use a built-in index`
>    - *"Reference genome with or without an annotation"*: `use genome reference without builtin gene-model`
>    - *"Select reference genome"*: `Drosophila Melanogaster (dm6)`
>    - *"Gene model (gff3,gtf) file for splice junctions"*: the imported `Drosophila_melanogaster.BDGP6.87.gtf`
>    - *"Length of the genomic sequence around annotated junctions"*: `36`
>
>        This parameter should be length of reads - 1
>
> 2. {% tool [MultiQC](toolshed.g2.bx.psu.edu/repos/iuc/multiqc/multiqc/1.8+galaxy0) %}: Aggregate the STAR logs with
>      - *"Which tool was used generate logs?"*: `STAR`
>      - *"Type of FastQC output?"*: `Log`
>      - *"STAR log output"*: the generated `log` files (multiple datasets)
{: .hands​_on}

For consistency please use:

  • {% icon hands_on %} icon to define that is an hands-on
  • Short imperative sentences to make it easy to identify the tasks
  • Name of the tool in bold followed by {% icon tool %} icon to make it easy to identify a Galaxy tool
  • Parameters for the tool as a sublist

This will be rendered like:

Hands-on: Spliced mapping
  1. RNA STAR tool: Map your reads on the reference genome with
    • “Single-end or paired-end reads”: Paired-end (as individual datasets)
    • “RNA-Seq FASTQ/FASTA file, forward reads”: the generated trimmed reads pair 1 files (multiple datasets)
    • “RNA-Seq FASTQ/FASTA file, reverse reads”: the generated trimmed reads pair 2 files (multiple datasets)
    • “Custom or built-in reference genome”: Use a built-in index
    • “Reference genome with or without an annotation”: use genome reference without builtin gene-model
    • “Select reference genome”: Drosophila Melanogaster (dm6)
    • “Gene model (gff3,gtf) file for splice junctions”: the imported Drosophila_melanogaster.BDGP6.87.gtf
    • “Length of the genomic sequence around annotated junctions”: 36

      This parameter should be length of reads - 1

  2. MultiQC ( Galaxy version 1.8+galaxy0): Aggregate the STAR logs with
    • “Which tool was used generate logs?”: STAR
    • “Type of FastQC output?”: Log
    • “STAR log output”: the generated log files (multiple datasets)

There are also some predefined parameter icons available which can be used to indicate the type of parameter. These are optional, but may be helpful in some cases (for example to distinguish between single file inputs and collection inputs).

The available icons are:

> <hands​-on-title>My Step</hands​-on-title>
>
> 1. **My Tool** {% icon tool %} with the following parameters
>    - {% icon param-text %} *"My text parameter"*: `my value`
>    - {% icon param-file %} *"My input file"*: `my file`
>    - {% icon param-files %} *"My multiple file input or collection"*: `my collection`
>    - {% icon param-select %} *"My select menu"*: `my choice`
>    - {% icon param-check %} *"My check box"*: `yes`
>    - {% icon param-toggle %} *"My toggle button"*: `Yes`
>    - {% icon param-repeat %} **My repeat parameter**
>      - *"param1"*: `42`
{: .hands​_on}

which, when rendered, look like:

Hands-on: My Step
  1. My Tool tool with the following parameters
    • param-text “My text parameter”: my value
    • param-file “My input file”: my file
    • param-files “My multiple file input or collection”: my collection
    • param-select “My select menu”: my choice
    • param-check “My check box”: yes
    • param-toggle “My toggle button”: Yes
    • param-repeat My repeat parameter
      • “param1”: 42

Questions and Solutions boxes

Questions can be added to force trainees to think about what they are currently doing, and to put things in perspective. They can also help the instructors by exposing and clarifying common scenarios, errors, or applications.

> <question​-title></question​-title>
>
> 1. Why are some tests filtered?
> 2. Does it improve the *p*-value distribution?
>
> > <solution​-title></solution​-title>
> >
> > 1. Sol for the first question
> > 2. Sol for the second question
> >
> {: .solution}
{: .question}

Which will be rendered as:

Question
  1. Why are some tests filtered?
  2. Does it improve the p-value distribution?
  1. Sol for the first question
  2. Sol for the second question

Questions should be quick to answer. You can directly ask a question and expect an answer, or you can provide some answers and create multiple choices questions (MCQs). With well chosen wrong answers, MCQs can do much more than just measure how much someone knows, such as exposing common misconceptions and mistakes.

In the box below, initially hidden, we add the correct answer and possibly any additional explanation. Self-trainees can then check the solution and its explanation.

In the context of remote trainings, where a teacher isn’t synchronously available, ensuring that you have questions throughout your materials for students to check their understanding is incredibly key.

Additionally ensuring that solutions are provided, and are correct and up-to-date (or use a snippet explaining data variability along with with ways to check the results) is mandatory. Students will then use these questions to self-check their understanding against what you expected them to learn.

Tips box

Tips boxes are really just for ‘tips’, usually hints regarding Galaxy operations that users may or may not be familiar with. If you want to provide extended discussion or links to external materials then consider the comment and detail boxes instead.

> <tip​-title>Importing data via links</tip​-title>
>
> * Copy the link location
> * Open the Galaxy Upload Manager
> * Select **Paste/Fetch Data**
> * Paste the link into the text field
> * Press **Start**
{: .tip​}

Rendered:

  • Copy the link location
  • Open the Galaxy Upload Manager
  • Select Paste/Fetch Data
  • Paste the link into the text field
  • Press Start

Comments boxes

> <comment​-title></comment​-title>
> - Edit the "Database/Build" to select "dm3"
> - Rename the datasets according to the samples
{: .comment}

Rendered:

Comment
  • Edit the “Database/Build” to select “dm3”
  • Rename the datasets according to the samples

Details box

The detail box is used to give more background explanation on the subject. By default the box is collapsed, trainees can expand it if they wish to know extra information about a topic.

> <details​-title>More details on the ....</details​-title>
>
> Add more details in Markdown...
>
{: .details​}

Rendered:

Add more details in Markdown…

Key points box

This last box of the tutorial is automatically created with the take-home messages defined in the topic’s metadata

To render the boxes correctly, the syntax needs to be correct. If it doesn’t work, have a look at similar tutorials and get inspiration.

Warning box

> <warning​-title>Danger: You can lose data!</warning​-title>
> Something really bad can happen here!
{: .warning}

Rendered:

Warning: Danger: You can lose data!

Something really bad can happen here!

Nested boxes

Boxes can be nested, e.g. for having tips inside a hands-on:

> <hands​-on-title>Defining the topic for the tutorial</hands​-on-title>
>
> 1. Search for NCBI Blast+ on the [ToolShed](https://toolshed.g2.bx.psu.edu/)
> 2. Check in which category it is
>
>    > <question​-title></question​-title>
>    >
>    > In which topic will you put the tutorial?
>    >
>    > > <solution​-title></solution​-title>
>    > >
>    > > If we search for [NCBI Blast+ in the ToolShed](https://toolshed.g2.bx.psu.edu/view/devteam/ncbi_blast_plus/7538e2bfcd41), it is attributed to 2 categories (bottom): "Next Gen Mappers" and "Sequence Analysis".
>    > > We decided to put it in "Sequence analysis" because this is the most general one for this tutorial.
>    > {: .solution​}
>    {: .question​}
{: .hands​_on}

Code box

We have added code in/out boxes to help you show commands, and their effects, when running command line commands.

Normally a single column, with the boxes above one another, it will automatically split side-by-side over a given width (1200px);

> > <code​-in-title>Bash</code​-in-title>
> > ```bash
> > cat /tmp/test.ini
> > ```
> {: .code-in}
>
> > <code​-out-title></code​-out-title>
> > The file should look like:
> >
> > ```ini
> > [example]
> > server_name = Dogs!
> > listen = 192.168.0.2
> > apikey = super-secret-api-key-wow!
> > ```
> {: .code-out}
{: .code-2col}

Rendered (try it! resize your browser)

Input: Bash
cat /tmp/test.ini
Output

The file should look like:

[example]
server_name = Dogs!
listen = 192.168.0.2
apikey = super-secret-api-key-wow!

If you leave off the {: .code-2col}, it will render as a single column always.

> <code​-in-title>Bash</code​-in-title>
> ```bash
> cat /tmp/test.ini
> ```
{: .code-in}

> <code​-out-title></code​-out-title>
> The file should look like:
>
> ```ini
> [example]
> server_name = Dogs!
> listen = 192.168.0.2
> apikey = super-secret-api-key-wow!
> ```
{: .code-out}

Rendered:

Input: Bash
cat /tmp/test.ini
Output

The file should look like:

[example]
server_name = Dogs!
listen = 192.168.0.2
apikey = super-secret-api-key-wow!

Quote boxes

> If you don't know where you're going, you might not get there.
{: .quote cite="https://en.m.wikiquote.org/wiki/Yogi_Berra" author="Yogi Berra"}

Rendered:

If you don’t know where you’re going, you might not get there.

The citation and author parameters are both optional. If provided the cite key must be a URL.

If you don’t know where you’re going, you might not get there.

If you don’t know where you’re going, you might not get there.

Additional Features to Improve Learning

Here we cover additional features you can use throughout your tutorials to improve the learning experience.

With the new GTN in Galaxy Webhook, trainees can view training directly within Galaxy. As part of this, we enable those trainees to click on tools, and have those tools directly activated in Galaxy, enabling for a seamless training experience for trainees.

GIF of a user using the GTN in Galaxy webhook.Open image in new tab

Figure 3: A gif showing how the GTN in Galaxy webhook works. A student clicks the learning hat icon in the masthead of a Galaxy server, and an overlay is activated showing the GTN website. Within the GTN they can browse around and their place in tutorials is saved. While following a tutorial the student reches a step which instructs them to run a specific tool. Instead of the normal experience searching for a tool (quite difficult on large servers), they click a blue button and the tool is activated in Galaxy, and the overlay is closed. The student can reactivate the overlay at any time and return to their place in the tutorial.

To enable these in your tutorial you can use the following syntax:

- {% tool MultiQC %}
- {% tool [MultiQC](toolshed.g2.bx.psu.edu/repos/iuc/multiqc/multiqc/1.8+galaxy0) %}
- {% tool [Import some data](upload1) %}

Which will be rendered as:

  • MultiQC
  • MultiQC ( Galaxy version 1.8+galaxy0)
  • Import some data

When viewed through Galaxy, students will see:

Import some data Tool: upload1

How to find these IDs?

The easiest way is to use planemo to generate the training from a workflow. In recent versions of planemo, this is managed automatically.

The alternative is to figure out the ID for the tool you want to use:

  1. Find your tool in Galaxy, and click to access the tool form.
  2. Click on Options at the top right
  3. Click on Share
  4. The URL shown will be something like https://usegalaxy.eu/root?tool_id=toolshed.g2.bx.psu.edu/repos/galaxyp/mz_to_sqlite/mz_to_sqlite/2.0.4+galaxy1
  5. Keep only the part after the =, so toolshed.g2.bx.psu.edu/repos/galaxyp/mz_to_sqlite/mz_to_sqlite/2.0.4+galaxy1 in this example

Finding the tool ID.

Example Histories

If you have example input histories for your tutorial, perhaps for specific servers where trainees will often follow a tutorial but want to skip a slow input step, then you can provide example histories as part of your tutorial.

Input: Tutorial Frontmatter
answer_histories:
  - label: "UseGalaxy.eu"
    history: https://humancellatlas.usegalaxy.eu/u/j.jakiela/h/generating-a-single-cell-matrix-using-alevin-3
  - label: "Older Alevin version"
    history: https://humancellatlas.usegalaxy.eu/u/wendi.bacon.training/h/cs1pre-processing-with-alevin---answer-key
    date: 2024-01-01
input_histories:
  - label: "UseGalaxy.eu"
    history: https://humancellatlas.usegalaxy.eu/u/wendi.bacon.training/h/cs1pre-processing-with-alevin---input-1
Output: Rendered Tutorial

a screenshot of the GTN metadata box showing a dropdown for input histories and answer histories. The answer histories features two examples one on UseGalaxy.eu and an older alevin one, each with a date. In the dropdown is also a link to an FAQ titled how to use this.

Workflows

In some tutorials you aren’t as interested in teaching users the individual steps for analysing data, but rather want to focus on some downstream aspects of analysis, or to showcase the best practice workflows that are already available for a user to use! In those cases it can be useful to have a nicer way of inviting the user to execute those steps.

If you are accessing these in tutorial mode, they should function as button that, when clicked, launch the workflow directly. Outside of tutorial mode, they will link to our redirection service which will let you supply which Galaxy you plan to use.

Note that if for some reason the ‘fancy’ method doesn’t work, there are fallback tip boxes to help a user execute a similar procedure manually.

GTN Workflows

If you’ve included the workflow in the GTN but haven’t uploaded to a repository yet:

{% snippet faqs/galaxy/workflows_run_trs.md path="topics/assembly/tutorials/largegenome/workflows/Galaxy-Workflow-Data_QC.ga" title="Galaxy Workflow Data QC" %}

Rendered:

Hands-on: Importing and launching a GTN workflow
Launch Galaxy Workflow Data QC (View on GitHub, Download workflow) workflow.
  • Click on Workflow on the top menu bar of Galaxy. You will see a list of all your workflows.
  • Click on galaxy-upload Import at the top-right of the screen
  • Paste the following URL into the box labelled “Archived Workflow URL”: https://training.galaxyproject.org/training-material/topics/assembly/tutorials/largegenome/workflows/Galaxy-Workflow-Data_QC.ga
  • Click the Import workflow button

Below is a short video demonstrating how to import a workflow from GitHub using this procedure:

Video: Importing a workflow from URL

WorkflowHub

You can use a dedicated snippet to invite users to run a WorkflowHub workflow:

{% snippet faqs/galaxy/workflows_run_wfh.md title="mRNA-Seq BY-COVID Pipeline" wfhub_id="685" version="1" %}

Rendered:

Hands-on: Importing and Launching a WorkflowHub.eu Workflow
Launch mRNA-Seq BY-COVID Pipeline (v1) (View on WorkflowHub)

WorkflowHub is a workflow management system which allows workflows to be FAIR (Findable, Accessible, Interoperable, and Reusable), citable, have managed metadata profiles, and be openly available for review and analytics.

  1. Ensure that you are logged in to your Galaxy account.
  2. Click on the Workflow menu, located in the top bar.
  3. Click on the Import button, located in the right corner.
  4. In the section “Import a Workflow from Configured GA4GH Tool Registry Servers (e.g. Dockstore)”, click on Search form.
  5. In the TRS Server: workflowhub.eu menu you should type name:"mRNA-Seq BY-COVID Pipeline" galaxy TRS workflow search field, name:vgp is entered in the search bar, and five different workflows all labelled VGP are listed
  6. Click on the desired workflow, and finally select the latest available version.

After that, the imported workflows will appear in the main workflow menu. In order to run the workflow, just need to click in the workflow-run Run workflow icon.

Below is a short video showing this uncomplicated procedure:

Video: Importing from WorkflowHub

Note that it links to a specific workflow, on any Galaxy server. When this tutorial is opened from within the Tutorial Mode, that link will change to one on the current server, removing the intermediate step.

Dockstore

Please note that the dockstore ID should be provided without the #workflow/ prefix, so starting from github.com.

{% snippet faqs/galaxy/workflows_run_ds.md title="K-mer Profiling HiFi" dockstore_id="github.com/iwc-workflows/kmer-profiling-hifi-VGP1/main" version="v0.1.5" %}

Rendered:

Hands-on: Importing and Launching a Dockstore Workflow

Dockstore is a free and open source platform for sharing reusable and scalable analytical tools and workflows.

  1. Ensure that you are logged in to your Galaxy account.
  2. Go to DockStore
  3. Click on “Galaxy” dropdown within the “Launch with” panel located in the upper right corner.
  4. Select a galaxy instance you want to launch this workflow with.
  5. You will be redirected to Galaxy and presented with a list of workflow versions.
  6. Click the version you want (usually the latest labelled as “main”)
  7. You are done!

The following short video walks you through this uncomplicated procedure:

Video: Importing from Dockstore

This snippet has the same behaviour, it will use my.galaxy.training links to make them server independent, but in Tutorial Mode it will open on the current server.

FAQs (snippets)

Many common questions or instructions may be useful to share between different tutorials. For example instructions on how to start a new history or importing data. To make these types of snippets easier to re-use and avoid duplication, they are available in the form of snippets.

The use of snippets is extremely important for asynchronous, remote learning. In this situation as students do not have a teacher immediately on hand, and likely do not have friends or colleagues sitting working with them, they will rely on these boxes to refresh their knowledge and know what to do.

Please ensure you test your learning materials with a learner or colleague not familiar the material, and if possible, (silently) watch them go through your lesson. You’ll easily identify which portions need more explanations and details.

Finding snippets

These are available in folders named faqs, either at the project level, topic level, or tutorial level.

  • Project-level FAQs: faqs/
    • faqs/galaxy/ for general Galaxy questions
    • faqs/gtn/ for questions regarding the GTN website itself
  • Topic-level FAQs: topics/<topic>/faqs/
    • for questions pertaining to that specific topic
  • Tutorial-level FAQs: topics/<topic>/tutorials/<tutorial>/faqs/
    • for questions pertaining to that specific tutorial
    • if this is present, it is linked to from the tutorial overview box at the top, and from the end of the tutorial

Including FAQs/snippets in your tutorials

To include one of these snippets in your tutorial, you can use the following syntax:

{% snippet faqs/galaxy/histories_create_new.md %}

Which will be rendered as:

To create a new history simply click the new-history icon at the top of the history panel:

UI for creating new history

The advantage of this approach is that when the Galaxy interface updates, we only have to update the snippet, rather than every tutorial. Please try to use snippets whenever you can!

You could also specify the box type you want the snippet to be rendered in:

{% snippet faqs/galaxy/histories_create_new.md box_type="hands_on" %}
Hands-on: Creating a new history

To create a new history simply click the new-history icon at the top of the history panel:

UI for creating new history

or without a box altogether:

{% snippet faqs/galaxy/histories_create_new.md box_type="none" %}

To create a new history simply click the new-history icon at the top of the history panel:

UI for creating new history

Creating new FAQs/snippets

Do you want to include something in your tutorial that you think might be useful in other tutorials as well? Or are you answering a frequently asked question? Consider creating a snippet for it

Each snippet (question) is a separate file, with some metadata, residing in one of the faqs folders:

---
title: How do I run a workflow?
area: workflows      # FAQs will be grouped by these areas on the FAQ page
box_type: tip        # tip/comment/hands_on/question; optional, if you want the content to be in a box
layout: faq          # if you set this the snippet will get its own page and be included in the FAQs page
contributors: [annefou,nomadscientist] # anybody who has contributed to the FAQ over time
---

Here you can write the snippet / answer to the FAQ in Markdown

- Go to `Workflows` on the top menu bar
- Click on ..
- ..

A dictionary/map

(Required) layout
Free Text

This must be set to faq

Possible Values:

  • faq

Example(s)

layout: "faq"

(Required) title
Free Text

Title of the FAQ

Example(s)

title: How does the GTN implement the 'Ten simple rules for collaborative lesson development'
title: How can I give feedback?
title: Ways to use Galaxy

(Required) box_type
Free Text

The type of box that should be used when rendering this FAQ. Use none if it should not be in a box, but just plain text.

Possible Values:

  • tip
  • hands_on
  • question
  • comment
  • warning
  • details
  • none

Example(s)

box_type: "tip"
box_type: "hands_on"
box_type: "question"
box_type: "comment"
box_type: "warning"
box_type: "details"
box_type: "none"

(Required) contributors
List of Items

Who contributed to this FAQ

Example(s)

contributors:
- shiltemann
- hexylena

Free Text

A text key used for sorting related FAQs together in the visual interface for users.

Example(s)

area: contributors
area: learners
area: features

Free Text

A short, one line description to provide additional context of the FAQ

Example(s)

description: Galaxy may have several reference genomes built-in, but you can also create your own.
description: Quickly learn what the identifiers are in any **BAM** dataset that is the result from mapping
description: Finding and Correcting Metadata

A dictionary/map

A list of _examples that can be used to illustrate the FAQ’s invocation

Example(s)

A very basic included version: {}
A more complex example: {name: "Phages", format: "genbank"}

A dictionary/map

Free Text

Integer Number

An internal ID tracking which form response generated this in the GTN Google Forms. Please do not add this manually.

A dictionary/map

Optional parameters that can enhance the experience of the learner if set correctly

Example(s)

format: the format they should change it to

Free Text

List of Items

If a tutorial is renamed to a new location, use this field to list prior locations from which this tutorial was accessible.

Example(s)

redirect_from:
- /topics/sequence-analysis/tutorials/de-novo-rad-seq/tutorial

A dictionary/map

A list of parameters that are required to be set when invoking the FAQ, otherwise the FAQ will not render correctly (e.g. in the FAQ list!)

Example(s)

name: The name of the dataset

Free Text

When you are running a remote, asynchronous lesson, you’ll want to be sure you collect all student questions and add them back to your tutorial afterwards, as FAQs. This will help other learners as they progress through the materials, and can give you a very easy URL to point your learners to if they get stuck on a particular task.

FAQ pages

All FAQs will also be collected on their own page, this makes it easy for and teachers to prepare the session, and for participants to quickly find the answers to common questions.

To do this, create a file named index.md inside the faq folder:

---
layout: faq-page
---

If you would like to enforce an order of the faq areas, you can do so:

---
layout: faq-page
area_order: [introduction, learners, instructors, contributors, other]
---

(just make sure you list all existing areas in the folder)

If a tutorial-level FAQ page exists (topics/<topic>/tutorials/<tutorial>/faqs/index.md) it will be automatically linked to from the overview box at the top of the tutorial, and at the end of the tutorial. Have a look at this tutorial to see it in action.

Footnotes

Input: Markdown
Footnotes[^test] can be used to insert more content or explanation as reference material to your content. You can use the same footnote reference multiple time, and the footnote will include backlinks to return to the correct place in the text.[^test]
Output

Footnotes1 can be used to insert more content or explanation as reference material to your content. You can use the same footnote reference multiple time, and the footnote will include backlinks to return to the correct place in the text.1

Icons

To use these icons, take the name of the icon, ‘details’ in this example, and write something like this in your tutorial:

{% icon details %}

Some icons have multiple aliases, any may be used, but we’d suggest trying to choose the most semantically appropriate one in case Galaxy later decides to change the icon.

icon[0][0]
announcement
icon[0][0]
arrow-keys
icon[0][0]
code-in
icon[0][0]
code-out
icon[0][0]
cofest, hall-of-fame, pref-permissions
icon[0][0]
comment
icon[0][0]
congratulations
icon[0][0]
copy, param-files, zenodo_link
icon[0][0]
curriculum, level
icon[0][0]
details, galaxy-info, dataset-info
icon[0][0]
docker_image
icon[0][0]
download, galaxy-download
icon[0][0]
download-cloud
icon[0][0]
dropdown, galaxy-dropdown
icon[0][0]
email
icon[0][0]
exchange, switch-histories
icon[0][0]
external-link, galaxy_instance
icon[0][0]
event, event-date, last_modification
icon[0][0]
event-location
icon[0][0]
event-cost
icon[0][0]
feedback
icon[0][0]
galaxy-advanced-search
icon[0][0]
galaxy-show-active
icon[0][0]
galaxy-barchart, galaxy-visualise, galaxy-visualize
icon[0][0]
galaxy-vis-config, galaxy-viz-config
icon[0][0]
galaxy-bug
icon[0][0]
galaxy-chart-select-data, galaxy-history-size
icon[0][0]
galaxy-clear
icon[0][0]
galaxy-columns, galaxy-multihistory, galaxy-history
icon[0][0]
galaxy-cross
icon[0][0]
galaxy-dataset-map, galaxy-workflows-activity, dataset-related-datasets
icon[0][0]
galaxy-delete
icon[0][0]
galaxy-history-options
icon[0][0]
galaxy-eye, solution
icon[0][0]
galaxy-gear, galaxy-wf-options
icon[0][0]
galaxy-histories-activity
icon[0][0]
galaxy-dataset-collapse
icon[0][0]
galaxy-history-archive
icon[0][0]
galaxy-history-storage-choice
icon[0][0]
galaxy-history-refresh
icon[0][0]
galaxy-history-input
icon[0][0]
galaxy-history-answer
icon[0][0]
galaxy-home
icon[0][0]
galaxy-lab, subdomain
icon[0][0]
galaxy-library, param-collection, topic
icon[0][0]
galaxy-link, dataset-link
icon[0][0]
galaxy-panelview, pref-list
icon[0][0]
galaxy-pencil, hands_on, param-text
icon[0][0]
galaxy-refresh
icon[0][0]
galaxy-undo
icon[0][0]
galaxy-rulebuilder-history
icon[0][0]
galaxy-save, save
icon[0][0]
galaxy-scratchbook
icon[0][0]
galaxy-selector, param-check
icon[0][0]
galaxy-show-hidden
icon[0][0]
galaxy-star, rating
icon[0][0]
galaxy-tags
icon[0][0]
galaxy-toggle, param-toggle
icon[0][0]
galaxy-upload
icon[0][0]
galaxy-wf-best-practices
icon[0][0]
galaxy-wf-connection
icon[0][0]
galaxy-wf-edit
icon[0][0]
galaxy-wf-new, new-history, plus
icon[0][0]
galaxy-wf-report-download
icon[0][0]
github
icon[0][0]
gitter
icon[0][0]
gtn-theme, pref-palette
icon[0][0]
help, question
icon[0][0]
history-annotate
icon[0][0]
history-share, workflow
icon[0][0]
history-select-multiple
icon[0][0]
instances
icon[0][0]
interactive_tour
icon[0][0]
keypoints, pref-apikey
icon[0][0]
language
icon[0][0]
license
icon[0][0]
linkedin
icon[0][0]
notebook
icon[0][0]
objectives
icon[0][0]
orcid
icon[0][0]
param-file
icon[0][0]
param-repeat, pref-notifications
icon[0][0]
param-select, pref-toolboxfilters
icon[0][0]
point-right
icon[0][0]
pref-info
icon[0][0]
pref-password
icon[0][0]
pref-identities
icon[0][0]
pref-dataprivate
icon[0][0]
pref-cloud
icon[0][0]
pref-custombuilds, tool-versions
icon[0][0]
pref-signout
icon[0][0]
pref-delete
icon[0][0]
purl
icon[0][0]
references
icon[0][0]
requirements
icon[0][0]
rss-feed
icon[0][0]
search
icon[0][0]
slides
icon[0][0]
sticky-note
icon[0][0]
time
icon[0][0]
text-document
icon[0][0]
tip
icon[0][0]
tool
icon[0][0]
trophy
icon[0][0]
tutorial
icon[0][0]
twitter
icon[0][0]
upgrade_workflow
icon[0][0]
warning
icon[0][0]
wf-input
icon[0][0]
workflow-runtime-toggle
icon[0][0]
workflow-run
icon[0][0]
video
icon[0][0]
video-slides
icon[0][0]
version
icon[0][0]
dataset-rerun
icon[0][0]
dataset-visualize
icon[0][0]
dataset-save
icon[0][0]
dataset-question
icon[0][0]
dataset-undelete

Abbreviations

Oftentimes there are terms you’ll use over and over again where there is an acronym or abbreviation you’ll use consistently. However for learners new to the material, they might need to scroll up to the first definition every time to remember what it meant. It would be annoying as an author to have to re-define it every time, so we’ve implemented some very simple syntax to allow you to create a list of definitions and then use those in the text.

In your tutorial metadata you can add an abbreviations section like:

---
title: My awesome tutorial
...
abbreviations:
  API: Application Programming Interface
  JSON: JavaScript Object Notation
---

And in your text you can use braces to refer to the term

Input: Markdown

The `/jobs` {API} will return {JSON}. When we call the {API} we'll get back this result {JSON}.

Output

The /jobs Application Programming Interface (API) will return JavaScript Object Notation (JSON). When we call the API we’ll get back this result JSON.

A dictionary/map

A dictionary of abbreviations and their expansions.

Example(s)

abbreviations:
    SQL: Structured Query Language
    API: Application Programming Interface

Free Text

The expansion of the abbreviated term.

Choose Your Own Tutorial

Sometimes you’re writing a large tutorial and at one small step there are multiple paths or multiple ways to get the data you want, and you’d like to showcase them all! You could write them all out in order, Option 1…2…etc, however maybe you want it to be a bit more interactive and focus only on one option at a time, so a user doesn’t get distracted by the other options.

Include this markdown where you want your user to choose between the multiple paths:

Input: Markdown
{% include _includes/cyoa-choices.html option1="Ananas of course" option2="Avocados" default="Avocados"
       text="Here is why some people choose Ananas. Other times you want Avocados as they fit the menu better." %}
Hands-on: Choose Your Own Tutorial

This is a "Choose Your Own Tutorial" section, where you can select between multiple paths. Click one of the buttons below to select how you want to follow the tutorial

Here is why some people choose Ananas. Other times you want Avocados as they fit the menu better.

And then they can wrap the relevant sections with a div block with the relevant class (if you have space in your option, use - in the class). You must set markdown="1" as well to have the inner contents rendered corretly.

NB: If you do not set a default, then on the very first page load, both options will be shown in their entirety. As soon as the user selects one of the options by clicking the relevant button, then the list is filtered. The user’s browser generally will remember which button was selected across navigation and page reloads.

Input: Markdown
<div class="Ananas-of-course" markdown="1">
- 🍍 are fantastic
- hands on!
- questions!
- solutions!
</div>
<div class="Avocados" markdown="1">
- 🥑 are amazing
- hands on!
- questions!
- solutions!
</div>
Output
  • 🍍 are fantastic
  • hands on!
  • questions!
  • solutions!
  • 🥑 are amazing
  • hands on!
  • questions!
  • solutions!

CYOAs work by filtering the content based on the class name. Class names cannot contain spaces, so, we need to replace all whitespace with -. The exact algorithm we use to create ‘safe’ IDs is:

  1. Remove the following character ", ', /, ;, :, ,, ., !, @, #, $, %, ^, &, *, (, ) from the text.
  2. Replace all whitespace with -
  3. Replace multiple -s with a single -

This results in retaining capitalisation. Hence, Ananas of course becomes Ananas-of-course. For a more complicated example (RNA) inhibitors would become RNA-inhibitors.

This can also be used inline: My favourite fruit is an 🍍🥑.

If you wish to have multiple CYOAs in a single tutorial, you are free to do that! However you must:

  1. Ensure that all options are disjoint, there should not be any shared terms! (I.e if the both CYOAs need to use “STAR”, please find a different way to phrase it, or even use “STAR “, it just needs to be different.)
  2. Provide a disambiguation term for them, passed as a parameter to all, or all but one, includes.

This disambiguation term will affect the URL parameter, which will become ?gtn-cyoa{term}={value}

E.g.:


{% include _includes/cyoa-choices.html option1="Oui" option2="Non" default="Oui" text="Vos données ESTAMP sont prêtes ?" %}
{% include _includes/cyoa-choices.html option1="Yes" option2="No" text="Do the thing?" disambiguation="english" %}

We, the GTN, don’t always know if you intend to have not used a specific branch. As such we recommend that if you have a branch that has no steps, you should include a div block with the class name of that branch, just so we know for sure you meant it to be empty.

E.g.


{% include _includes/cyoa-choices.html option1="Yes, they don't pass QC" option2="No" text="Do you think your samples need to be filtered?" %}

<div class="Yes-they-dont-pass-QC" markdown="1">
Some content here!
</div>

<div class="No" markdown="1">
<!-- intentionally empty. This comment itself isn't necessary, but we recommend adding the div. -->
</div>


URL Parameter

The branch can be selected via URL parameter e.g. for courses, to prevent users selecting the wrong path. Just supply ?gtn-cyoa=Ananas (or your preferred value) on the tutorial URL.

If you are running a remote training, and expect your users to follow a specific path, be certain to include the URL parameter to select the pathway to avoid student confusion. Please note that all tutorials using a CYOA should be tagged which will give you a heads up as a trainer.

Citations

If you would like to cite any articles, books or websites in your tutorial, you can do so by adding a file called tutorial.bib next to your tutorial.md file. In this file you may enter bibtex formatted citations. An example is given below:

@article{bebatut2018community,
  title={Community-driven data analysis training for biology},
  author={Batut, B{\'e}r{\'e}nice and Hiltemann, Saskia and Bagnacani, Andrea and Baker, Dannon and Bhardwaj, Vivek and Blank, Clemens and Bretaudeau, Anthony and Brillet-Gu{\'e}guen, Loraine and {\v{C}}ech, Martin and Chilton, John and others},
  journal={Cell systems},
  volume={6},
  number={6},
  pages={752--758},
  year={2018},
  publisher={Elsevier},
  doi={10.1016/j.cels.2018.05.012}
}

@misc{galaxy-training-materials,
  url = {https://training.galaxyproject.org},
  note = {Accessed 2019-04-08},
  title = {Galaxy Training materials website}
}

@online{Galaxy-P_Metaproteomics,
  author = {Galaxy-P Team},
  title = {Galaxy-P Metaproteomics instance},
  url = {https://proteomics.usegalaxy.eu/},
  urldate = {2020-10-13}
}

You can use this in your tutorial as follows:

For more information please look at this great article {% cite bebatut2018community %},
and the corresponding website {% cite galaxy-training-materials %}

Rendered:

For more information please look at this great article Batut et al. 2018, and the corresponding website Galaxy Training materials website

A bibliography will automatically be appended to the end of your tutorial (scroll down to the end of this tutorial to see how it looks! or jump there directly)

If you have a DOI for a paper, you can easily obtain the bibtex citation using doi2bib.org.

Automatic Jupyter Notebooks & RMarkdown

If your tutorial is primarily focused on teaching students how to write code (Bash, Python, SQL, etc) you can take advantage of the GTN’s ability to automatically export notebooks from the tutorial content! In this system, you pick a single language for your tutorial, and then all code blocks tagged with that language become runnable. E.g.

Here is some explanation

```python
some_code += f"that students {should execute}"
```

Notebook Schema

A dictionary/map

Example(s)

notebook:
    language: python
    pyolite: true

notebook:
    language: python
    snippet: topics/climate/tutorials/pangeo-notebook/preamble.md

(Required) language
Free Text

Possible Values:

  • python
  • bash
  • r
  • sql

Example(s)

language: "python"
language: "bash"
language: "r"
language: "sql"

List of Items

A list of packages that must be installed before running this tutorial. This value is not currently used, but might be in the future.

Example(s)

packages:
- tidyverse

Boolean

The GTN has support for JupyterLite and the Pyodide kernel which runs Python in the browser via webassembly/javascript. This comes with some restrictions:

  • Python only
  • No filesystem access (so no wget prep steps)
  • Little to no cell magic

However, it means we can run a lot of our Python training directly in the GTN! And in the future, hopefully, we will be able to embed individual cells of the notebook directly in the Python training, so the user doesn’t even need to switch pages.

Enabling this field will enable pyolite links for this notebook.

Free Text

If you have an alternative preamble for your notebook that students should know before following (e.g. they must load X datasets in their history), it can be listed here.

This text will be shown in the GTN tutorial, but it will not be included in the notebook, giving you a bit better control over mixing setup content which is relevant for Galaxy, with notebook content that can be easy to run for students.

Example(s)

snippet: topics/climate/tutorials/pangeo-notebook/preamble.md

Currently Supported Languages

Language Jupyter RMarkdown
Bash Yes No
SQL Yes No
R Yes Yes
Python Yes No

Every cell that you wish to be executable, needs to be annotated with the language like above. Then if a compatible notebook can be produced, it will be.

Restrictions

To use this system, you need to take care of a few things:

  • Do not use hands-on boxes for segments that should be executed (code needs to be left aligned!)
  • Do not use snippets
  • Do not use icons {% icon galaxy-eye %}
  • Do not use a terminal or prompt character (that would be included in the execution.)
  • Avoid including output when you can, it doesn’t render nicely especially when the cells will become runnable.

And be aware that the output will look a little bit different than the GTN, e.g. solution boxes cannot be hidden by default, so in Jupyter notebook we format the text with a colour of white so it does not appear in the notebook and requires selection to view the answer.

However there are things that are possible! You can still use question/solution boxes, or otherwise nested boxes. Just not includes or snippets

Enabling the system

Add metadata to your tutorial.md header like:

notebook:
  language: python

Supported values are python, sql, r, and bash. The notebook will be generated automatically as part of the site build process.

JupyterLite & Pyodide

The GTN has support for JupyterLite and the Pyodide kernel which runs Python in the browser via webassembly/javascript. This comes with some restrictions:

  • Python only2
  • No filesystem access (so no wget prep steps)
  • Little to no cell magic

However, it means we can run a lot of our Python training directly in the GTN! And in the future, hopefully, we will be able to embed individual cells of the notebook directly in the Python training, so the user doesn’t even need to switch pages.

To enable this feature, set:

notebook:
  language: python
  pyolite: true

Spanish Translation Project

We have started a trial for translating tutorials into Spanish. Below are instructions on how to add translations of slides and/or hands-on tutorials in Spanish.

  1. Add a new file with the translated material, next to the English version.
    • Add suffix _ES suffix
      • i.e. tutorial_ES.md or slides_ES.html
  2. Add metadata to the English version (at the top of the file):
      tags:
        - español
      translations:
        - es
    
  3. Add metadata to the translated version of the file:
      lang: es
      translations:
        - en
    

If all worked well, it should look something like this, with a dropdown menu on the slides and/or tutorial showing the presence of a curated tutorial:

example of the view in the topic page for a tutorial with a Spanish translation.

Other Languages

Would you like to add a different language to the GTN? Please contact us first (e.g. on Gitter), to discuss a long-term sustainability plan!

Conclusion

If you have created a new tutorial, please also consider writing a GTN news post about it to let people know about it (and make it easy for us to tweet about)!

Footnotes (Rendered)

  1. The wikipedia definition of a footnote is: “A note is a string of text placed at the bottom of a page in a book or document or at the end of a chapter, volume or the whole text. The note can provide an author’s comments on the main text or citations of a reference work in support of the text. Footnotes are notes at the foot of the page while endnotes are collected under a separate heading at the end of a chapter, volume, or entire work. Unlike footnotes, endnotes have the advantage of not affecting the layout of the main text, but may cause inconvenience to readers who have to move back and forth between the main text and the endnotes.”  2

  2. Not entirely true, other kernels are supported, see their demo repo, but e.g. the SQLite kernel comes with severe restrictions like no downloading databases or connecting to ones online.