Skip to content

adding cookbook to pass variables from one task to the next one #43

@edublancas

Description

@edublancas

A few times on Slack, we've been asked how to pass variables from one task to the next one. Typical use cases are runtime parameters (for example, doing feature selection and then training on that subset of features).

Our recommended solution is to serialize the parameters into a JSON file (or similar). However, this involves users learning how to use the JSON library. We should add a cookbook that shows how to do it, something like this:

tasks:
  # show an function task example
  - source: functions.some_function
     product:
       variable: products/variable.json

 # show a script/notebook example
   - source: scripts/some-script.py
     product:
       nb: products/report.html
       variable: products/another-variable.json

  # load  products/variable.json and products/another-variable.json her
   - source: scripts/last.py
      product: products/final.html

@idomic - tagging you to keep you in the loop. this isn't urgent, but if you need more good issues for the interns, this is a good one

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions