Steps are the fundamental building blocks of your Workflow. Each Step represents a specific action or task within your workflow. Breaking down complex processes into individual steps makes everything simpler and more manageable.
Always break up getting data and processing data into separate steps.
Step 1: Get data
Step 2: Process data
The reason is that Pinkfish won’t know what your data is going to look like until after it’s retrieved. Ie: it hasn’t seen your data, so it doesn’t know how to handle it. So, first retrieve it in one step. Then, process it in another step. This is the golden combination.
Sometimes we see people trying to cram everything into a single step. This is a mistake. Breaking your workflow into multiple steps is the way to go. Here’s why:
Easier Testing: Test and debug each step independently
Better Organization: Keep your workflow logic clean and organized
Improved Maintenance: Update specific parts without affecting the whole
Clearer Workflow: Understand and document your process more effectively
Reusability: Share outputs between steps and other workflows
Faster Builds: There’s just less to process, so everything runs faster
When you run a step, the results are returned as one or more artifacts. To reference an artifact in a subsequent step, use the “Insert path into chat” tool, which will insert a reference to a specific variable or to the entire artifact into your prompt.
In our practice of data minimization and to protect your privacy, we avoid sending your data to the Pinkfish Workflow Agent to the greatest extent possible. So when your step generates artifacts, Pinkfish Agent doesn’t actually get to see that data. It only sees the structure of the data - such as the fields and their types. This allows Pinkfish to process the data without seeing it. The data itself sits encrypted in an Amazon S3 bucket and is accessible only to you.However, if you were to paste your data into the chat, Pinkfish Agent would then see it. Sometimes this may be what you want, but it’s not the default behavior.