Very short, basic overview of how to create and run pipelines in ZEISS arivis Pro.
Image analysis in arivis Pro
Overview
Workflow Description
The video above shows the complete process of creating, modifying and executing a pipeline for tracking on a single dataset. Let's break down the various steps.
Opening the Analysis panel
All segmentation operations, and the operations needed to enhance or otherwise modify the segmentation, can be built into a pipeline within the analysis panel. When we first open the analysis panel we can create new pipelines from scratch or use existing sample pipelines.
Blob Finder (Segmentation)
The Blob Finder is a popular segmentation operation that is available in arivis. It is a fairly powerful operation because it is quite robust in dealing with noise and uneven backgrounds without the need for additional image pre-processing. The exact details of how this operation works is covered in the help files which we can access by pressing the F1 key on our keyboard.
The first parameter that needs to be set in any segmentation operation is the channel from which the segmentation extracts objects. Most operation only use one channel for segmentation, but some, including the Machine Learning and Deep Learning segmenters can use multiple channel inputs.
When setting up any segmentation operation, we usually have a couple of parameters to set, and we can use the preview to help us set the correct values.
The exact values we used in this case aren't particularly important, by using the preview we can adjust the parameters until the segmentation seems optimal. If we use this pipeline with multiple images it is of course also important to use the same settings for all our images and therefore to also test on a variety of images.
Every segment operation, whether it creates de novo objects or modifies existing ones, uses tags to help us select the objects in downstream pipeline operations. The default tag is the name of the operation, which is fine as a 1st default value but likely not ideal if our pipeline contains several segmentations or object processing operations of the same type, and it is therefore recommended to change the tag to something more appropriate.
Useful tip with regards to naming: start with names that describe the process then narrow down the naming to specific object types. For example, we might start with a tag "DAPI Seg" and then use the tag "Nucleus" once all false positives have been removed.
Export Object Features
Whenever we create or modify objects, the purpose is usually to extract some useful numerical value pertaining to these objects. In arivis we call these Features of the objects, and these can include values like:
- Morphological information (volume, surface area, length, sphericity...)
- Intensity values (mean, max, min etc, for any channel in the image)
- Object specific features (e.g. number of children for groups, average speed for track, number of branches for traces)
The complete list of available features is covered in the help files (User Interface>Additional Windows> View Objects> Object Features), and additional features can be created by using Custom Features. Custom Features can be used to:
- Create group statistics (feature statistics for all or just some of the children in the group)
- Create object counts for groups that include multiple children types (e.g. cells with two different labeled vesicles)
- Compute new features from existing features (e.g. ratio of intensities between 2 channels, number of children per unit volume, and many more)
The Export Object Features operation, allows us to create an excel spreadsheet containing the numerical information generated by the pipeline. In our example we exported a spreadsheet containing both the information pertaining to tracks and the tracked objects.
Saving changes
By default, pipeline operations do not typically make any changes to the pixel values in the image data, but this is not the only piece of information that is stored with the SIS file. Along with the SIS file we also have a metadata file that includes several additional bits of information pertaining to the image, including the pipelines we used on that document. When we close the document we are prompted to save our changes, this includes any modification to the pipeline, and the objects we created with it. It is therefore important to save those changes so we don't need to rebuild the pipeline and run the segmentation every time we want to inspect the results.
Saving the document when we close it means we can review the pipelines and segmented objects when we next open the image, but we can also export the pipeline for use with other images and sharing with other users. Exporting a pipeline is done from the Analysis Panel's hamburger menu:
Conclusions
The general process of doing image analysis in arivis is fairly simple. We use the Analysis Panel to create Pipelines. Those pipelines are built from individual operations that work with each other to extract the information we need. Pipelines can then easily be re-used with other images as needed, including in batch mode to streamline the process.
Of course, the process we described here is only the basic principle of pipeline:
- Enhance images if needed
- Use images to segment objects
- Use the segmented objects to extract useful information
- Save the results
The full breadth of what can be done in a pipeline cannot be covered here. The inclusion of Machine Learning and Deep Learning makes it possible to segment objects that were previously impossible to segment, and the pipeline tools allow us to extract all sorts of useful information from these segmentation. Please check our pipeline examples, to find out more about the types of information arivis can extract from images, and to learn more about how individual operations work.
Finally, again since our Knowledge Base and sample pipelines couldn't hope to fully cover what can be achieved in a pipeline, don't hesitate to get in touch with your local ZEISS representative.