Machine Learning and AI Functionalities in ZEN
You can train and use machine learning models as well as download and use dedicated AI models, like deep learning models for instance segmentation from arivis Cloud. With the necessary licenses, you can use these models in several modules, including the Image Analysis and Bio Applications.
Machine Learning Capabilities
You can import and export machine learning models for segmentation, denoising, and object classification via the respective tool on the Analysis tab. You can execute them with a dedicated function on the Processing tab (even without a license), or as part of an image analysis and/or Bio Application. To train such models directly in ZEN, you need the license for the AI Toolkit. Training and running machine learning models for segmentation and object classification requires an installation of the 3rd party Python Tools during the installation of ZEN. Training machine learning models for denoising requires an installation of Docker Desktop and a corresponding denoising container during the installation of ZEN. The machine learning functionality in ZEN includes:
- Intellesis Segmentation to train and use models for segmenting images using pixel-classification, see Intellesis Segmentation.
- Intellesis Denoising to train and use deep learning based models for the denoising of images with the Noise2Void (N2V) approach, see Intellesis Denoising.
- Intellesis Object Classification to train and use models for classifying objects based on measured parameters of an analyzed image, see Intellesis Object Classification.
AI Models
Compatibility of Instance Segmentation Models
Instance segmentation models trained after Oct. 21st 2025 are only compatible with NVIDIA Graphics cards of newer generation with CUDA Compute Capability ≥ 7.0 (Volta or newer). If you want to use these newer models with older NVIDIA graphics cards, you can use the CPU fallback (under Tools > Options > arivis Cloud > Instance Segmentation deactivate the checkbox Enable NVIDIA GPU for Instance Segmentation).
Different functionalities in ZEN can also make use of trained AI models packaged as Docker containers. These functionalities therefore need the Docker Desktop software installed and running on your PC. For more information, refer to the installation guide and see Requirements for Docker Desktop. You can directly download AI models from arivis Cloud into ZEN, for which you need to establish a connection with an access token, see Creating and Entering an Access Token and Downloading AI Models. Additionally, certain modules use systemwide Docker containers that can be installed with the ZEISS Microscopy Installer during installation of ZEN.