How to classify objects

Aivia Software

How to classify objects

The Classifier View in Aivia allows you to create and apply custom object classifications on analyzed data. The classifier uses a random forest algorithm to identify unique features (i.e. measurements) for classification. The view mode can be toggled using the Classifier View icon 

in the zoombar, which is directly above the image.

This page will walk you through the steps needed for classifying objects using the Classifier View.

Apply a classifier

You can load a classifier from a file and classify new data by pressing the Load Classifier icon 

 in the Classifier View toolbar. 

To apply a classifier, select the classifier from the Classifier dropdown menu and click the Apply button in the lower right corner of the gallery. If the data has existing classifications, applying a classifier will remove the existing classifications and create new ones.

On apply, the classifier will look at each object and assign a class. If you have Color by Class turned on in the Object Set Settings, the colors of the objects will change to correspond to their assigned categories. An example of classified output is shown on the right.

You can also view the objects by class in the Spreadsheet panel as subsets.

 

Example of classification output with Color by Class turned on (Neuron reconstruction courtesy of NeuroMorpho.org)

Create a classifier

You can create a new classifier from scratch by clicking on the Create New Classifier icon 

 in the Classifier View toolbar. Make sure you have loaded an image and have analysis data prior to using the Classifier tool. When you click the Create New Classifier button, the Classifier Creation dialog will be shown (see right).

Select the object type

In the dialog, enter a name for your classifier into the Name field and select the type of objects you wish to classify using the Object Type dropdown menu. Aivia currently supports the classification of seven types of objects:

 

Object Type

Description

Object Type

Description

Neuron

Classify whole 3D neurons (based on full neuron reconstruction with soma, dendrites, and spines included)

MeshFeatures

Classify 3D object surfaces

Soma

Classify 3D somas

Dendrite

Classify 3D dendritic arbors (based on overall dendrite branching)

DendriteSemgent

Classify 3D dendritic branches/segments as individual objects

Spine

Classify 3D spine objects (based on spine head and neck)

Outline

Classify 2D objects for each time point

 

When you are done, click Create to return to Classifier View and start with a blank classifier.

 

 

Create a class

In order to create a functional object classifier, you will need to have a minimum of two (2) classes defined with examples of objects given for each class. To create a class, click on the + button to the right of the Class dropdown menu.

When you create a class, a new header is shown in the gallery with the name highlighted. Type in a new name and press Enter to finish creating a class. Do this for each class you wish to add to the classifier.

Select measurements

Starting in Aivia 7.5, you can specify which measurements to use when generating the classification rules by clicking on the Select Measurements icon 

 in the toolbar.

When you click on the icon, a new dialog opens. Click on the checkbox for each measurement you want to include. If the measurement has not been calculated on the image, it will be automatically calculated when you apply the classifier. When you are finished selecting the measurements, click Finish to confirm and save your changes.

Intensity measurements can be selected on the additional tabs in the Classifier Measurements window. Once you have selected intensity measurements, click on the caret next to Input And Output to expand the menu where you may specify the input channels to measure from the image as well as the object set to classify.

 

Input And Output section (expanded)

Classifier Measurements window

 

Teach the classifier

The classifier is generated through a "teaching" process by providing examples of objects for each defined class. The Classifier tool uses a random forest algorithm to identify unique (and most recurrent) measurements for separating the classes.

Depending on the Object Type chosen, the Classifier tool will automatically generate the appropriate list of measurements to be used for classification. Depending on the size of the image, there may be a short delay in Aivia while the measurements are being generated.

To teach the classifier, first select the representative objects by clicking on their thumbnails in the gallery or by selecting them directly on the image. You can select multiple objects by holding down the Ctrl or Shift key on your keyboard while clicking in the gallery or on the image. Alternately, you can use the Toggle Multi-Selection option 

 to select multiple objects one-by-one.

There are two ways to assign an object to a class for teaching:

  • Drag-and-drop the selected thumbnails directly to the header of one of the classes in the gallery 

  • Select the class to assign to using the Class dropdown menu below the gallery and click the Assign button

On assignment to a class, the selected thumbnails will appear in the gallery of their assigned class.

When you are done providing the examples for the classifier, press the Teach button to generate the classifier.

You need to provide at least one (1) example object for every class you have created in Classifier View. Additionally, a minimum of two (2) classes are required