Aivia Software
Neuron Composer
The Neuron Composer lets you create new or edit existing neuron objects (generated using the 3D Neuron Analysis recipes or Mesh Contour Editor) in 3D View manually. The Neuron Composer provides tools for editing dendrite segments, adding somas (cell bodies), and adding spines. When you complete an edit, the Neuron Composer automatically updates the neuron measurements as well as the display of the edited neurons.
Interface
The Neuron Composer is one (1) of eight (8) tools found in the 3D Tools tab of the Analysis Panel. Go to 3D View to show the 3D Tools tab. Click on the 3D Tools tab, and then click on the Neuron Composer icon to launch the tool. When you first launch the Neuron Composer, the display settings are updated to show neuron objects and color them by object label. To start editing, select a tool from the Edit Mode section at the top of the Neuron Composer GUI.
Neuron Composer interface with the Neuron Composer icon highlighted
Edit modes
The Edit Mode box contains the editing tools for the Neuron Composer. When you select a tool, you enter a specific edit mode that lets you modify certain parts of the neuron objects (i.e., somas, dendrites, or spines). Descriptions and functions for all editing tools in the Neuron Composer are summarized in the table below, and the options for each edit mode are explained in the subsections to follow.
Edit mode | Icon | Hotkey | Description |
---|---|---|---|
Predict Dendrite |
| Toggles the Predict Dendrite mode for algorithm-assisted dendrite tracing | |
Draw Dendrite |
| Toggles the Draw Dendrite tool for WYSIWYG dendrite tracing in the 3D volume | |
Connect Neurons |
| Toggles the Connect Neurons tool for joining dendritic segments | |
Delete Dendrite Points |
| Toggles the Delete Dendrite Points tool that removes individual dendritic points | |
Add Spine |
| Toggles the Add Spine tool for one-click spine creation | |
Add Soma |
| Toggles the Add Soma tool for one-click soma creation | |
EM Create |
| Toggles the EM Create tool for point-by-point dendrite tracing | |
EM Update | Toggles the EM Update tool for updating the segmentation of dendrite meshes following edits to dendrite trees |
On this page:
Predict Dendrite interface
The Predict Dendrite tool offers algorithm-assisted dendrite tracing and has the interface shown on the right. The available options and parameters for Predict Dendrite are grouped into five (5) sections—Trace Radius, Operations, Camera Modes, Clip Modes, and Clip Size—and described in the table below.
Section | Option | Description |
---|---|---|
Trace Radius | Trace Radius | Specifies the radius of the drawn dendrite trace and the maximum search distance between adjacent dendrite points; the radius parameter is relative to your computer display and not to the physical width of the dendrite in the image |
Enhance Trace | Lets you override the specified dendrite radius of the drawn trace by estimating the approximate radius at each point using the intensity of the segment | |
Operations | Add To | Specifies the object group to output the edited objects to |
Undo | Undoes the last edit | |
Redo | Redoes the last edit | |
(B) Build Trace | Creates a dendrite from the trace in progress | |
(Escape) Clear | Clears the trace in progress | |
Camera Modes | Follow | Follows the predicted trace, moving the camera automatically to fit the trace |
Pan-Only | Follows the predicted trace with panning only, keeping the same angle of view | |
Clip Modes | Latest | Clips to the current prediction and last path segment added |
Grow | Clips to the current prediction and all segments in the current trace | |
Object Set | Clips to the current prediction and all objects in the output object set | |
Clip Size | Clip Size | Specifies the size of the clipping box |
Predict Dendrite interface
Draw Dendrite interface
The Draw Dendrite tool allows you to draw dendrites on a 3D volume with more manual control than the Predict Dendrite tool provides. The interface for the Draw Dendrite tool is shown on the right, and the options and parameters available for the tool are described in the table below.
Section | Option | Description |
---|---|---|
Trace Radius | Trace Radius | Specifies the radius of the drawn dendrite trace and the maximum search distance between adjacent dendrite points; the radius parameter is relative to your computer display and not to the physical width of the dendrite in the image |
Enhance Trace | Lets you override the specified dendrite radius of the drawn trace by estimating the approximate radius at each point using the intensity of the segment | |
Operations | Add To | Specifies the object group to output the edited objects to |
Undo | Undoes the last edit | |
Redo | Redoes the last edit |
Draw Dendrite interface
Connect Neurons interface
The Connect Neurons tool can be used to join dendritic segments to each other as well as to somas. The Connect Neurons interface is shown on the right, and descriptions of the available options are given in the table below.
Section | Option | Description |
---|---|---|
Operations | Undo | Undoes the last edit |
Redo | Redoes the last edit |
Connect Neurons interface
Delete Dendrite Points interface
The Delete Dendrite Points tool can be used to delete individual dendrite points and has the interface shown on the right. Descriptions of the available options are given in the table below.
Section | Option | Description |
---|---|---|
Operations | Undo | Undoes the last edit |
Redo | Redoes the last edit |
Delete Dendrite Points interface
Add Spine interface
The Add Spine tool allows for one-click spine creation and has the interface shown on the right. The table below contains descriptions of the available options and parameters for the tool.
Section | Option | Description |
---|---|---|
Spine Search Range | Spine Search Range | Specifies the maximum search distance (in voxels) for spines from the nearest dendrite segment |
Operations | Add To | Specifies the object group to output the spine to |
Undo | Undoes the last edit | |
Redo | Redoes the last edit |
Add Spine interface
Add Soma interface
The Add Soma tool allows for one-click soma creation and has the interface shown on the right. The table below contains descriptions of the available options and parameters for the tool.
Section | Option | Description |
---|---|---|
Search Range | Search Range | Specifies the maximum detection radius (in voxels) from the selected point for soma detection |
Dendrite Root Radius | Dendrite Root Radius | Specifies the dendrite radius (in voxels) at the soma, which increases detection accuracy with enhanced soma detection |
Enhance Soma Detection | Lets you use an advanced algorithm to produce a more accurate soma given the Dendrite Root Radius; with this off, a threshold is used, creating a soma that more closely matches the preview | |
Operations | Add To | Specifies the object group to output the soma to |
Create Soma | Creates a new soma object based on the selected location and specified parameters and options | |
Undo | Undoes the last edit | |
Redo | Redoes the last edit |
Add Soma interface
EM Create interface
The EM Create tool allows you to create dendrite segments and branches point by point. The interface for the EM Create tool is shown on the right, and the available options and parameters for the tool are described in the table below.
Section | Option | Description |
---|---|---|
EM Truth Creation | Create Dendrite | Allows you to place dendrite point when enabled |
Branch From Point | Allows you to select a dendrite point to branch from | |
(B) Build Trace | Creates a dendrite from the trace in progress | |
(Escape) Clear | Clears the trace in progress | |
Set View Defaults | Adjusts the display settings to those that are recommended for the EM Create tool | |
Trace Radius | Trace Radius | Specifies the radius of the drawn dendrite trace; the radius parameter is relative to your computer display and not to the physical width of the dendrite in the image |
Operations | Add To | Specifies the object group to output the dendrites to |
Undo | Undoes the last edit | |
Redo | Redoes the last edit |
EM Create interface
EM Update interface
The EM Update tool allows you to update the segmentation of dendrite meshes based on the tree structure and has the interface shown on the right. The options for the EM Update tool are described in the table below.
Section | Option | Description |
---|---|---|
EM Update | Source | Specifies the object group to update |
Process | Segments the dendrite meshes based on the dendrite tree structure |
EM Update interface
Tool-specific hotkeys
Hotkey | Edit mode(s) | Action |
---|---|---|
| Add Soma | Confirm soma creation |
| Predict Dendrite | Terminate a potential path by holding |
| Predict Dendrite | Hide the current trace while the key is held |
| Predict Dendrite EM Create | Create a dendrite from the trace in progress |
| Predict Dendrite EM Create | Clear the trace in progress |
| EM Create | Toggle on Branch From Point mode |
Using Neuron Composer
To launch the Neuron Composer tool, click on the 3D Tools tab in the Analysis Panel in Aivia and select the Neuron Composer tool from the 3D Tools toolbar. This will open the Neuron Composer interface.
Trace new dendrites
The Draw Dendrite tool lets you draw new dendrites directly on the 3D volume. Click on the Draw Dendrite tool icon or press the D
key on your keyboard to enter this mode. The cursor display will change to a pencil with the tip of the pencil (lower-left corner) as the tracing position.
Before tracing a dendrite, make sure the channel displaying the dendrite is visible. Depending on the intensity of the dendrite and the density of objects in the volume, you may need to adjust the lookup table or add a clipping plane to isolate the desired dendrite. The Draw Dendrite tool uses ray tracing to find the closest opaque (i.e., non-background) signal directly in the line of sight of the displayed volume. To trace, hold down the left mouse button while dragging the mouse cursor along the dendrite.
Each point the Draw Dendrite tool finds along the dendrite is shown as a sphere in the volume. As you trace along the dendrite, additional spheres (dendrite points) are added to the trace. To finalize the trace, release the left mouse button; Aivia will connect the detected dendrite points to form a single dendritic segment and attempt to clean up the trace by removing any points that overlap the constructed trace.
The video on the right shows an example of using the Draw Dendrite tool to trace dendrites.
For even finer control over the placement of dendrite points, you may use the EM Create tool, which is designed for creating and editing dendrite traces for 3D electron microscopy images. It is recommended that this tool be used while stepping through the image slice-by-slice with an ortho plane. You may click on the Set View Defaults button in the EM Create interface to set the recommended display settings for this editing tool.
When Create Dendrite is enabled in the EM Create tool, left-click on the image to place a dendrite point. Once you have placed all dendrite points on the current trace that you would like to add, click on Build Dendrite or press B
to finalize the dendrite segment. You can also branch off of existing dendrite segments in EM Create mode by first enabling Branch From Dendrite, then selecting the dendrite point to branch from (the selected point will turn yellow), placing dendrite points in the branch segment, and finally clicking on Build Dendrite or pressing B
to finalize the branch.
Adjust dendrite radius
You can adjust the Trace Radius by moving the slider or entering a new value into the textbox. Increasing the Trace Radius results in thicker dendrite traces and increases the search radius for finding dendrite points. This option is useful for tracing dendrites with discontinuous signals. The radius parameter is relative to your computer display and not to the physical width of the dendrite in the image.
Enhance trace
The Enhance Trace option overrides the dendrite radius by aligning the drawn segment to the center of the dendrite and adjusting the radius locally at each dendrite point detected based on intensity in the volume. For best results, make sure the contrast between the dendrite segment and the background is as high as possible.
Manual dendrite tracing using Draw Dendrite (Aivia 5)
Creating a branch (blue) from a selected branch point (yellow) in EM Create mode
Predictive modes
The Predict Dendrite tool lets you partially or fully accept/reject predicted dendritic segments on the 3D volume and can auto-connect traces to existing dendrite segments or somas. Click on the Predict Dendrite tool icon or press the E
key on your keyboard to enter this mode. If your dataset has somas and you want to include them in the analysis, we suggest you first detect the soma(s) of interest using the Add Soma tool and then use the Predict Dendrite tool.
To start a predicted trace, either click on the 3D volume or click on an existing dendrite point to branch or extend from. Predictions will then be shown as yellow lines on the 3D volume.
To accept a full prediction, click on the predicted trace. If a connection to an existing dendrite segment or soma is predicted, the trace will be automatically built and connected when the prediction is accepted; otherwise, the accepted prediction will turn blue, and another prediction will be generated from the end of the accepted prediction.
To accept a portion of a prediction, hold Ctrl
and left-click on the end of the portion you would like to accept. The section you have accepted will turn blue, and the point where you clicked to cut off the prediction will serve as the seed for the next prediction.
As an alternative to partially or fully accepting a prediction, you can click on another location in the 3D volume to serve as the next seed point; Aivia will attempt to find the best path between the newly selected point and the previous seed point and then display it as a blue trace. You can also select an existing dendrite point to connect the current trace to, and a path will be predicted to the selected dendrite point and built.
When no trace is predicted from the last seed point, the seed point will turn red.
Camera modes
Camera modes give you options for automatic camera positioning as you trace. In Follow mode, the camera position and angle of view is automatically adjusted, but in Pan-Only mode the angle of view is not changed. You may deselect Follow and Pan-Only modes to turn off automatic camera movement.
Clip modes
There are three (3) clip modes for clipping to the portion of the image being traced. In Latest mode, the clipping box contains the current prediction and last confirmed path segment. In Grow mode, the clipping box contains the current prediction and all segments in the current trace. In Object Set mode, the clipping box contains the current prediction and all objects in the output object set. You can adjust the size of the clipping box using the Clip Size textbox.
Tracing with Predict Dendrite
Connect dendrites
You can connect any point on an existing dendrite to any point on a different dendrite or a soma using the Connect Neurons tool. Click on the Connect Neurons icon or press the C
key on your keyboard to activate the edit mode. There are three (3) types of connections:
Connections | Effect |
---|---|
Endpoint-to-Endpoint | Extend existing dendrite |
Endpoint-to-Intermediate-Point | Create dendrite branch at intermediate point |
Endpoint-to-Soma | Create a root point at the endpoint, and add a dendrite to the neuron |
Connect dendrite points
To connect two (2) dendrites, mouse the cursor over an existing dendrite point and hold down the left mouse button. The point will be highlighted in red. Move your cursor while holding down the left mouse button to a dendrite point on another dendrite. If the connection is valid, the initial point will be highlighted in blue and the connection point will be in green. Release the mouse button, and the dendrite branches will be connected. The dendrite segments will update automatically to reflect the new connections.
Connect to soma
Move your cursor to the dendrite endpoint closest to the soma and hold down the left mouse button. When you drag the cursor towards the soma, the Neuron Composer will recognize the connection and highlight the soma with a large green sphere. Release the mouse button to connect. The root point will be shown as a translucent shell over the dendrite endpoint.
Limitations
There are several restrictions in place to prevent invalid connections. A red sphere at the connection point indicates that the connection point is invalid. The following table summarizes the restrictions and solutions to resolve the issue:
Restriction | Solution |
---|---|
Joining segments from two (2) neuron objects is not allowed. | Separate the segment from the incorrect neuron with Delete Dendrite Points prior to connecting the segments. |
Joining segments belonging to the same neuron object (i.e., loops) is not allowed. | Separate the segment from the incorrect dendrite with Delete Dendrite Points prior to connecting the segments. |
Joining a dendrite endpoint to the soma of the same neuron is not allowed. | Separate the segment from the incorrect dendrite with Delete Dendrite Points prior to connecting the endpoint to the soma. |
Joining more than two (2) segments to a single dendrite point is not allowed. | Connect the segments at adjacent dendrite points—each point can have a maximum of two (2) branches. |
Extending a dendrite segment
Creating a branch point
Connecting a dendrite endpoint to a soma
Delete dendrite points
You can delete individual points on a dendrite using the Delete Dendrite Points tool. Click on the Delete Dendrite Points tool icon or press the F
key on your keyboard to activate this mode. Your cursor will change to a scissor while you are in this mode.
When you hover the cursor over a dendrite segment, the dendrite point to be removed will be highlighted in red. Press the left mouse button to delete the highlighted dendrite point.
Delete dendrite segments
To delete a dendrite segment, it is recommended that you use the Delete Dendrite Points tool to isolate the segment first. Once the segment is separated, exit the Neuron Composer and change the object selection mode to Single Item from the zoombar. Click on the segment you wish to delete to select the segment, and then press the Delete
key on your keyboard to remove the segment.
Dendrite point to be deleted highlighted in red
Create spines
Dendritic spines are protrusions on dendrites that interact with nearby neurons at the synapse. In the Neuron Composer, you can add spines to a dendrite using the Add Spine tool. To activate the tool, click on the Add Spine tool icon or press the S
key on your keyboard.
To add a spine, click on the spine head in the image near an existing dendrite. A purple sphere will highlight the location where you clicked (as determined by ray tracing), and the Neuron Composer will automatically detect the size of the spine head and attach the spine head to the nearest dendrite segment with a spine neck.
You can adjust the search distance for spine detection in the tool using the Spine Search Range slider or textbox. The tool will look for the nearest dendrite segment within the specified search range. The value corresponds to the distance in voxels from the specified spine head location to the center of the traced segment.
Selected spine-head location indicated by purple sphere
Create somas
You can add somas, or neuron cell bodies, to the image using the Add Soma tool in the Neuron Composer. To activate the tool, click on the Add Soma tool icon or press A
on your keyboard.
When you enable the Add Soma tool, the cursor changes to a pencil icon. Click anywhere on the image where a soma is located and a preview is generated at the location where you clicked. The detected area is shown as an overlay in silver over the image. If you are satisfied with the detection, you can click the Create Soma button or press Shift + A on your keyboard to create the soma.
The created soma is a single, continuous surface that surrounds the clicked location. Surfaces that are separate from the continuous surface are not used for creating the soma.
Adjust soma detection
You can change how far the detected soma extends from the clicked location by changing the Search Range slider or textbox. The live surface preview automatically updates as you modify the Search Range parameter. You can click anywhere on the image again to update the search location.
With the Enhance Soma Detection option, an advanced algorithm is used to detect a more accurate soma given the Dendrite Root Radius. The Dendrite Root Radius, which you may specify with the associated slider or textbox, is a distance in voxels; it is recommended that you set this value as the largest radius (in voxels) of a dendrite at its connection to the soma of interest. Note that the live surface preview does not update with changes to the Dendrite Root Radius.
Creating smooth somas
Undo or redo an operation
You can undo an operation by clicking on the Undo icon, which looks like a counter-clockwise looping arrow, or pressing Ctrl
+ Z
on your keyboard. To redo an operation, press the Redo icon (clockwise looping arrow) or Ctrl
+ Y
on your keyboard. The order of the undo/redo operation is determined by the last operation or the most recent operation completed respectively, regardless of the edit mode used.
Specify output object group
You can specify the object group to output the edits to using the Add To dropdown menu. If a neuron object group exists, the Neuron Composer will automatically select the existing object group as the output group. To output the edited objects to a different object group, click on the dropdown menu and select the desired output object group option.
To output the edited objects to a new object group, click on the dropdown menu and select the <Create Object Group> option.
You can only output to neuron object groups from the Neuron Composer.