Annotation Tools Reference

Classifications

Classifications are answers to true-or-false or multiple-choice questions about the data. Often, classifications apply to the whole image. In multi-frame images (like videos, or slices of a 3D scan), there can also be classifications that apply to individual frames. The questions themselves are set up by your principal investigator.

Image Classifications

These classifications apply to the whole image. If the image only has one frame (such as an x-ray), they are the only type of classification available.

Checkboxes

The simplest form of classification is a checkbox. Click the checkbox to mark an image as belonging to a given category (for example, showing a diseased organ).{width=”2.7291666666666665in” height=”1.3333333333333333in”}

Frame Classifications

These classifications apply to individual frames, and can only be used in multi-frame images. They work exactly the same as the image classifications, but only apply to the frame you’re currently on. Frame classifications cannot be applied to 3D images.

The Timeline Tool

The timeline tool allows you to classify multiple frames at once. To access it, click the {width=”0.20833333333333334in” height=”0.21875in”} button next to the classification you want to use. A timeline will appear at the bottom. You can click on the timeline to move between frames.

With the Timeline tool active, any classification will apply to both current frame and to all subsequent frames. If you change an existing classification, you will only change the section of subsequent frames with the same current classification. Similarly, if you remove the classification by re-selecting the same option, it will delete all subsequent frames until the frame classification changes.

You can use the {width=”0.20833333333333334in” height=”0.20833333333333334in”} button to reset a given classification.

{width=”6.5in” height=”1.9861111111111112in”}

Segmentation Tools

Segmentation tools “colour” the image, categorizing individual pixels into belonging to a region or not. Generally, when using segmentation tools, you should highlight the entire region you are indicating.

Drawing-based tools

These tools paint individual pixels, editing the segmentation directly.

{width=”0.3333333333333333in” height=”0.3125in”} Brush

Click and drag to draw a segment on the image. Use the Set Pencil Size button ({width=”0.2916666666666667in” height=”0.3229166666666667in”}) to change the brush size.

{width=”4.351655730533683in” height=”2.4478062117235346in”}

{width=”0.34375in” height=”0.34375in”}Eraser

Click and drag to remove part of a segment. Use the Set Pencil Size button ({width=”0.2916666666666667in” height=”0.3229166666666667in”}) to change the eraser size.

{width=”3.7215332458442694in” height=”2.677834645669291in”}

{width=”0.27597003499562556in” height=”0.31736548556430444in”}Circle

Left-click where you want the centre of the circle to be, then move the mouse out. Click again when the circle is at the desired size.

{width=”3.669821741032371in” height=”2.6406255468066493in”}

{width=”0.3281255468066492in” height=”0.3773436132983377in”}Rectangle

Left-click where you want one corner of the rectangle to be, then left-click where you want the diagonally opposite corner to be.

Spline Tools

These tools allow you to draw a boundary by creating a set of points (called vertices). This boundary is then automatically filled in. Splines can allow you to create complex shapes more precisely than using the drawing tools alone.

All splines can be edited by clicking and dragging their vertices with a spline tool selected, or moved by dragging their edges with a spline tool selected.

{width=”3.6301607611548556in” height=”2.5364588801399823in”}

When a spline is created intersecting with another spline, it instead edits the existing spline. Starting inside the existing spline will expand it; starting outside will remove the selected part.

{width=”3.6897933070866142in” height=”2.5781255468066493in”}

{width=”0.3771784776902887in” height=”0.3724048556430446in”}Linear Spline

This tool creates a spline with straight edges. Left-click where you want the first vertex to be, then continue left-clicking at each subsequent vertex. To finish, click the first corner, or double-click. If you place a vertex incorrectly, press the Delete or Backspace key to remove it.{width=”3.385739282589676in” height=”2.365676946631671in”}

{width=”0.28125in” height=”0.2916666666666667in”} Polygon Spline

This tool creates a curved spline, with the boundary curving around the outside of the vertices. Left-click where you want the first vertex to be, then continue left-clicking at each subsequent vertex. To finish, click the first corner, or double-click. If you place a vertex incorrectly, press the Delete or Backspace key to remove it.

{width=”3.9730500874890637in” height=”2.776042213473316in”}

{width=”0.3020833333333333in” height=”0.28125in”} Vector Spline

This tool creates a curved spline, with the boundary curving within the inside of the vertices. Left-click where you want the first vertex to be, then continue left-clicking at each subsequent vertex. To finish, click the first corner, or double-click. If you place a vertex incorrectly, press the Delete or Backspace key to remove it.

{width=”3.8489588801399823in” height=”2.689336176727909in”}

Contour/Sculpt Tools

These tools allow you to create a region by drawing its outline, and then to carefully edit the region.

{width=”0.20833333333333334in” height=”0.21539588801399825in”} Freehand Contour

Left-click and drag around the boundary you want to segment.

{width=”6.5in” height=”3.486111111111111in”}

{width=”0.24802165354330707in” height=”0.25208661417322836in”}Sculptor

This tool lets you edit the contour by “pushing” the boundary inwards or outwards. Begin inside the contour to push it out, or outside to push it in. To push, left-click and drag through the boundary. Bringing the mouse closer to the boundary before you click will make the tool smaller and more precise.

{width=”6.5in” height=”3.5972222222222223in”}

If you use this tool to cut the boundary in half, the larger half will be preserved. If you push a line out and then loop back, the central area will be filled in.

{width=”6.5in” height=”3.0416666666666665in”}

Shapes and Regions

These tools are used to highlight specific parts of the image or frame. Unlike with Segmentations, which allow anything to be drawn, a given shape/region will consist of a single geometric object. This can make them more useful for certain types of AI training. [LINK TO EXPLANATION DOC?]

{width=”0.2604166666666667in” height=”0.2916666666666667in”} Line

A line is defined by the location of its two ends. Left-click on one, then on the other.

Note that as with all shapes and regions, drawing a second line will delete the first one. (If your project requires you to draw several lines, they will all have different names.)

{width=”3.827097550306212in” height=”2.674061679790026in”}

{width=”0.4843755468066492in” height=”0.2980774278215223in”}Region

Similar to the Freehand Contour and Sculpt tools, this pair of tools allows you to draw and edit a boundary.

To draw the boundary, left-click and drag, tracing it out. Make sure to bring your mouse back to where you started.

{width=”5.338542213473316in” height=”2.6093832020997376in”}

To edit the boundary, use the sculpting tool to “push” the boundary in or out by left-clicking and dragging. Bringing the mouse closer to the boundary before left-clicking will cause the tool to shrink, allowing for more precise edits.

{width=”6.5in” height=”2.986111111111111in”}

{width=”0.3125in” height=”0.3229166666666667in”} Point

Denotes a single point on the image. Although it is identified with a small circle, the computer only sees the location of the exact centre of the circle.

{width=”3.5108945756780403in” height=”2.4531255468066493in”}

{width=”0.2708333333333333in” height=”0.2604166666666667in”}Circle

Left-click where you want the centre of the circle to be, then move the mouse out. Click again when the circle is at the desired size.

{width=”3.3319958442694664in” height=”2.3281255468066493in”}

{width=”0.23958333333333334in” height=”0.25in”}Rectangle

Left-click where you want one corner of the rectangle to be, then left-click where you want the diagonally opposite corner to be.

{width=”3.570527121609799in” height=”2.494792213473316in”}

{width=”0.3125in” height=”0.3020833333333333in”}Spline

The Spline tool creates a line which curves around a set of points called vertices. To create a spline, left-click to create a vertex at the mouse location. Vertices will be connected in the order in which they are created. Click the first vertex to close the spline (making it a loop), or double-click to finish the spline while leaving it open (a line with a beginning and an end).

{width=”4.166666666666667in” height=”2.90625in”}