tasks-vision package

Classes

Enumerations

Interfaces

Variables

Type Aliases

BrushMode

Specifies the polarity or mode of a brush stroke. Represents whether the brush stroke is meant to add, subtract, or lasso from the selection.

Signature:

export declare enum BrushMode

DEFAULT_CATEGORY_TO_COLOR_MAP

A color map with 22 classes. Used in our demos.

Signature:

export declare const DEFAULT_CATEGORY_TO_COLOR_MAP: number[][];

Callback

A user-defined callback to take input data and map it to a custom output value.

Signature:

export declare type Callback<I, O> = (input: I) => O;

CategoryToColorMap

A category to color mapping that uses either a map or an array to assign category indexes to RGBA colors.

Signature:

export declare type CategoryToColorMap = Map<number, RGBAColor> | RGBAColor[];

EmptyPacketListener

A listener that receives the current MediaPipe packet timestamp. This is invoked even for empty packet.

Signature:

declare type EmptyPacketListener = (timestamp: number) => void;

ErrorListener

A listener that will be invoked with an absl::StatusCode and message.

Signature:

declare type ErrorListener = (code: number, message: string) => void;

HolisticLandmarkerCallback

A callback that receives the result from the holistic landmarker detection. The returned result are only valid for the duration of the callback. If asynchronous processing is needed, the masks need to be copied before the callback returns.

Signature:

export declare type HolisticLandmarkerCallback = (result: HolisticLandmarkerResult) => void;

ImageSegmenterCallback

A callback that receives the computed masks from the image segmenter. The returned data is only valid for the duration of the callback. If asynchronous processing is needed, all data needs to be copied before the callback returns.

Signature:

export declare type ImageSegmenterCallback = (result: ImageSegmenterResult) => void;

ImageSource

Valid types of image sources which we can run our GraphRunner over.

Signature:

export declare type ImageSource = TexImageSource;

InteractiveSegmenterLegacyCallback

A callback that receives the computed masks from the interactive segmenter. The returned data is only valid for the duration of the callback. If asynchronous processing is needed, all data needs to be copied before the callback returns.

Signature:

export declare type InteractiveSegmenterLegacyCallback = (result: InteractiveSegmenterLegacyResult) => void;

PoseLandmarkerCallback

A callback that receives the result from the pose detector. The returned masks are only valid for the duration of the callback. If asynchronous processing is needed, the masks need to be copied before the callback returns.

Signature:

export declare type PoseLandmarkerCallback = (result: PoseLandmarkerResult) => void;

RGBAColor

A four channel color with values for red, green, blue and alpha respectively.

Signature:

export declare type RGBAColor = [ number, number, number, number ] | number[];

RunningMode

The two running modes of a vision task. 1) The image mode for processing single image inputs. 2) The video mode for processing decoded frames of a video.

Signature:

declare type RunningMode = "IMAGE" | "VIDEO";

SimpleListener

A listener that receives the contents of a non-empty MediaPipe packet and its timestamp.

Signature:

declare type SimpleListener<T> = (data: T, timestamp: number) => void;

VectorListener

A listener that receives a single element of vector-returning output packet. Receives one element at a time (in order). Once all elements are processed, the listener is invoked with data set to unknown and done set to true. Intended for internal usage.

Signature:

declare type VectorListener<T> = (data: T, done: boolean, timestamp: number) => void;