Performs object detection on images.
Signature:
export declare class ObjectDetector extends VisionTaskRunner
Extends: VisionTaskRunner
Methods
Method | Modifiers | Description |
---|---|---|
createFromModelBuffer(wasmFileset, modelAssetBuffer) | static |
Initializes the Wasm runtime and creates a new object detector based on the provided model asset buffer. |
createFromModelPath(wasmFileset, modelAssetPath) | static |
Initializes the Wasm runtime and creates a new object detector based on the path to the model asset. |
createFromOptions(wasmFileset, objectDetectorOptions) | static |
Initializes the Wasm runtime and creates a new object detector from the provided options. |
detect(image, imageProcessingOptions) | Performs object detection on the provided single image and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode image . |
|
detectForVideo(videoFrame, timestamp, imageProcessingOptions) | Performs object detection on the provided video frame and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode video . |
|
setOptions(options) | Sets new options for the object detector.Calling setOptions() with a subset of options only affects those options. You can reset an option back to its default value by explicitly setting it to undefined . |
ObjectDetector.createFromModelBuffer()
Initializes the Wasm runtime and creates a new object detector based on the provided model asset buffer.
Signature:
static createFromModelBuffer(wasmFileset: WasmFileset, modelAssetBuffer: Uint8Array): Promise<ObjectDetector>;
Parameters
Parameter | Type | Description |
---|---|---|
wasmFileset | WasmFileset | A configuration object that provides the location of the Wasm binary and its loader. |
modelAssetBuffer | Uint8Array | A binary representation of the model. |
Returns:
Promise<ObjectDetector>
ObjectDetector.createFromModelPath()
Initializes the Wasm runtime and creates a new object detector based on the path to the model asset.
Signature:
static createFromModelPath(wasmFileset: WasmFileset, modelAssetPath: string): Promise<ObjectDetector>;
Parameters
Parameter | Type | Description |
---|---|---|
wasmFileset | WasmFileset | A configuration object that provides the location of the Wasm binary and its loader. |
modelAssetPath | string | The path to the model asset. |
Returns:
Promise<ObjectDetector>
ObjectDetector.createFromOptions()
Initializes the Wasm runtime and creates a new object detector from the provided options.
Signature:
static createFromOptions(wasmFileset: WasmFileset, objectDetectorOptions: ObjectDetectorOptions): Promise<ObjectDetector>;
Parameters
Parameter | Type | Description |
---|---|---|
wasmFileset | WasmFileset | A configuration object that provides the location of the Wasm binary and its loader. |
objectDetectorOptions | ObjectDetectorOptions | The options for the Object Detector. Note that either a path to the model asset or a model buffer needs to be provided (via baseOptions ). |
Returns:
Promise<ObjectDetector>
ObjectDetector.detect()
Performs object detection on the provided single image and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode image
.
Signature:
detect(image: ImageSource, imageProcessingOptions?: ImageProcessingOptions): DetectionResult;
Parameters
Parameter | Type | Description |
---|---|---|
image | ImageSource | An image to process. |
imageProcessingOptions | ImageProcessingOptions | the ImageProcessingOptions specifying how to process the input image before running inference. A result containing a list of detected objects. |
Returns:
ObjectDetector.detectForVideo()
Performs object detection on the provided video frame and waits synchronously for the response. Only use this method when the ObjectDetector is created with running mode video
.
Signature:
detectForVideo(videoFrame: ImageSource, timestamp: number, imageProcessingOptions?: ImageProcessingOptions): DetectionResult;
Parameters
Parameter | Type | Description |
---|---|---|
videoFrame | ImageSource | A video frame to process. |
timestamp | number | The timestamp of the current frame, in ms. |
imageProcessingOptions | ImageProcessingOptions | the ImageProcessingOptions specifying how to process the input image before running inference. A result containing a list of detected objects. |
Returns:
ObjectDetector.setOptions()
Sets new options for the object detector.
Calling setOptions()
with a subset of options only affects those options. You can reset an option back to its default value by explicitly setting it to undefined
.
Signature:
setOptions(options: ObjectDetectorOptions): Promise<void>;
Parameters
Parameter | Type | Description |
---|---|---|
options | ObjectDetectorOptions | The options for the object detector. |
Returns:
Promise<void>