UniversalEmbedder performs multimodal embedding extraction directly using LiteRT LM.
Signature:
export declare class UniversalEmbedder
Methods
| Method | Modifiers | Description |
|---|---|---|
| createFromOptions(wasmFileset, options) | static |
Initializes the Wasm runtime and creates a new UniversalEmbedder instance. |
| createWebGpuDevice() | static |
Creates a WebGPU device for GPU-accelerated universal multimodal embedding. |
| createFromModelBuffer(wasmFileset, modelAssetBuffer) | static |
Initializes the Wasm runtime and creates a UniversalEmbedder from a model buffer. |
| createFromModelPath(wasmFileset, modelAssetPath) | static |
Initializes the Wasm runtime and creates a UniversalEmbedder from a model path. |
| embedText(text) | Performs embedding extraction on the input text. | |
| embedImage(imageBytes) | Performs embedding extraction on raw image bytes. | |
| embedAudio(audioData) | Performs embedding extraction on audio float samples. | |
| embedContent(content) | Performs embedding extraction on multimodal content parts. | |
| cosineSimilarity(u, v) | static |
Computes cosine similarity between two embeddings. |
| getProvider() | Returns an EmbeddingProvider for this embedder. | |
| close() | Shuts down the UniversalEmbedder and releases resources. |
UniversalEmbedder.createFromOptions()
Initializes the Wasm runtime and creates a new UniversalEmbedder instance.
Signature:
static createFromOptions(wasmFileset: WasmFileset, options: UniversalEmbedderOptions): Promise<UniversalEmbedder>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| wasmFileset | WasmFileset | |
| options | UniversalEmbedderOptions |
Returns:
Promise<UniversalEmbedder>
UniversalEmbedder.createWebGpuDevice()
Creates a WebGPU device for GPU-accelerated universal multimodal embedding.
Signature:
static createWebGpuDevice(): Promise<GPUDevice>;
Returns:
Promise<GPUDevice>
UniversalEmbedder.createFromModelBuffer()
Initializes the Wasm runtime and creates a UniversalEmbedder from a model buffer.
Signature:
static createFromModelBuffer(wasmFileset: WasmFileset, modelAssetBuffer: Uint8Array | ReadableStreamDefaultReader): Promise<UniversalEmbedder>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| wasmFileset | WasmFileset | |
| modelAssetBuffer | Uint8Array | ReadableStreamDefaultReader |
Returns:
Promise<UniversalEmbedder>
UniversalEmbedder.createFromModelPath()
Initializes the Wasm runtime and creates a UniversalEmbedder from a model path.
Signature:
static createFromModelPath(wasmFileset: WasmFileset, modelAssetPath: string | string): Promise<UniversalEmbedder>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| wasmFileset | WasmFileset | |
| modelAssetPath | string | string |
Returns:
Promise<UniversalEmbedder>
UniversalEmbedder.embedText()
Performs embedding extraction on the input text.
Signature:
embedText(text: string): Promise<UniversalEmbedderResult>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| text | string |
Returns:
Promise<UniversalEmbedderResult>
UniversalEmbedder.embedImage()
Performs embedding extraction on raw image bytes.
Signature:
embedImage(imageBytes: Uint8Array): Promise<UniversalEmbedderResult>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| imageBytes | Uint8Array |
Returns:
Promise<UniversalEmbedderResult>
UniversalEmbedder.embedAudio()
Performs embedding extraction on audio float samples.
Signature:
embedAudio(audioData: Float32Array): Promise<UniversalEmbedderResult>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| audioData | Float32Array |
Returns:
Promise<UniversalEmbedderResult>
UniversalEmbedder.embedContent()
Performs embedding extraction on multimodal content parts.
Signature:
embedContent(content: readonly ContentPart[]): Promise<UniversalEmbedderResult>;
Parameters
| Parameter | Type | Description |
|---|---|---|
| content | readonly ContentPart[] |
Returns:
Promise<UniversalEmbedderResult>
UniversalEmbedder.cosineSimilarity()
Computes cosine similarity between two embeddings.
Signature:
static cosineSimilarity(u: Embedding, v: Embedding): number;
Parameters
| Parameter | Type | Description |
|---|---|---|
| u | Embedding | |
| v | Embedding |
Returns:
number
UniversalEmbedder.getProvider()
Returns an EmbeddingProvider for this embedder.
Signature:
getProvider(): EmbeddingProvider;
Returns:
EmbeddingProvider
UniversalEmbedder.close()
Shuts down the UniversalEmbedder and releases resources.
Signature:
close(): void;
Returns:
void