This API is provided as a preview for developers and may change based on feedback that we receive. Do not use this API in a production environment.
Encapsulates configuration for on-device inference.
Signature:
export interface OnDeviceParams
Properties
| Property | Type | Description |
|---|---|---|
| createOptions | LanguageModelCreateOptions | (Public Preview) |
| promptOptions | LanguageModelPromptOptions | (Public Preview) |
OnDeviceParams.createOptions
This API is provided as a preview for developers and may change based on feedback that we receive. Do not use this API in a production environment.
Signature:
createOptions?: LanguageModelCreateOptions;
OnDeviceParams.promptOptions
This API is provided as a preview for developers and may change based on feedback that we receive. Do not use this API in a production environment.
Signature:
promptOptions?: LanguageModelPromptOptions;