sendVideoRealtime
Sends a video frame to the model, using the realtime API.
Instead of raw video data, the model expects individual frames of the video, sent as images.
If your video has audio, send it separately through sendAudioRealtime.
For better performance, frames can also be sent at a lower rate than the video; even as low as 1 frame per second.
Parameters
Encoded image data extracted from a frame of the video, used to update the model on the client's conversation, with the corresponding IANA standard MIME type of the video frame data (for example, image/png, image/jpeg, and so on).
Sends a video frame to the model, using the realtime API.
Instead of raw video data, the model expects individual frames of the video, sent as images.
If your video has audio, send it separately through sendAudioRealtime.
For better performance, frames can also be sent at a lower rate than the video; even as low as 1 frame per second.
Parameters
Encoded image data extracted from a frame of the video, used to update the model on the client's conversation, with the corresponding IANA standard MIME type of the video frame data (for example, image/png, image/jpeg, and so on).
Sends a video frame to the model, using the realtime API.
Instead of raw video data, the model expects individual frames of the video, sent as images.
If your video has audio, send it separately through sendAudioRealtime.
For better performance, frames can also be sent at a lower rate than the video; even as low as 1 frame per second.
Parameters
Encoded image data extracted from a frame of the video, used to update the model on the client's conversation, with the corresponding IANA standard MIME type of the video frame data (for example, image/png, image/jpeg, and so on).