new·The score now tells you which way it movedA brain's exam only ever grows: its own material writes questions, and so does every question a real caller asked and did not get answered. The score is a percentage over that growing set, so a brain that learned more could post a smaller number — and this week three did. One of them answered two MORE questions than the week before and showed eighteen points less. Printed as a single percentage, that reads as decline to a reader and as punishment to anyone who contributes material.all news →
mozg.beta
Sign in

AI SDK · Providers · all subjects

google-vertex/capabilities

16 notes, read out of this brain and free to use. Each one was extracted from a source and is re-checked against its exam.

Google Vertex transcription API limits

Synchronous API transcribes audio up to one minute or 10 MB, whichever is reached first.

Google Vertex code execution tool

Enable code execution by adding the `code_execution` tool to requests: `tools: { code_execution: googleVertex.tools.codeExecution({}) }`. Certain Gemini models on Vertex AI can generate and execute Python code for calculations, data manipulation, and other tasks.

Google Vertex URL Context tool

Enable URL context by adding `tools: { url_context: googleVertex.tools.urlContext({}) }`. Allows Gemini models to retrieve and analyze content from URLs. Supported models: Gemini 2.5 Flash-Lite, 2.5 Pro, 2.5 Flash, 2.0 Flash.

Google Vertex Google Search tool

Enable Google Search by adding `tools: { google_search: googleVertex.tools.googleSearch({}) }`. Allows Gemini models to access real-time web information. Supported models: Gemini 2.5 Flash-Lite, 2.5 Flash, 2.0 Flash, 2.5 Pro.

Google Vertex Enterprise Web Search tool

Enable Enterprise Web Search by adding `tools: { enterprise_web_search: googleVertex.tools.enterpriseWebSearch({}) }`. Provides grounding using a compliance-focused web index for regulated industries (finance, healthcare, public sector). Does not log customer data and supports VPC service controls. Supported models: Gemini 2.0 and newer.

Google Vertex Google Maps tool

Enable Google Maps by adding `tools: { google_maps: googleVertex.tools.googleMaps({}) }`. Allows Gemini models to access Google Maps data for location-aware responses. Supported models: Gemini 2.5 Flash-Lite, 2.5 Flash, 2.0 Flash, 2.5 Pro, 3.0 Pro. Optional retrievalConfig.latLng provider option provides location context.

Google Vertex file input support

Google Vertex provider supports file inputs (e.g. PDF files). Pass files in message content with type 'file', data as Buffer/ArrayBuffer/Uint8Array, and mediaType. The AI SDK automatically downloads URLs if passed as data, except for gs:// URLs which can be uploaded via Google Cloud Storage API.

Google Vertex implicit caching

Google Vertex supports implicit caching to reduce costs. Structure prompts with consistent content at the beginning. Repeated requests with the same prefix are eligible for cache hits. Cached token count is reported in providerMetadata.vertex.usageMetadata.cachedContentTokenCount.

Google Vertex explicit caching

Explicit caching can be used with Gemini models. Create a cache using Google GenAI SDK with Vertex mode enabled, set model, contents, and ttl. Pass the cache name (format: projects/{project}/locations/{location}/cachedContents/{cachedContent}) to subsequent requests via providerOptions.vertex.cachedContent.

Google Vertex Imagen inpainting support

Image editing is supported by `imagen-3.0-capability-001`. Pass input images via `prompt.images` and optionally a mask via `prompt.mask`. Inpainting mode: EDIT_MODE_INPAINT_INSERTION to insert/replace objects, EDIT_MODE_INPAINT_REMOVAL to remove objects. Set maskMode to MASK_MODE_USER_PROVIDED and maskDilation (recommended 0.01).

Google Vertex Imagen outpainting support

Imagen outpainting extends images beyond original boundaries. Use mode EDIT_MODE_OUTPAINT, set maskMode to MASK_MODE_USER_PROVIDED. Input images must be provided as Buffer, ArrayBuffer, Uint8Array, or base64-encoded strings. URL-based images are not supported.

Google Vertex Gemini image model editing

Gemini image models support image editing. Provide input images via `prompt.images` including URLs and gs:// Cloud Storage URIs. Do not support mask-based inpainting.

Google Vertex video generation frameImages support

Veo supports first-last-frame generation via top-level `frameImages` option. Pass array of objects with image (gs:// URL) and frameType (first_frame or last_frame).

Google Vertex video generation inputReferences support

Veo 3.1 supports reference-to-video generation via top-level `inputReferences` option. Pass array of gs:// Cloud Storage URIs for reference images.

Google Vertex speech model multi-speaker support

Multi-speaker dialogue is available via `providerOptions.googleVertex.multiSpeakerVoiceConfig`.

Google Vertex Gemini models support matrix

Google Vertex Gemini models and their capabilities: gemini-3.1-pro-preview, gemini-3-pro-preview, gemini-2.5-pro, and gemini-2.5-flash all support Image Input, Object Generation, Tool Usage, and Tool Streaming.

Give your agent this brain