{"id":3183,"date":"2026-10-03T19:02:07","date_gmt":"2026-10-03T19:02:07","guid":{"rendered":"https:\/\/dmarketertayeeb.com\/blog\/cohere-embed-5-pro-vs-fast\/"},"modified":"2026-10-03T19:02:07","modified_gmt":"2026-10-03T19:02:07","slug":"cohere-embed-5-pro-vs-fast","status":"publish","type":"post","link":"https:\/\/dmarketertayeeb.com\/blog\/cohere-embed-5-pro-vs-fast\/","title":{"rendered":"Cohere Embed 5 Pro vs Fast: Code, Costs and Limits"},"content":{"rendered":"\n

Quick choice:<\/strong> Use Embed 5 Pro when retrieval quality matters most for complex documents. If you index a corpus once and query it often, test Pro for documents and Fast for live queries. Cohere reports a normalized mean nDCG@10 score of 98.4 for this pairing, compared with 100 for Pro on both sides across 40 development datasets. Cohere says the two Embed 5 models share an embedding space, so Pro vectors can be queried with Fast when both sides use the same output dimension. Cohere\u2019s launch results and compatibility note.<\/a><\/p>\n\n\n\n

Which model belongs on each side of retrieval?<\/h2>\n\n\n\n

Cohere positions Pro for quality-first indexing and retrieval over complex, financial, multilingual, or visually rich material. Fast targets latency-sensitive and cost-sensitive workloads such as interactive search and high-volume query traffic. Those are product positions, not a guarantee that one wins on your corpus. See Cohere\u2019s workload guidance.<\/a><\/p>\n\n\n\n

\n\n\n\n
Two model IDs in the Embed 5 shared space. Cohere launch details.<\/a><\/caption>\n
Choice<\/th>API model ID<\/th>Starting point<\/th>Cohere API text rate<\/th><\/tr>\n<\/thead>\n
Embed 5 Pro<\/th>embed-v5.0-pro<\/code><\/td>Offline indexing; quality-critical or complex-document retrieval<\/td>$0.12 per 1M input tokens<\/td><\/tr>\n
Embed 5 Fast<\/th>embed-v5.0-fast<\/code><\/td>Live queries; latency- or volume-sensitive retrieval<\/td>$0.08 per 1M input tokens<\/td><\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n\n\n\n

The text-rate difference is $4 for every 100 million tokens embedded: $12 with Pro or $8 with Fast. This is a token calculation, not a per-request charge. It excludes image input, vector storage, your database, reranking, and generation. Cohere lists image input at $0.40 per million image tokens for both models, so the lower Fast text rate does not change the published image-token rate. See Cohere\u2019s price table.<\/a><\/p>\n\n\n\n

The shared space separates indexing from query choice<\/h2>\n\n\n\n

Cohere says Pro and Fast vectors can be compared directly, so you can choose the corpus encoder and query encoder independently. Its evaluation covers all four combinations below. The score is a mean nDCG@10 normalized to Pro corpus plus Pro query = 100. It is not an absolute score or the share of searches your system will get right.<\/p>\n\n\n\n

\n
\n\"Cohere-reported\n<\/div>\n
Cohere-reported mean nDCG@10 across 40 development datasets spanning text, image, fused, and parsed-document retrieval. Scores are normalized to Pro corpus + Pro query = 100. These are vendor results, not an independent test. See Cohere\u2019s pairing results.<\/a><\/figcaption>\n<\/figure>\n\n\n\n
\n\n\n\n
Exact values from Cohere\u2019s cross-model test; deltas are against Pro\/Pro. Source: Cohere launch results.<\/a><\/caption>\n
Corpus encoder<\/th>Query encoder<\/th>Normalized mean nDCG@10<\/th>Delta vs. Pro\/Pro<\/th><\/tr>\n<\/thead>\n
Pro<\/td>Pro<\/td>100.0<\/td>Reference<\/td><\/tr>\n
Pro<\/td>Fast<\/td>98.4<\/td>\u22121.6<\/td><\/tr>\n
Fast<\/td>Pro<\/td>97.3<\/td>\u22122.7<\/td><\/tr>\n
Fast<\/td>Fast<\/td>96.6<\/td>\u22123.4<\/td><\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n\n\n\n

For a quality-first index with frequent live queries, Pro corpus plus Fast query is Cohere\u2019s recommended mixed pairing. In Cohere\u2019s aggregate, Fast corpus plus Pro query scores 97.3, which is 0.7 normalized points higher than Fast\/Fast at 96.6. Pro corpus plus Fast query scores 98.4, 1.1 points higher than the reverse mix. These small aggregate differences do not establish a universal deployment winner. Cohere\u2019s footnote requires the same output dimension on both sides and reports that the pattern persists with Matryoshka truncation and int8 quantization. See the benchmark setup and conditions.<\/a><\/p>\n\n\n\n

The 40-dataset matrix is a vendor-reported mean. Cohere does not publish per-dataset scores or confidence intervals for this matrix, or the test hardware and latency settings. Treat 98.4 as a trial hypothesis, not a forecast for a different vector store, corpus, or query mix.<\/p>\n\n\n\n

\n\n\n\n
Hypothetical Cohere API text-token costs only. Rates from Cohere\u2019s launch price table<\/a>; no measurement period is assumed.<\/caption>\n
Corpus model<\/th>Query model<\/th>Corpus stage: 100M tokens<\/th>Query stage: 1B tokens<\/th>Combined text cost<\/th><\/tr>\n<\/thead>\n
Pro<\/td>Pro<\/td>$12<\/td>$120<\/td>$132<\/td><\/tr>\n
Pro<\/td>Fast<\/td>$12<\/td>$80<\/td>$92<\/td><\/tr>\n
Fast<\/td>Pro<\/td>$8<\/td>$120<\/td>$128<\/td><\/tr>\n
Fast<\/td>Fast<\/td>$8<\/td>$80<\/td>$88<\/td><\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n\n\n\n

Formula: (corpus tokens \u00f7 1,000,000 \u00d7 corpus rate) + (query tokens \u00f7 1,000,000 \u00d7 query rate). For example, Pro\/Fast is (100 \u00d7 $0.12) + (1,000 \u00d7 $0.08) = $92. This scenario is hypothetical and shows text charges only. It excludes image tokens, storage, database costs, reranking, and generation, and it is not a forecast of real workload spend.<\/p>\n\n\n\n

Check the API contract before changing your index<\/h2>\n\n\n\n

Cohere\u2019s current model reference lists both models with a 128K-token context window, 100+ languages, and text, image, and fused text-plus-image inputs. Both list output dimensions of 256, 512, 768, 1,024, 1,536, and 2,048; the default is 2,048. See Cohere\u2019s model table.<\/a><\/p>\n\n\n\n

For retrieval, set input_type=\"search_document\"<\/code> for corpus content and input_type=\"search_query\"<\/code> for queries. Cohere\u2019s v2 endpoint accepts up to 96 texts or mixed input objects per call. Image inputs are data URIs for JPEG, PNG, WebP, or GIF files; the reference caps combined image payload at 20 MB. Cohere\u2019s mixed-content example sends text and image components together in one input object. The default truncation mode is END<\/code>, which drops excess tokens from the end of an overlong input. Set truncate=\"NONE\"<\/code> when oversized inputs should fail rather than lose their tail. Check the v2 Embed API reference.<\/a><\/p>\n\n\n\n

The Embed 5 launch and model table highlight float, int8, and binary outputs. The current API reference also lists uint8, ubinary, and base64 representations for supported Embed models. The default response is float. Choose an output type and dimension that your vector database can store, and keep corpus and query vectors compatible. If your index schema is fixed at 1,536 dimensions, set that dimension explicitly instead of relying on Embed 5\u2019s 2,048 default. API reference<\/a> and model table<\/a> list the current options.<\/p>\n\n\n\n

Cohere\u2019s direct shared-space statement applies to Embed 5 Pro and Fast. It does not establish compatibility with Embed 4 vectors or embeddings from another model. Matching dimensions alone does not prove semantic compatibility. For an older-model migration, use a separate index or namespace, re-embed documents with the selected Embed 5 corpus encoder and embed new queries with a compatible Embed 5 query encoder, then evaluate before routing production traffic to the new vectors. Cohere\u2019s compatibility statement covers the two Embed 5 variants.<\/a><\/p>\n\n\n\n

\n\n\n\n
Cohere model-table defaults and parameters compared with the published AWS SageMaker parameter tables. Cohere model table<\/a>; AWS Pro listing<\/a>; AWS Fast listing<\/a>.<\/caption>\n
Published interface<\/th>Default output dimension<\/th>Listed output dimensions<\/th>What to verify<\/th><\/tr>\n<\/thead>\n
Cohere Embed 5 model table<\/th>2,048 for Pro and Fast<\/td>256, 512, 768, 1,024, 1,536, 2,048<\/td>Use explicit model, dimension, and output type.<\/td><\/tr>\n
AWS SageMaker Pro parameters<\/th>1,536<\/td>256, 512, 1,024, 1,536<\/td>Pro listing appears out of sync with Cohere\u2019s Embed 5 table.<\/td><\/tr>\n
AWS SageMaker Fast parameters<\/th>1,024<\/td>256, 512, 768, 1,024, 1,536, 2,048<\/td>Fast listing has a different stated default.<\/td><\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n\n\n\n

The AWS Pro parameter table appears out of sync with Cohere\u2019s Embed 5 model table, and AWS lists a different default for Fast. That is an inference from the published-source conflict, not a confirmed endpoint defect. Before moving an index to SageMaker, confirm the selected offer and endpoint\u2019s current model version, allowed parameters, and defaults. Do not assume Cohere API SDK calls or defaults work unchanged on SageMaker or Microsoft Foundry. AWS Pro listing<\/a>, AWS Fast listing<\/a>, and Cohere\u2019s current model table<\/a>.<\/p>\n\n\n\n

The Embed endpoint\u2019s documented inputs are text strings, image data URIs, and mixed content; the current reference does not list a PDF-file field. If you need to turn PDFs into structured text or page content first, see our Cohere Parse guide to PDF ingestion and structured outputs<\/a>. Keep parsing and embedding as separate steps in your estimate.<\/p>\n\n\n\n

Compare the billing unit for your deployment<\/h2>\n\n\n\n

Cohere API, Model Vault, Microsoft Foundry, and Amazon SageMaker expose different cost units. Do not carry the Cohere API token rate over to an instance-based deployment.<\/p>\n\n\n\n

\n\n\n\n
Published billing examples checked October 3\u20134, 2026. Provider units differ. See Cohere pricing<\/a>, the AWS Pro listing<\/a>, and the AWS Fast listing<\/a>.<\/caption>\n
Deployment route<\/th>Embed 5 Pro<\/th>Embed 5 Fast<\/th>Unit and caveat<\/th><\/tr>\n<\/thead>\n
Cohere API<\/th>$0.12 per 1M text tokens; $0.40 per 1M image tokens<\/td>$0.08 per 1M text tokens; $0.40 per 1M image tokens<\/td>Token-based. The accessed Cohere API pricing and API references do not provide a conversion from image files or page count to billed image tokens.<\/td><\/tr>\n
Cohere Model Vault, Small<\/th>$3\/hour or $2,000\/month<\/td>$3\/hour or $2,000\/month<\/td>Per instance.<\/td><\/tr>\n
Cohere Model Vault, Medium<\/th>$5\/hour or $3,250\/month<\/td>$5\/hour or $3,250\/month<\/td>Per instance.<\/td><\/tr>\n
Amazon SageMaker, ml.g5.xlarge real-time example<\/th>$2.39 per host-hour<\/td>$2.39 per host-hour<\/td>Marketplace software charge; AWS infrastructure costs may apply. Other instance types and modes have different rates.<\/td><\/tr>\n
Microsoft Foundry<\/th>Pay-as-you-go token billing<\/td>Pay-as-you-go token billing<\/td>Cohere Azure guidance<\/a> confirms the billing basis but does not state a current rate; check the Foundry offer before budgeting.<\/td><\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n\n\n\n

Cohere lists Embed 5 on its API, Model Vault, Microsoft Foundry, and Amazon SageMaker. It also documents vLLM for private deployments in a customer\u2019s own VPC or on premises; private-deployment pricing is custom. Cohere\u2019s launch announcement lists these availability and private-deployment routes.<\/a> Cohere\u2019s pricing page<\/a> distinguishes per-instance Model Vault rates from token billing. The SageMaker listing price is a software usage charge, with AWS infrastructure billed separately. Azure guidance confirms token billing but does not provide the Foundry rate in the accessed documentation. See Cohere\u2019s Azure guidance.<\/a><\/p>\n\n\n\n

For image-heavy workloads, do not multiply the number of page images by $0.40. Cohere quotes that rate per million image tokens, but the sources checked here do not publish a token conversion for a page or file. Check usage reporting or price a small approved sample before estimating a large image corpus.<\/p>\n\n\n\n

Run a small evaluation on your corpus<\/h2>\n\n\n\n
    \n\n
  1. Choose representative documents and real query types, including cases that matter to your team: tables, scanned pages, multilingual terms, and short interactive searches.<\/li>\n\n\n
  2. Hold parsing, chunking, filters, vector-store settings, output dimension, and precision constant. Compare Pro\/Pro, Pro\/Fast, Fast\/Pro, and Fast\/Fast so the encoder pairing is the change.<\/li>\n\n\n
  3. Measure relevance with labels from your own search tasks. Track query latency separately from indexing throughput, token charges, image-token usage, and vector storage. Decide in advance what quality or latency change you will accept.<\/li>\n\n<\/ol>\n\n\n\n

    Cohere\u2019s launch also reports ViDoRe V3 results with RCP-nDCG@10, a separate measure from the 40-dataset nDCG@10 matrix. Cohere describes RCP-nDCG@10 as evaluating the ordering of a fixed candidate set, so those results do not by themselves show first-stage retrieval from a full corpus. Read Cohere\u2019s explanation of RCP-nDCG@10<\/a> and keep candidate generation in mind when comparing its scores.<\/p>\n\n\n\n

    Cohere API example: Pro documents and Fast queries<\/h2>\n\n\n\n

    Prerequisites: install the official SDK and NumPy with pip install cohere numpy<\/code>, then set CO_API_KEY<\/code> in the process environment. This Cohere v2 example uses Pro for search_document<\/code>, Fast for search_query<\/code>, and the same 1,024-dimensional float output on both sides. It ranks an illustrative three-document corpus by cosine similarity. The method follows Cohere\u2019s launch example and v2 API reference. Cohere launch sample<\/a>; v2 Embed API.<\/a><\/p>\n\n\n\n

    import os\nimport cohere\nimport numpy as np\n\nclient = cohere.ClientV2(api_key=os.environ[\"CO_API_KEY\"])\n\ndocuments = [\n    \"Annual report: operating expenses rose 8 percent.\",\n    \"Maintenance guide: inspect the compressor every 90 days.\",\n    \"Leave policy: employees accrue 1.5 paid days per month.\",\n]\n\ndoc_embeddings = client.embed(\n    model=\"embed-v5.0-pro\",\n    input_type=\"search_document\",\n    texts=documents,\n    output_dimension=1024,\n    embedding_types=[\"float\"],\n    truncate=\"NONE\",\n).embeddings.float_\n\nquery = \"How often should the compressor be inspected?\"\nquery_embedding = client.embed(\n    model=\"embed-v5.0-fast\",\n    input_type=\"search_query\",\n    texts=[query],\n    output_dimension=1024,\n    embedding_types=[\"float\"],\n    truncate=\"NONE\",\n).embeddings.float_[0]\n\ndoc_vectors = np.asarray(doc_embeddings)\nquery_vector = np.asarray(query_embedding)\ncosine_scores = doc_vectors @ query_vector \/ (\n    np.linalg.norm(doc_vectors, axis=1) * np.linalg.norm(query_vector)\n)\nfor index in np.argsort(cosine_scores)[::-1][:2]:\n    print(f\"{cosine_scores[index]:.3f} {documents[index]}\")<\/code><\/pre>\n\n\n\n
    Execution status:<\/strong> This API example was not executed by DMT. The document set is illustrative; no observed match, returned score, throughput, or latency is claimed.<\/p>\n\n\n\n
    AI assistance disclosure:<\/strong> AI tools assisted with source review and drafting. DMT did not run the Cohere API example or independently reproduce Cohere\u2019s benchmark. All benchmark scores above are labeled as Cohere-reported.<\/p>\n","protected":false},"excerpt":{"rendered":"
    Compare Cohere Embed 5 Pro and Fast with a source-checked API example, hypothetical token costs, pairing scores and deployment compatibility limits.<\/p>\n","protected":false},"author":1,"featured_media":3181,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[178],"tags":[365,300,314,273],"class_list":["post-3183","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","tag-ai-benchmarks","tag-ai-models","tag-ai-pricing","tag-ai-search","has-featured-image"],"_links":{"self":[{"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/posts\/3183","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/comments?post=3183"}],"version-history":[{"count":0,"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/posts\/3183\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/media\/3181"}],"wp:attachment":[{"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/media?parent=3183"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/categories?post=3183"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dmarketertayeeb.com\/blog\/wp-json\/wp\/v2\/tags?post=3183"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}