RAG (retrieval-augmented generation)

Fetching relevant documents at question time and putting them in the model’s context, so answers come from your data instead of the model’s memory.

Hiring data as of November 4, 2026 · refreshed daily

companies naming it
14 of 47companies naming it
open roles naming it
26open roles naming it
of those based in NYC
16of those based in NYC
median posted base (n=15)
$240kmedian posted base (n=15)

What RAG means

Retrieval-augmented generation answers a question in two moves. First, search a body of documents for the passages most relevant to the question. Second, give those passages to a language model along with the question and have it answer from them. The model’s training data stops being the source of truth; the retrieved text is.

It is the standard way to make a model useful over private or fast-changing information without retraining it. The hard parts are almost all on the retrieval side — how documents are chunked, how relevance is scored, how permissions carry through — which is why RAG work often looks more like search engineering than like machine learning.

RAG in New York job posts

14 of the 47 New York AI companies we track name RAG in at least one open role today, across 26 postings. 16 of those are based in New York; the rest are remote or in the companies’ other offices.

This is engineering vocabulary: 85% of the postings that name it are Engineering roles.

How to read it

A posting that names RAG is telling you the product answers questions over a customer’s documents, and that retrieval quality is a live problem. It pairs closely with vector search and evals in the same descriptions. Expect to be asked how you would measure whether the right passages were retrieved, separately from whether the final answer read well.

Go deeper: when retrieval improves a workflow, and how to ground answers in sources, in the Neuronify AI Field Guide.

What these roles pay

$218k25th percentile
$240kMedian
$260k75th percentile

Midpoints of 15 distinct salary ranges posted on New York roles that name RAG. Base salary only; on-target earnings are excluded, and a range repeated across one company’s postings counts once. For comparison, the median across all New York engineering postings is $216k. A term’s pay reflects the roles that name it as much as the skill itself — see the role mix below before reading a premium into it. Full bands by function and seniority are in the NYC salary calculator.

Companies naming RAG, daily

Count of companies with at least one open role naming the term. We read between 46 and 47 companies a day over this period, so a move of one or two is noise.

012.52514Sep 20Nov 4Sep 20: 20 companiesSep 21: 20 companiesSep 22: 20 companiesSep 23: 20 companiesSep 24: 20 companiesSep 25: 19 companiesSep 26: 19 companiesSep 27: 19 companiesSep 28: 18 companiesSep 29: 18 companiesSep 30: 17 companiesOct 1: 17 companiesOct 2: 17 companiesOct 3: 17 companiesOct 4: 17 companiesOct 5: 17 companiesOct 6: 17 companiesOct 7: 17 companiesOct 8: 17 companiesOct 9: 16 companiesOct 10: 16 companiesOct 11: 16 companiesOct 12: 16 companiesOct 13: 16 companiesOct 14: 16 companiesOct 15: 16 companiesOct 16: 16 companiesOct 17: 16 companiesOct 18: 16 companiesOct 19: 16 companiesOct 20: 16 companiesOct 21: 15 companiesOct 22: 15 companiesOct 23: 16 companiesOct 24: 16 companiesOct 25: 16 companiesOct 26: 17 companiesOct 27: 17 companiesOct 28: 17 companiesOct 29: 17 companiesOct 30: 17 companiesOct 31: 17 companiesNov 1: 17 companiesNov 2: 17 companiesNov 3: 15 companiesNov 4: 14 companies
View as table
Datecompanies
2026-09-2020
2026-09-2120
2026-09-2220
2026-09-2320
2026-09-2420
2026-09-2519
2026-09-2619
2026-09-2719
2026-09-2818
2026-09-2918
2026-09-3017
2026-10-0117
2026-10-0217
2026-10-0317
2026-10-0417
2026-10-0517
2026-10-0617
2026-10-0717
2026-10-0817
2026-10-0916
2026-10-1016
2026-10-1116
2026-10-1216
2026-10-1316
2026-10-1416
2026-10-1516
2026-10-1616
2026-10-1716
2026-10-1816
2026-10-1916
2026-10-2016
2026-10-2115
2026-10-2215
2026-10-2316
2026-10-2416
2026-10-2516
2026-10-2617
2026-10-2717
2026-10-2817
2026-10-2917
2026-10-3017
2026-10-3117
2026-11-0117
2026-11-0217
2026-11-0315
2026-11-0414

Who names it

Open roles naming RAG, by company.

  • Pinecone4
  • AlphaSense3
  • EvolutionIQ3
  • Hyperscience3
  • Hebbia2
  • Invisible Technologies2
  • Ramp2
  • April1
  • Clay1
  • Comet1
  • EliseAI1
  • Maven Clinic1

Also: Mirage (fka Captions), Patlytics.

Which roles

The same postings, by function and by seniority.

  • Engineering22
  • Operations1
  • Other1
  • Design1
  • GTM1
  • Mid9
  • Senior8
  • Staff/Principal7
  • Manager1
  • Entry1

Named alongside RAG

Terms that appear in the same postings far more often than chance would put them there. The number is how many of the 14 companies pair the two.

Open roles naming RAG

A sample from today’s data, New York roles first and one per company before any repeats. Links go to the employer’s own posting. For the full market, see AI jobs in NYC.

How this is counted

Every day we read the open roles on the public job boards of the New York AI companies in our coverage — the NYC AI 100 and the AI in NYC Show roster. This term is matched against each role’s description after removing the text a company repeats across its postings, so an “About us” paragraph cannot tag every role the company has open. A vendor’s own postings never count toward its own name.

The figure means named in a job posting. It does not mean used in production, and a “nice to have” counts the same as a requirement. Companies are the headline number because posting counts are dominated by whichever few employers are hiring hardest this month.

Full method, including the pay rules, is on the glossary index; the underlying series is the NYC AI Hiring Index.

RAG — common questions

What does RAG mean in an AI job posting?

Fetching relevant documents at question time and putting them in the model’s context, so answers come from your data instead of the model’s memory. A posting that names RAG is telling you the product answers questions over a customer’s documents, and that retrieval quality is a live problem. It pairs closely with vector search and evals in the same descriptions. Expect to be asked how you would measure whether the right passages were retrieved, separately from whether the final answer read well.

How many New York AI companies are hiring for RAG?

As of November 4, 2026, 14 of the 47 New York AI companies we track name RAG in the description of at least one open role, across 26 postings (16 based in New York). The count refreshes daily from the companies’ own job boards.

What do roles that ask for RAG pay in New York?

Across 15 distinct posted salary ranges on New York roles naming RAG, the median midpoint is $240k base, with the middle half between $218k and $260k. The same figure for all New York engineering postings is $216k. These are employer-posted ranges required by New York’s pay transparency law, base salary only.

Which skills are asked for alongside RAG?

In the same postings, the terms most distinctively paired with RAG are Vector search, Prompt engineering, MLOps, Fine-tuning, LangChain. We rank pairings by how much more often they appear together than apart, so near-universal terms such as Python do not crowd out the informative ones.

Need someone who has actually shipped this?

A keyword in a posting is easy to match and hard to verify. We match companies with AI engineers and consultancies vetted on production work, and tell you when the project needs a different skill than the one you named.