LLMs (large language models)
Models trained on very large text corpora to predict the next token, which turns out to be enough to write, summarize, extract, translate, and reason over language.
Hiring data as of November 4, 2026 · refreshed daily
- companies naming it
- 38 of 47companies naming it
- open roles naming it
- 240open roles naming it
- of those based in NYC
- 128of those based in NYC
- median posted base (n=80)
- $215kmedian posted base (n=80)
What LLMs means
A large language model is a neural network trained to predict the next token in a sequence, at a scale where that single skill generalizes into writing, summarizing, classifying, extracting structured data, and working through multi-step problems. GPT, Claude, Gemini, and Llama are all LLMs. Most companies never train one; they call a provider’s model through an API and build the product around it.
That shift is why the term shows up far outside research teams. Working with LLMs in 2026 mostly means application engineering: choosing a model for the cost and latency you can afford, shaping what goes into the context window, checking outputs, and handling the cases where the model is confidently wrong.
LLMs in New York job posts
38 of the 47 New York AI companies we track name LLMs in at least one open role today, across 240 postings. 128 of those are based in New York; the rest are remote or in the companies’ other offices.
Engineering roles make up 51% of the postings that name it, with the rest spread across other functions.
How to read it
When a posting names LLMs without naming a provider or a technique, it is describing the product surface, not the skill. Read the rest of the description for the real requirement — evals, retrieval, agents, or serving — and expect the interview to probe whether you have shipped something on a model rather than prompted one.
Go deeper: how to choose a model for a specific task, in the Neuronify AI Field Guide.
What these roles pay
Midpoints of 80 distinct salary ranges posted on New York roles that name LLMs. Base salary only; on-target earnings are excluded, and a range repeated across one company’s postings counts once. For comparison, the median across all New York engineering postings is $216k. A term’s pay reflects the roles that name it as much as the skill itself — see the role mix below before reading a premium into it. Full bands by function and seniority are in the NYC salary calculator.
Companies naming LLMs, daily
Count of companies with at least one open role naming the term. We read between 46 and 47 companies a day over this period, so a move of one or two is noise.
View as table
| Date | companies |
|---|---|
| 2026-09-20 | 40 |
| 2026-09-21 | 40 |
| 2026-09-22 | 40 |
| 2026-09-23 | 40 |
| 2026-09-24 | 39 |
| 2026-09-25 | 37 |
| 2026-09-26 | 37 |
| 2026-09-27 | 37 |
| 2026-09-28 | 37 |
| 2026-09-29 | 37 |
| 2026-09-30 | 38 |
| 2026-10-01 | 38 |
| 2026-10-02 | 38 |
| 2026-10-03 | 38 |
| 2026-10-04 | 38 |
| 2026-10-05 | 38 |
| 2026-10-06 | 38 |
| 2026-10-07 | 38 |
| 2026-10-08 | 38 |
| 2026-10-09 | 37 |
| 2026-10-10 | 37 |
| 2026-10-11 | 37 |
| 2026-10-12 | 37 |
| 2026-10-13 | 37 |
| 2026-10-14 | 37 |
| 2026-10-15 | 37 |
| 2026-10-16 | 37 |
| 2026-10-17 | 37 |
| 2026-10-18 | 37 |
| 2026-10-19 | 37 |
| 2026-10-20 | 37 |
| 2026-10-21 | 36 |
| 2026-10-22 | 36 |
| 2026-10-23 | 36 |
| 2026-10-24 | 36 |
| 2026-10-25 | 36 |
| 2026-10-26 | 37 |
| 2026-10-27 | 37 |
| 2026-10-28 | 37 |
| 2026-10-29 | 37 |
| 2026-10-30 | 38 |
| 2026-10-31 | 38 |
| 2026-11-01 | 38 |
| 2026-11-02 | 38 |
| 2026-11-03 | 37 |
| 2026-11-04 | 38 |
Who names it
Open roles naming LLMs, by company.
- AlphaSense36
- ElevenLabs26
- Rogo26
- Ramp17
- Hebbia14
- Headway12
- Normal Computing12
- Invisible Technologies9
- Patlytics9
- Modal8
- Clay7
- Basis6
Also: EliseAI, EvolutionIQ, Runway, Mirage (fka Captions), Hyperscience, K Health, Maven Clinic, Spade, Tabs, Alloy, Anterior, Attentive, Grow Therapy, Pinecone, Preql, Tennr, Andela, April, Arthur, Comet, Hume AI, Kustomer, Norm Ai, Rillet, Sixfold, Vic.ai.
Which roles
The same postings, by function and by seniority.
- Engineering123
- GTM48
- Product17
- Research16
- Operations13
- Other11
- Mid147
- Senior52
- Staff/Principal28
- Manager6
- Entry5
- Director2
Named alongside LLMs
Terms that appear in the same postings far more often than chance would put them there. The number is how many of the 38 companies pair the two.
Open roles naming LLMs
A sample from today’s data, New York roles first and one per company before any repeats. Links go to the employer’s own posting. For the full market, see AI jobs in NYC.
- Account Executive ↗Patlytics · New York
- Account Executive - Enterprise - Consumer Brands ↗ElevenLabs · New York
- AI Research Resident (Algorithms Codesign) ↗Normal Computing · New York
- AI Strategist ↗Hebbia · NYC
- Analytics Engineer ↗Modal · New York
- Applied AI Engineer ↗Ramp · New York, NY (HQ)
- Applied AI Engineer (Full-Stack) ↗Pinecone · New York City
- Data Engineer ↗K Health · New York, NY
On the AI in NYC Show
- Episode 25: AI Storytelling, AGI Hype, and Creative Worlds
Hilary Mason, Hidden Door
How this is counted
Every day we read the open roles on the public job boards of the New York AI companies in our coverage — the NYC AI 100 and the AI in NYC Show roster. This term is matched against each role’s description after removing the text a company repeats across its postings, so an “About us” paragraph cannot tag every role the company has open. A vendor’s own postings never count toward its own name.
The figure means named in a job posting. It does not mean used in production, and a “nice to have” counts the same as a requirement. Companies are the headline number because posting counts are dominated by whichever few employers are hiring hardest this month.
Full method, including the pay rules, is on the glossary index; the underlying series is the NYC AI Hiring Index.
LLMs — common questions
What does LLMs mean in an AI job posting?
Models trained on very large text corpora to predict the next token, which turns out to be enough to write, summarize, extract, translate, and reason over language. When a posting names LLMs without naming a provider or a technique, it is describing the product surface, not the skill. Read the rest of the description for the real requirement — evals, retrieval, agents, or serving — and expect the interview to probe whether you have shipped something on a model rather than prompted one.
How many New York AI companies are hiring for LLMs?
As of November 4, 2026, 38 of the 47 New York AI companies we track name LLMs in the description of at least one open role, across 240 postings (128 based in New York). The count refreshes daily from the companies’ own job boards.
What do roles that ask for LLMs pay in New York?
Across 80 distinct posted salary ranges on New York roles naming LLMs, the median midpoint is $215k base, with the middle half between $185k and $250k. The same figure for all New York engineering postings is $216k. These are employer-posted ranges required by New York’s pay transparency law, base salary only.
Which skills are asked for alongside LLMs?
In the same postings, the terms most distinctively paired with LLMs are Prompt engineering, RAG, Vector search, Tool use, MLOps. We rank pairings by how much more often they appear together than apart, so near-universal terms such as Python do not crowd out the informative ones.
Need someone who has actually shipped this?
A keyword in a posting is easy to match and hard to verify. We match companies with AI engineers and consultancies vetted on production work, and tell you when the project needs a different skill than the one you named.
Related Content
NYC AI Skill Map
Which kinds of NYC AI company hire for which skills, and what is rising.
NYC AI Hiring Index
Weekly data on who is hiring, and what they post as pay.
AI Jobs in NYC
Open roles pulled daily from company job boards.
NYC AI Engineer Salary Calculator
Posted pay bands by level, employer type, and specialization.
AI Engineer Salary: NYC
What AI engineers earn in New York, honestly told.
NYC AI 100
New York’s AI companies, verified and tiered, with live roles.