GPUs
The parallel processors that train and serve modern models. In a posting, the word marks a role that works close to the hardware.
Hiring data as of September 20, 2026 · refreshed daily
- companies naming it
- 5 of 47companies naming it
- open roles naming it
- 19open roles naming it
- of those based in NYC
- 12of those based in NYC
- median posted base (n=10)
- $238kmedian posted base (n=10)
What GPUs means
Graphics processing units run the large matrix operations that neural networks consist of, thousands at a time. Training and serving modern models depends on them, and on the software that makes them usable — CUDA, kernel libraries, and the schedulers that share scarce capacity across teams.
Most AI application engineers never touch a GPU directly; the provider’s API hides it. The people who do are building or optimizing models, running inference infrastructure, or writing the kernels themselves, and that last group is small.
GPUs in New York job posts
5 of the 47 New York AI companies we track name GPUs in at least one open role today, across 19 postings. 12 of those are based in New York; the rest are remote or in the companies’ other offices.
Engineering roles make up 53% of the postings that name it, with the rest spread across other functions.
Modal alone accounts for 13 of the 19 postings, which is why we lead with the company count: one employer’s hiring push should not read as a market trend.
How to read it
A reliable marker of infrastructure, research, or performance roles. It travels with CUDA, vLLM, TensorRT, distributed training, and quantization in the same postings — a cluster that barely overlaps with the agents-and-RAG cluster. Decide which of the two you are before applying to either.
What these roles pay
Midpoints of 10 distinct salary ranges posted on New York roles that name GPUs. Base salary only; on-target earnings are excluded, and a range repeated across one company’s postings counts once. For comparison, the median across all New York engineering postings is $215k. A term’s pay reflects the roles that name it as much as the skill itself — see the role mix below before reading a premium into it. Full bands by function and seniority are in the NYC salary calculator.
Trend
We began extracting this term from posting text on September 20, 2026. Job descriptions disappear when a role is filled, so the series cannot be backfilled; a trend line appears here once a week of data exists.
Who names it
Open roles naming GPUs, by company.
- Modal13
- ElevenLabs2
- Normal Computing2
- K Health1
- Mirage (fka Captions)1
Which roles
The same postings, by function and by seniority.
- Engineering10
- Research5
- Design1
- Operations1
- GTM1
- Other1
- Mid8
- Staff/Principal5
- Senior3
- Entry2
- Manager1
Named alongside GPUs
Terms that appear in the same postings far more often than chance would put them there. The number is how many of the 5 companies pair the two.
- TensorRT 2
- Triton 2
- vLLM 2
- CUDA 3
- Quantization and distillation 3
- SGLang 2
- Distributed training 3
- Reinforcement learning 2
- Inference 4
- Multimodal AI 2
Open roles naming GPUs
A sample from today’s data, New York roles first and one per company before any repeats. Links go to the employer’s own posting. For the full market, see AI jobs in NYC.
- Compute Strategy & Operations Lead ↗Modal · New York
- Research Engineer, Algorithms ↗Normal Computing · New York City
- Research Engineer, Generative Video ↗Mirage (fka Captions) · Union Square, New York City
- HPC Infrastructure Engineer - GPU Clusters ↗ElevenLabs · United States
- Senior DevOps Engineer ↗K Health · Tel-Aviv, IL
- Customer Engineer ↗Modal · New York
- Thermodynamic Hardware Resident ↗Normal Computing · New York City
- Research Engineer - Inference ↗ElevenLabs · United Kingdom
On the AI in NYC Show
- Episode 10: Nvidia vs. AMD and the AI Power Crunch
Doug O’Laughlin, SemiAnalysis
- Episode 7: The Future of AI Hardware
Waleed Atallah, Makora (on air as Mako)
- Episode 33: Refurbished GPUs, Real Infrastructure: Powering the AI Boom
Harris Edelman, Ombligo
How this is counted
Every day we read the open roles on the public job boards of the New York AI companies in our coverage — the NYC AI 100 and the AI in NYC Show roster. This term is matched against each role’s description after removing the text a company repeats across its postings, so an “About us” paragraph cannot tag every role the company has open. A vendor’s own postings never count toward its own name.
The figure means named in a job posting. It does not mean used in production, and a “nice to have” counts the same as a requirement. Companies are the headline number because posting counts are dominated by whichever few employers are hiring hardest this month.
Full method, including the pay rules, is on the glossary index; the underlying series is the NYC AI Hiring Index.
GPUs — common questions
What does GPUs mean in an AI job posting?
The parallel processors that train and serve modern models. In a posting, the word marks a role that works close to the hardware. A reliable marker of infrastructure, research, or performance roles. It travels with CUDA, vLLM, TensorRT, distributed training, and quantization in the same postings — a cluster that barely overlaps with the agents-and-RAG cluster. Decide which of the two you are before applying to either.
How many New York AI companies are hiring for GPUs?
As of September 20, 2026, 5 of the 47 New York AI companies we track name GPUs in the description of at least one open role, across 19 postings (12 based in New York). The count refreshes daily from the companies’ own job boards.
What do roles that ask for GPUs pay in New York?
Across 10 distinct posted salary ranges on New York roles naming GPUs, the median midpoint is $238k base, with the middle half between $215k and $275k. The same figure for all New York engineering postings is $215k. These are employer-posted ranges required by New York’s pay transparency law, base salary only.
Which skills are asked for alongside GPUs?
In the same postings, the terms most distinctively paired with GPUs are TensorRT, Triton, vLLM, CUDA, Quantization and distillation. We rank pairings by how much more often they appear together than apart, so near-universal terms such as Python do not crowd out the informative ones.
Need someone who has actually shipped this?
A keyword in a posting is easy to match and hard to verify. We match companies with AI engineers and consultancies vetted on production work, and tell you when the project needs a different skill than the one you named.
Related Content
NYC AI Hiring Index
Weekly data on who is hiring, and what they post as pay.
AI Jobs in NYC
Open roles pulled daily from company job boards.
NYC AI Engineer Salary Calculator
Posted pay bands by level, employer type, and specialization.
AI Engineer Salary: NYC
What AI engineers earn in New York, honestly told.
How to Get Into AI
Every real path into the industry, mapped honestly.
NYC AI 100
New York’s AI companies, verified and tiered, with live roles.