ML engineer demand is up 59% since 2020 while general software engineering openings have fallen 49%. Most companies are still hiring as if those numbers were reversed — and that misalignment is exactly why AI searches keep stalling.
The frustration is nearly universal among engineering hiring leaders right now: AI roles sit open for months, promising candidates disappear after the second interview, and the pipeline never quite delivers. The paradox is that roughly 127,000 US-based tech workers lost their jobs throughout 2025 — AI-driven restructuring frequently named as a contributing cause — according to Crunchbase data reported by pin.com. A flooded market and an empty pipeline, at the same time.
That contradiction isn't a paradox — it's a structural mismatch hiding in plain sight in the labor data. There are effectively two tech talent markets operating simultaneously right now, and most hiring strategies are pointed at the one that is contracting.
The Fork in the Labor Market Data
Indeed Hiring Lab's July 2025 analysis makes the divergence impossible to ignore. Demand for machine learning engineers has climbed 59% relative to the February 2020 baseline. General software engineer openings, over that same period, are down 49%. The broader tech market overall sits 36% below pre-pandemic levels, according to data tracked by pin.com.
| Role Category | Demand Change vs. Feb 2020 Baseline |
|---|---|
| Machine Learning Engineer | +59% |
| General Software Engineer | -49% |
| Broader Tech Market (overall) | -36% |
This is not a talent shortage in aggregate. It is a market that has sorted itself sharply by specialization. Companies posting for "software engineers with AI exposure" are competing in a pool that has shrunk by nearly half since 2020. The engineers with genuine ML credentials are in a different pool entirely — one where demand has almost doubled and where candidates understand their leverage clearly.

At the same time, generative AI job postings exploded from fewer than 60 listings in 2021 to just under 10,000 by May 2025, per analysis at dataexec.io. NLP skills now show up in roughly one out of every five AI job postings — making them the single most requested AI competency — and production deployment experience has clearly overtaken model training familiarity as the capability employers actually want to buy. What the market is pricing has shifted considerably from what most job descriptions still describe.
The Compensation Gap No One Budgeted For
When talent pools bifurcate, compensation follows — and right now the spread is wide enough to derail searches that were otherwise well-structured. The Robert Half 2026 Salary Guide pegs the midpoint for AI/ML roles in the middle of the band at $170,750. Peer-reported data on Levels.fyi puts the US average for AI engineers at $245,000.
| Data Source | AI/ML Engineer Benchmark |
|---|---|
| Robert Half 2026 Salary Guide (mid-band median) | $170,750 |
| Levels.fyi (US average, peer-reported) | $245,000 |
That is a gap of roughly $74,000 per hire, and it appears frequently in searches that stall at the offer stage. Organizations that anchored their compensation bands to the Robert Half figure — a reasonable mid-market proxy — are routinely making offers $50,000 to $75,000 below what experienced candidates have already internalized as their market value. The search does not fail because the candidate was uninterested. It fails because the offer did not clear a bar the candidate already knew existed.
This does not mean every AI engineering hire needs to hit the top of what funded AI startups pay. It means compensation strategy has to be calibrated against which specific AI skills the role requires and which talent pool those skills actually come from — not against a single industry-wide median.

Why Your Entry-Level Pipeline Won't Solve This
When senior AI talent proves expensive, many organizations pivot toward aggressive entry-level hiring and internal training. The data suggests that strategy carries its own complications right now.
Entry-level programmer employment fell 27.5% in recent analysis, and new-graduate hiring at major tech companies contracted by more than half, according to data cited by dataexec.io. Large employers have already pulled back substantially from junior pipelines — partly because AI-assisted productivity tools have reduced the volume of entry-level work available, and partly because production AI requires domain judgment that develops with time.
That pullback has a secondary effect worth understanding: the mid-market companies and AI-focused startups are where new graduates and career changers are landing, and those organizations are often developing AI fluency faster than traditional enterprise teams. By the time your internal training program produces candidates ready for production AI work, the engineers you planned to grow may already carry two years of real deployment experience — and compensation expectations to match.
The strategic implication for enterprise companies is sharper than it first appears: the longer the runway to develop AI talent internally without outside support, the further behind the organization falls relative to the teams shipping AI in production today.
How to Restructure Your AI Talent Search
The market signals here point toward concrete adjustments that hiring leaders can make now:
Audit your job titles before you post. A role that requires ML model evaluation, MLOps pipeline management, or LLM integration should be titled and scoped as an ML engineer or AI systems engineer position — not a software engineering role with AI appended in the description. Title precision directly affects both sourcing quality and candidate self-selection, which is the cheapest screening step available.
Recalibrate compensation bands against the specific skills the role requires. NLP, production deployment experience, and LLM integration command rates that differ meaningfully from general Python development. Use the Robert Half 2026 Salary Guide as a floor for mid-market benchmarking, and check Levels.fyi for roles where you are effectively competing with well-funded AI companies for the same candidates.
Stop filtering out mid-market and startup experience. Given that major tech employers have largely withdrawn from new-graduate AI hiring, the engineers who have built genuine production AI experience are doing it at smaller companies. Requiring FAANG tenure as a proxy for AI depth may systematically exclude the candidates who have done the most applied work.
Define what production AI experience means for your context before the first interview. The most common failure point in AI engineering searches right now is a mismatch between what the job description lists and what the interview actually probes. If the role requires taking an LLM integration from prototype to a deployed, monitored endpoint, ask candidates to walk through exactly that scenario — not a general algorithm exercise unrelated to the work.
Treat external AI-fluent engineering capacity as a supply-side option, not a last resort. Amazon now operates with over one million robot workers, according to Ars Technica, which illustrates how rapidly automation is reshaping even the largest organizations. Companies that wait for internal talent development to close the AI skills gap are making a timing bet that the market data does not currently support.
Ryzlink works directly with this problem: a bench of AI-fluent engineers available in 48–72 hours, deployable as a single forward-deployed engineer, a full team pod, or an outcome-based partnership where Ryzlink is accountable for what ships — not just for filling a requisition. For teams that need production AI work to move now, it is worth reviewing what is available at ryzlink.com/jobs.
The AI talent shortage is real. But it is far more specific than most hiring searches currently acknowledge — and considerably more solvable once the search is pointed at the right pool.
Found this useful? Share it
Comments
No comments yet — be the first to share your thoughts.
