Skip to main content
McCarthy Search

Founder VP AI Inference (SW)

L8

blue signal searchKnoxville, TN4 days ago

Occupations

Computer Systems Engineers/ArchitectsComputer and Information Systems ManagersSoftware Developers

Industries

Software PublishersCustom Computer Programming ServicesComputer Systems Design Services
Founder VP AI Inference (SW) Remote, Nationwide A confidential, venture-backed AI systems company is hiring a senior software leader to help shape the next era of high-performance inference. This is a rare opportunity to step into a founder-level seat where you can influence architecture, team design, product direction, and the long-term path from software acceleration into programmable hardware and future silicon. The ideal candidate brings deep technical judgment, strong leadership presence, and the ability to build credibility with elite engineers, founders, and external partners alike.
What You Will Do: Lead architecture and delivery of a high-performance AI inference software stack spanning runtime, scheduling, serving, and system optimization. Build and mentor a small elite engineering team while remaining hands on with code, technical design, and execution. Partner with founders to shape product roadmap, infrastructure strategy, and the path from software acceleration into programmable hardware and future silicon. Improve throughput, latency, utilization, and cost efficiency across modern accelerator-based deployments and distributed environments. Work closely with strategic customers and ecosystem partners to support real world production adoption and performance tuning. Establish engineering standards for hiring, release quality, experimentation, and cross functional collaboration in a fast-moving startup setting.
What We Are Looking For:
  • Deep experience building or optimizing production scale AI inference or distributed systems software for accelerator rich environments.
  • Strong systems background in one or more of GPU programming, kernel optimization, runtime design, communication layers, caching, batching, or scheduling.
  • Track record of shipping technically difficult platforms where performance, reliability, and scalability all matter.
  • Experience leading senior engineers and attracting top talent, with the judgment to balance urgency and long-term architecture.
  • Familiarity with modern model serving patterns, speculative execution approaches, and performance measurement for large scale AI workloads.
  • Comfortable operating in an early-stage company where ambiguity is high and leaders help define the playbook.
  • What Makes This Opportunity Stand OutFounder-level influence on both technical strategy and team formation.
  • Meaningful exposure to cutting edge AI infrastructure work with real production impact.
  • High autonomy, direct access to leadership, and room to shape the function without heavy micromanagement.
  • Competitive executive compensation and meaningful equity participation.
  • Opportunity to help define how advanced inference software evolves alongside next generation hardware initiatives.
  • About Blue Signal:
  • Blue Signal is an award-winning, executive search firm specializing in various specialties. Our recruiters have a proven track record of placing top-tier talent across industry verticals, with deep expertise in numerous professional services. Learn more at bit.ly/46Gs4yS
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

DirectorL8

Location

Knoxville, TN

Occupation

Computer Systems Engineers/Architects

Industry

Software Publishers

Posted

4 days ago

To get sharper similar jobs, create your profile using the link below.

Create profile