Software Engineer - ML Inference
Predibase
Date: 2 days ago
City: Santa Rosa, CA
Contract type: Full time
We're looking to hire a software engineer working at the intersection of AI / ML and systems programming to develop our next generation LLM Inference Engine. As an engineer working on our ML Inference team, you will work to integrate new LLM inference techniques from the research to improve latency and throughput of LLM serving systems, you'll work closely with customers to optimize performance on specific use cases, and go deep into performance optimizations at multiple levels of the stack, including: PyTorch, C++, and CUDA. As part of the role, you will have significant technical leadership responsibilities to define the roadmap and technical vision of our inference stack, and work closely with partner teams to build scalable, multi-replica serving infrastructure.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Lifestyle Apartment Regional Manager
Jackson Square Properties,
Santa Rosa, CA
23 hours ago
ExperienceJackson Square Properties is seeking a candidate with five to seven years of multi-site Class A apartment management experience, with an emphasis on “lifestyle” living, to train to take the next step into Real Estate management.OverviewBased in San Francisco, Jackson Square Properties (JSP) is a private equity real estate investment company that specializes in multi-family properties. The company has grown...
Content Marketing & SEO Manager
VisitorsCoverage Inc.,
Santa Rosa, CA
2 days ago
Come join VisitorsCoverage, one of Silicon Valley's most successful InsurTech companies, certified as a Great Place to Work!As a Content & SEO Manager, you’ll be responsible for creating and managing high-quality, engaging content that drives organic growth and enhances brand visibility. As a key contributor to our content strategy, you’ll develop diverse content types, including articles, blog posts, press releases,...
Community Relationships & Engagement Manager
LBAN/Latino Business Action Network,
Santa Rosa, CA
$100,000
-
$130,000
per year
2 days ago
About The Latino Business Action NetworkLBAN is a dynamic Silicon Valley-based nonprofit with a big mission to strengthen the U.S. economy by empowering Latino entrepreneurship across the country. We are a nonprofit 501 (c) (3) organization with a national reach. In the last 10 years, Latinos created half the new companies in the U.S. LBAN leverages the best of Stanford...