Machine Learning Hardware Engineer - Remote

Overview

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Machine Learning Hardware Engineer in India.

In this role, you will be responsible for designing, developing, and optimizing enterprise-grade retrieval-augmented generation (RAG) systems and AI infrastructure. You will work on end-to-end AI pipelines, integrating large language models with advanced retrieval systems, and ensuring high-performance, scalable solutions in production. The position involves hands-on development in Python and Golang/Rust, deploying solutions on cloud platforms, and implementing hybrid search, embeddings, and semantic ranking strategies. You will collaborate with cross-functional teams, guide other engineers, and implement best practices for AI workflows and RAG architectures. This is a high-impact role for candidates passionate about pushing the boundaries of AI hardware and software integration while working in a fast-paced, innovative environment.

In Short

• Lead the design and implementation of RAG architectures to ensure reliability, scalability, and low-latency performance.
• Develop and optimize multi-stage AI pipelines using LLM orchestration frameworks such as LangChain, LangGraph, or LlamaIndex.
• Build high-performance services and APIs in Python and Golang/Rust to support AI workflows, document ingestion, and retrieval processes.
• Implement hybrid search strategies, vector embeddings, and semantic ranking to improve contextual accuracy.
• Design, iterate, and optimize prompts for domain-specific applications, including few-shot and tool-augmented prompts.
• Collaborate with cross-functional teams, mentor engineers, and establish KPIs for RAG pipeline and model performance.

Requirements

• Strong experience in machine learning and AI infrastructure.
• Proficiency in Python and Golang/Rust.
• Experience with cloud platforms for deployment.
• Knowledge of hybrid search and semantic ranking techniques.
• Ability to work collaboratively in cross-functional teams.
• Strong problem-solving and optimization skills.

Benefits

• Opportunity to work on cutting-edge AI technologies.
• Collaborative and innovative work environment.
• Professional development and mentoring opportunities.
• Flexible work arrangements.
• Competitive salary and benefits package.