Remote Otter LogoRemoteOtter

Part Time AI Software & Hardware Optimization Engineer - Remote

Posted 7 weeks ago
Software Development
Part Time
Worldwide

Overview

We have a cutting-edge AI chatbot powered by Llama 3.2 in production. As we scale, reducing infrastructure GPU costs is a critical priority. Our current setup runs on Nvidia A100 80GB via Runpod, but we’re actively exploring new hardware solutions, including Nvidia Decimals, Apple M4 with unified memory, Tenstorrent, and other emerging AI chips.

We’re looking for an AI Software & Hardware Optimization Engineer who can analyze, adapt, and optimize our existing CUDA-based AI models to run efficiently across different hardware architectures. This is a unique opportunity to work at the intersection of AI software, performance engineering, and next-generation AI hardware.

In Short

  • Optimize AI Model Performance Across Different Hardware
  • AI Hardware Benchmarking & Cost Reduction
  • Model Optimization for Efficient Deployment
  • Infrastructure & Deployment
  • Deep AI Model Optimization Experience
  • Hardware & System-Level Knowledge
  • Inference Optimization & Acceleration
  • Benchmarking & Profiling
  • Nice-to-Have Skills
  • Why Join Us?

Requirements

  • Strong expertise in PyTorch, TensorFlow, and JAX
  • Experience optimizing AI models with CUDA, Metal, ROCm
  • Expert understanding of GPU architectures
  • Experience with alternative AI hardware
  • Hands-on experience with TensorRT, ONNX Runtime
  • Experience with AI performance profiling tools
  • Knowledge of low-level parallelism and AI chip architectures
  • Ability to analyze power efficiency and memory bandwidth
  • Experience with LLM-specific optimizations
  • Familiarity with emerging AI accelerators

Benefits

  • Work on cutting-edge AI infrastructure & next-gen hardware
  • Fully remote, flexible work environment
  • Competitive salary with potential bonuses for cost reductions
  • Opportunity to shape the future of AI model deployment
Livit logo

Livit

Livit is an innovative company that focuses on fostering collaboration and skill development in the field of artificial intelligence. Through initiatives like the Benevolent AI Challenge, Livit provides opportunities for tech-savvy students and professionals to enhance their English communication skills, develop valuable soft skills, and gain real-world experience in a remote, international environment. Participants can earn certificates and potentially secure part-time job opportunities, all while working on impactful AI projects.

Share This Job!

Save This Job!

Similar Jobs:

Algolia

Junior Software Engineer, Optimization - Remote

Algolia

2 weeks ago

Join Algolia as a Junior Software Engineer to enhance AI-driven features and deliver robust analytics and A/B testing tools.

Worldwide
Full-time
Software Development
VORKIS knows what employer wants logo

Software Engineer (Part-time/Full-time) - Remote

VORKIS knows what employer wants

4 weeks ago

Join TechSphere Innovations as a Software Engineer, responsible for developing software applications and ensuring product quality.

USA
Contract
Software Development
$126,129 - $171,801/year
Attentive logo

Principal Software Engineer, Search Optimization - Remote

Attentive

14 weeks ago

Join Attentive as a Principal Software Engineer to lead the development of distributed data applications and enhance client engagement through personalized marketing.

US
Full-time
Software Development
robusta logo

Optimizely Software Engineer - Remote

robusta

5 weeks ago

Join Octopus by RTG as an Optimizely Software Engineer to design and develop web applications while collaborating with cross-functional teams.

Egypt
Full-time
Software Development
Flock Safety logo

Hardware in the Loop Automation Software Engineer - Remote

Flock Safety

8 weeks ago

Join Flock Safety as a Hardware in the Loop Automation Software Engineer to enhance connectivity testing and validation while working remotely with some travel.

USA
Full-time
Software Development
$100,000 - $137,000/year