Principal Software Engineer - AI Platforms & Communications - Remote

Overview

Weave is searching for a Principal Engineer who can set technical vision, drive cross‑team execution, and mentor engineers while solving hard, high‑scale problems. You will architect and evolve the AI platform that powers our voice, text, and email products—bringing together LLMs, retrieval‑augmented generation (RAG), vector search, and multi‑tenant data pipelines to help millions of providers serve hundreds of millions of patients every day.

In Short

• Set architecture & strategy for multi‑tenant, AI‑powered communications services (voice, SMS, email).
• Design and build RAG pipelines, vector‑store–backed retrieval layers, and fine‑tuning workflows that deliver low‑latency, context‑aware experiences.
• Lead end‑to‑end platform initiatives: data ingestion, event processing, model hosting, continuous evaluation, and cost/latency optimization.
• Champion best practices for LLM safety, prompt management, experiment tracking, observability, and auto‑scaling.
• Influence roadmaps across Product, Design, and multiple engineering squads; unblock teams with reusable SDKs, templates, and reference architectures.
• Mentor & level‑up senior and staff engineers; foster a culture of ownership, experimentation, and inclusive collaboration.

Requirements

• 10+ years building distributed, customer‑facing systems; 3+ years designing ML or LLM production workloads at scale.
• Proven success with LLMs, RAG architectures, vector databases (e.g., Pinecone, Weaviate, PG Vector), embedding models, and fine‑tuning techniques.
• Deep knowledge of multi‑tenant SaaS patterns, data isolation, and usage‑based cost modeling.
• Fluency in at least one of Go, Python, or Java (Go/Python preferred) plus modern cloud stacks (GCP or AWS).
• Experience integrating or operating communications stacks—SIP/WebRTC for voice, SMS gateways, and transactional email services.
• Expertise in Kubernetes, IaC/GitOps, observability, and CI/CD for high‑compliance environments (HIPAA/PCI).
• Track record of shipping large, cross‑org initiatives on time and mentoring others to do the same.

Benefits

• Prior work with conversation intelligence, speech‑to‑text, or generative voice synthesis.
• Hands‑on with Dagster/Kubeflow, Triton, or similar model‑ops tooling.
• Contributions to open‑source AI/ML or communications projects.