Research Scientist / Engineer – Data - Remote

Posted 6 weeks ago

Data Analysis

Full Time

CA, USA

Python

PyTorch

Multimodal Data Processing

Computer Vision

Audio Processing

Natural Language Processing

Vision Language Models

Audio Language Models

Generative Video Models

Overview

Data is a fundamental layer in Luma that unlocks advanced capabilities in our foundation models. We tackle the fundamental data questions around how different modalities can be combined to enable new behaviors and capabilities, working on the open-ended challenges of what makes multimodal AI systems truly powerful and versatile.

In Short

Identify capability gaps and research solutions
Design datasets and data-mixture ablations to systematically improve model capabilities across vision, audio, and language
Develop evaluation frameworks and benchmarking approaches for multimodal AI capabilities
Create prototypes and demonstrations that showcase new multimodal capabilities

Requirements

Strong programming skills in Python and PyTorch
Experience with large-scale dataset
Experience with multimodal data processing pipeline
Understanding of computer vision, audio processing, and / or natural language processing techniques
(Preferred) Expertise working with interleaved multimodal data
(Preferred) Hands-on experience with Vision Language Models, Audio Language Models, or generative video models

Benefits

To be determined

Luma AI

Luma Ai is dedicated to advancing the field of artificial intelligence through the development of multimodal systems that enhance human creativity and capabilities. The company believes that integrating various forms of data, particularly visual information, is essential for creating more intelligent and interactive AI systems. Luma Ai focuses on training and scaling multimodal foundation models that can perceive, understand, and engage with the world, aiming to deliver high-performance AI solutions across diverse hardware platforms.

Share This Job!

Save This Job!