Remote Otter LogoRemoteOtter

Lead Data Engineer - Remote

Posted 4 days ago
Data Analysis
Full Time
USA

Overview

Mysten Labs believes that decentralized and open protocols are the bedrock of the internet of value. This is why at Mysten Labs, we are creating foundational infrastructure to accelerate the adoption of decentralized protocols based on blockchain technologies.

The Data team is looking to hire a Staff Data Engineer to design and execute on the next iteration of our data systems. This is an exciting opportunity for someone who wants to design web3 analytics systems that run at web2 scale, reliability, and robustness. Interested candidates will have the opportunity to help define the new standards for blockchain analytics on top of the world’s premier object-centric blockchain.

This role requires a combination of high capacity hands-on individual contributor work and planning data architecture. As a Staff Data Engineer you will partner with the heads of Data and Engineering to effectively and smoothly process high-volume data in a reliable and robust way. You will get to touch all parts of the business at Mysten Labs and become the expert on data structures on the Sui blockchain.

In Short

  • Design and implement scalable ingestion pipelines with a reusable and modular framework.
  • Build robust, reusable frameworks to ingest data from internal sources and external APIs or files.
  • Ensure idempotency, backfill support, and error handling in pipeline design.
  • Optimize and own data warehousing with clear table definitions and schemas.
  • Architect a centralized data lake/warehouse with clear schemas and partitioning strategies.
  • Enable data discoverability, usability, and governance through effective tools.
  • Implement data cataloging and lineage tools for better data management.
  • Develop a strong understanding of how to use on-chain and off-chain data together.

Requirements

  • 5+ years experience in data engineering.
  • Strong SQL and Python skills.
  • Strong opinions on data orchestrators, catalogs, governance, and testing frameworks.
  • Experience combining in-house and external data.

Benefits

  • Join a remote-first team with global hiring.
  • Opportunity to work on cutting-edge blockchain technology.
  • Be part of a world-class team with tremendous growth potential.
  • Contribute to the future of web3.

M.L

Mysten Labs

Mysten Labs is a cutting-edge technology company focused on building innovative solutions in the blockchain and decentralized systems space. With a commitment to advancing the capabilities of Web3, Mysten Labs aims to create scalable and secure infrastructure that empowers developers and users alike. The company is driven by a team of experts dedicated to pushing the boundaries of what is possible in the digital landscape, fostering a collaborative environment that encourages creativity and forward-thinking.

Share This Job!

Save This Job!

Similar Jobs:

DoseSpot logo

Lead Data Engineer - Remote

DoseSpot

1 week ago

Seeking a highly skilled Lead Data Engineer to design and manage data architecture in a remote environment.

USA
Full-time
Software Development
Qode logo

Lead Data Engineer - Remote

Qode

1 week ago

The Lead Data Engineer will oversee data engineering tasks and utilize various technologies to deliver data solutions.

PA, USA
Full-time
Data Analysis
Juniper Square logo

Lead Data Engineer - Remote

Juniper Square

4 weeks ago

Join Juniper Square as a Lead Data Engineer to shape data strategies and enhance analytics capabilities.

India
Full-time
Software Development
Wisersolutions logo

Lead Data Engineer - Remote

Wisersolutions

6 weeks ago

Wiser Solutions is seeking a Lead Data Engineer to develop data architecture and lead a team in optimizing data collection and analytics.

Worldwide
Full-time
Software Development
Bertoni Solutions logo

Lead Data Engineer - Remote

Bertoni Solutions

7 weeks ago

Join our team as a Lead Data Engineer, specializing in PySpark, SQL, and Python for scalable data solutions.

Worldwide
Contract
Software Development