Data Engineer - Microsoft - Remote

Overview

As a Data Engineer at Microsoft, you will be responsible for building and refining data pipelines and services that enhance the discoverability and usability of research content across applications and AI scenarios.

In Short

• Build and maintain core data pipelines for various data sources.
• Clean and structure data for web applications and AI use cases.
• Utilize Microsoft tools like Fabric and Azure services.
• Transform unstructured content into structured data using AI models.
• Design architecture for scalable data systems.
• Develop backend services and APIs for internal applications.
• Collaborate with cross-functional teams to define data requirements.
• Iterate on systems post-MVP for improved performance.
• Work independently within a small team.
• Engage in professional development and community-building events.

Requirements

• 5+ years of software or data engineering experience.
• 2+ years of hands-on work with data pipelines.
• Proven ability to design end-to-end data systems.
• Experience with AI models in data workflows.
• Proficiency in Python, SQL, or similar languages.
• Ability to define architecture from scratch.
• Comfortable working independently.
• Experience with Microsoft Fabric and Azure data services is a plus.
• Familiarity with metadata frameworks and knowledge modeling is advantageous.
• Experience shaping ambiguous information into structured datasets.

Benefits

• Hands-on support from 2A while working with Microsoft.
• Regular meetings for career development.
• Opportunities to join working groups.
• Access to community-building events.
• Professional development opportunities.