Senior Data Engineer, AI Insights - Remote

Overview

Affinity stitches together billions of data points from massive datasets to create a powerful, accurate representation of the world's professional relationship graph. Based on this data, we offer our users the insights and visibility they need to nurture and tap into their team's network of opportunities.

In Short

• Design scalable and reliable data pipelines to consume, integrate and analyze large volumes of complex data.
• Collaborate with machine learning engineers, software engineers, and product managers.
• Build and maintain frameworks for measuring and monitoring data quality.
• Establish and optimize CI/CD processes and infrastructure-as-code tooling.
• Implement robust data solutions using Spark, Python, Databricks, and AWS.
• Identify skill and process gaps and develop processes to drive team effectiveness.
• Articulate trade-offs of different approaches to building ETL pipelines.
• Encourage a diverse and inclusive workplace.

Requirements

• 5+ years of experience as a Data Engineer or Data Platform Engineer.
• Proficiency in data modeling, data warehousing, and ETL pipeline development.
• Hands-on experience building scalable data platforms using Spark and Databricks.
• Strong proficiency in SQL.
• Experience with cloud platforms like AWS or GCP.
• Familiar with CI/CD processes and test frameworks.
• Comfortable partnering with product and machine learning teams.

Benefits

• Comprehensive health benefits including medical, dental, and vision insurance.
• 401(k) retirement plan.
• Annual education budget for learning and development.
• Wellness support including reimbursements for home internet and wellness memberships.
• Virtual team-building activities and socials.