Data Engineer - Remote

Overview

Shamrock Trading Corporation is looking for a Data Engineer who wants to utilize their expertise in data warehousing, data pipeline creation/support and analytical reporting skills by joining our Data Services team.

In Short

• Develop & Maintain Scalable Data Pipelines using Databricks, Apache Spark, and Delta Lake.
• Optimize Data Processing with performance tuning techniques.
• Design and implement robust data architectures using AWS services.
• Develop streaming solutions using Kafka and Databricks Structured Streaming.
• Implement data validation and governance best practices.
• Collaborate with analysts and data scientists to meet business needs.
• Implement infrastructure-as-code and CI/CD best practices for data pipelines.

Requirements

• Bachelor’s degree in computer science, data science or related field.
• 2-5+ years of experience in data engineering.
• Strong hands-on experience with Databricks and AWS.
• Development experience in Python, Databricks, and Apache Spark.
• Strong SQL skills for data transformation.
• Understanding of data security and governance best practices.
• Enthusiasm for working directly with customer teams.

Benefits

• Fully paid healthcare, dental and vision premiums.
• Competitive PTO and paid leave policies.
• Generous company 401(k) contributions and employee stock ownership.
• Onsite gym and discounted fitness memberships.