Senior Big Data Engineer Consultant - Remote

Overview

The Senior Big Data Engineer Consultant at Allstate is responsible for driving multiple complex projects to deliver Big Data solutions that enable advanced data science and analytics, ensuring data quality and modernizing existing data architecture.

In Short

• Drive complex projects for Big Data solutions.
• Work with Advanced Data Platforms for data analysis.
• Develop data pipelines for optimal business decisions.
• Ensure data quality and modernize data architecture.
• Assist in the selection and development of team members.
• Utilize Python, SQL, Scala, and Spark.
• Experience with AWS and Azure cloud services.
• Implement CI/CD practices and containerization.
• Collaborate with teams to solve complex business problems.
• Innovate and provide new ideas to improve processes.

Requirements

• Strong understanding of Python and SQL.
• Experience with Apache Spark and Data Engineering.
• Hands-on experience with MongoDB and cloud services.
• Familiarity with Docker and Kubernetes.
• Knowledge of Git, CI/CD, and Agile methodologies.
• Ability to influence others and collaborate effectively.
• Experience with multithreading and RESTful APIs.
• Passion for learning new technologies.
• Strong problem-solving skills.
• Ability to work in a team-oriented environment.

Benefits

• Innovative and collaborative work environment.
• Opportunities for professional development.
• Commitment to serving clients and communities.
• Access to cutting-edge technology and tools.
• Work-life balance and flexible work arrangements.