Data Engineer - Remote

Overview

Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure high-quality, scalable, and efficient data delivery. This is an exciting opportunity to contribute to impactful projects, solve complex data challenges, and grow your skills in a supportive and dynamic environment.

In Short

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process large volumes of data from diverse sources.
• Build and optimize data storage solutions, such as data lakes and data warehouses, to ensure efficient data retrieval and processing.
• Integrate structured and unstructured data from various internal and external systems to create a unified view for analysis.
• Ensure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.
• Maintain comprehensive documentation for data processes, tools, and systems while promoting best practices for efficient workflows.
• Collaborate with product managers and other stakeholders to gather requirements and translate them into technical solutions.
• Participate in Agile development processes, including sprint planning and daily stand-ups.
• Conduct thorough testing and debugging to ensure the reliability and performance of applications.
• Stay updated with the latest technologies and trends in full-stack development.
• Foster a collaborative and inclusive work environment.

Requirements

• Bachelor's degree in computer science, Engineering, or related field.
• Proven experience as a Data Engineer, with a minimum of 3 years of experience.
• Proficiency in Python programming language.
• Experience with database technologies such as SQL and NoSQL databases.
• Strong understanding of data warehousing/lakehousing principles and concurrent/parallel processing concepts.
• Familiarity with at least one cloud data engineering stack (Azure, AWS, or GCP).
• Competence in working on Linux OS and creating shell scripts.
• Excellent problem-solving and analytical skills.
• Effective communication skills, both written and verbal.
• Adaptability and willingness to learn new technologies and tools as needed.

Benefits

• Opportunity to work on impactful projects.
• Supportive and dynamic work environment.
• Encouragement for continuous learning and innovation.
• Collaborative and inclusive workplace culture.
• Equal employment opportunities regardless of background.