Data Engineer - Remote

Overview

Analytica is seeking a Data Engineer to support one or more dynamic, long-term federal government enterprise data programs. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale AWS and/or Databricks based data environments. You will support designing, maintaining, automating and optimizing ETL operations ensuring data quality and efficient data management.

In Short

• Design, build, and optimize scalable data solutions using a Medallion Architecture.
• Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple workspaces.
• Integrate data from various structured and unstructured sources to enable high-quality business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
• Implement effective data management strategies to ensure data integrity, availability, and accessibility. Identify opportunities for cost optimization in data storage, processing, and analytics operations.
• Monitor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
• Collaborate with the team to enable advanced AI-driven analytics and data science workflows.

Requirements

• 5+ years of hands-on Data Integration experience creating and maintaining efficient scripts/data pipelines to clean, transform and ingest data from a variety of formats into database tables, data warehouses or data lake repositories.
• 3+ years of experience using SQL and Python to manipulate, profile and build data products
• Strong Experience building data pipelines using Databricks and/or AWS serverless components; using AWS Glue to build, maintain and monitor ETL jobs; using Python to implement ETL scripts and AWS Secrets Manager to manage credentials.
• Databricks and/or AWS Data Engineer Certification is strongly preferred.
• Proficient written, verbal, and client communication and presentation skills 
• Must be US Citizen and be able to obtain and maintain a Public Trust security clearance

Benefits

• Equal Opportunity Employer.
• Commitment to providing equal employment opportunities.
• Reasonable accommodations for applicants and employees with disabilities.