Data Engineer - Remote

Overview

The Data Engineer at 2Brains is responsible for designing and developing new information management models and maintaining existing ones. They will participate in advanced analytics initiatives, supporting the exploration of internal and external information models.

In Short

• Build and optimize data pipelines for efficient data ingestion, transformation, and loading.
• Manage cloud infrastructures (AWS, GCP, Azure) ensuring scalability and cost efficiency.
• Automate and monitor processes using DevOps tools like Airflow, Terraform, or Kubernetes.
• Implement quality controls and governance to ensure data integrity and availability.
• Collaborate with Data Science, Product, and Development teams to design solutions aligned with business needs.

Requirements

• Experience with BI technologies is mandatory.
• Experience in building/operating distributed systems for extracting, ingesting, and processing large datasets.
• Proven capability in data modeling, ETL development, and data storage.
• Experience using business intelligence reporting tools (Power BI).
• Knowledge of consuming REST API microservices is mandatory.
• Knowledge of Git, Bitbucket, Docker, Jenkins, Webhooks is mandatory.
• Programming with Python and solid software engineering fundamentals.
• Automation and scripting skills.
• Use of Python libraries for data manipulation and analysis, and Apache Spark.
• Knowledge of SQL and NoSQL databases.
• Knowledge of CI/CD, Dataflow, S3, Redshift, and Glue AWS.

Benefits

• Work with a high-performance team, learning and growing together.
• Access to large clients and challenging projects.
• Continuous learning and growth opportunities, including meetups and training.
• A flexible and dynamic work environment.
• Special benefits: a day off for your birthday, 4 weeks of vacation.