Data Engineer - Remote

Overview

The Data Engineer at 2Brains will play a crucial role in designing, building, and evolving the engineering ecosystem, BI, and generative Artificial Intelligence to transform the company's financial records into actionable insights for strategic and operational decision-making.

In Short

• Prioritize and execute the backlog of initiatives related to the finance information products.
• Design and build data pipelines from multiple sources to the Data Lake, ensuring scalability, performance, and quality.
• Model the Data Lake in alignment with Data Governance guidelines and corporate architecture.
• Monitor, maintain, and optimize data processing flows considering performance, costs, quality, and SLA compliance.
• Design and publish domain-oriented views for adoption by analytics, finance, and strategy teams.
• Develop AI-based solutions to automate analytical processes and enhance decision-making with predictive insights.
• Promote responsible data usage, disseminating standards and best practices for data storage and security.

Requirements

• At least 2 years of experience in data areas, involved in designing, developing, and maintaining data pipelines.
• Advanced knowledge of SQL and Python for data processing, transformation, and modeling.
• Practical experience in developing data pipelines from multiple sources to Data Lakes or Data Warehouses.
• Fluent in Google Workspace and cloud environments, ideally Google Cloud Platform (GCP).
• Knowledge of tools like Airflow for process orchestration and BigQuery for analysis and storage.
• Familiarity with batch and streaming architectures, understanding their differences and use cases.
• Experience with Git and best practices in versioning and deployment.
• Desirable: experience or interest in AI and generative AI solutions applied to analytical processes.

Benefits

• Work with a high-performance team, learning and developing together.
• Access to large clients and challenging projects.
• Continuous learning and growth opportunities, organizing meetups, training, and cultural activities.
• A flexible and dynamic work environment.