Senior Data Developer (Databricks and FICO) - Remote

Overview

We are specialists in technological transformation, combining human expertise with AI to create scalable tech solutions. With over 7,400 CI&Ters around the world, we have partnered with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

In Short

• Design, develop, and maintain scalable and robust data pipelines.
• Create data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
• Ensure data quality, integrity, and usability throughout the pipeline.
• Implement CI/CD pipelines focused on ETL processes.
• Design and maintain Data Lake and Data Warehouse solutions, applying best practices in data governance.
• Apply FinOps concepts for cost optimization related to cloud data processing.
• Develop and document workflows, processes, and data architectures.
• Troubleshoot technical issues with pipelines and data infrastructure.
• Work with concepts like Bronze, Silver, Gold layers, Star Schema, Delta Tables, Delta Sharing, and analytical tables.
• Collaborate with technical and business teams to orchestrate solutions aligned with company objectives.

Requirements

• Bachelor's degree in Computer Science, Engineering, IT, or related fields.
• Solid experience as a Data Engineer or similar role.
• Advanced knowledge in SQL.
• Proficiency in Python/PySpark.
• Experience with Azure Databricks and Azure Data Factory.
• Familiarity with Cloudera (Hive, Impala, HDFS).
• Knowledge of ETL/ELT and data pipelines.
• Experience in dimensional data modeling.
• Understanding of Data Lake/Data Warehouse governance and quality.
• Experience with CI/CD practices applied to the data environment.

Benefits

• Opportunity to work with a talented and motivated team.
• Engagement in innovative projects utilizing cutting-edge technologies.
• Continuous learning and professional development opportunities.
• Collaborative and dynamic work environment.
• Possibility of career advancement within the company.