Staff Data Engineer - Remote

Overview

Pismo is a technology company that provides a comprehensive processing platform for banking, card issuing, and financial market infrastructure. We are looking for a Staff Data Engineer to design and build robust data pipelines for our corporate Data Lake, working autonomously on significant projects and mentoring junior engineers.

In Short

• Design and implement data ingestion and transformation pipelines using PySpark/SparkSQL on Databricks.
• Own data pipelines end-to-end in production.
• Build and maintain Delta Lake tables following medallion architecture patterns.
• Design and optimize Airflow DAGs for complex orchestration scenarios.
• Implement and maintain data quality frameworks.
• Write advanced SQL for data modeling and performance optimization.
• Conduct thorough code reviews and mentor junior engineers.
• Investigate and resolve data quality incidents independently.
• Collaborate with Analytics, BI, and Product teams.
• Contribute to CI/CD and data governance practices.

Requirements

• Production experience with Apache Spark (PySpark, SparkSQL).
• Experience with Databricks and Delta Lake.
• Advanced SQL skills.
• Experience with Apache Airflow / MWAA.
• Knowledge of Amazon S3 data lake design.
• Experience with data quality frameworks.
• Data modeling experience.
• Familiarity with Git/GitHub and CI/CD.
• Experience with Terraform.
• Proficiency in Python for automation and data processing.
• English level B2.
• Based in Brazil.

Benefits

• Work in a dynamic and innovative environment.
• Opportunity to mentor junior engineers.
• Be part of a rapidly growing technology company.
• Access to Visa’s solutions and resources.
• Flexible working arrangements.