Senior Backend Engineer - Remote

Overview

Lean Tech is a rapidly expanding organization situated in Medellín, Colombia, focusing on software development and IT services for various sectors. The Senior Software Engineer will design and optimize backend systems for large-scale data processing.

In Short

• Design and build scalable batch and streaming processing systems using Apache Spark on AWS.
• Optimize distributed jobs for performance and cost.
• Architect and maintain the data storage layer on AWS S3.
• Develop production-grade Python code.
• Design and manage complex execution workflows.
• Lead code reviews and mentor junior engineers.

Requirements

• 5+ years of experience in software or data-focused engineering roles.
• 4+ years of experience with Apache Spark.
• B.S. or M.S. in Computer Science or related field.
• Experience with orchestration tools like Airflow.
• Advanced SQL skills.
• Deep experience with Spark DataFrame API.
• Understanding of Spark internals.
• Experience with columnar storage formats.
• 5+ years of experience writing Python.
• Experience with AWS services.

Benefits

• Join a powerful tech workforce.
• Professional development opportunities.
• Collaborative work environment.
• Career path and mentorship programs.