Senior PySpark Data Analytics Manager - Remote

Overview

We are seeking a Senior PySpark Developer with expertise in big data processing, Python, and Apache Spark, particularly within the finance domain. This role focuses on developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.

In Short

• Develop and optimize scalable PySpark-based data pipelines.
• Design and implement distributed computing solutions for risk modeling.
• Ensure efficient data storage and retrieval using Big Data.
• Implement best practices for Spark performance tuning.
• Maintain high code quality through testing and CI/CD pipelines.
• Work on batch processing frameworks for market risk analytics.
• Strong experience in software development and big data frameworks.
• Proficiency in Python and PySpark.
• Experience with financial markets and risk management.
• Hands-on experience with Hadoop and Spark.

Requirements

• Strong proficiency in Python and PySpark.
• Knowledge of core Spark concepts (RDDs, DataFrames, Spark Streaming).
• Familiarity with market risk concepts including VaR and Greeks.
• Excellent problem-solving skills and analytical mindset.
• Ability to work in a fast-paced financial environment.

Benefits

• Equal opportunity employer.
• Consideration for applicants without regard to race, color, religion, etc.
• Accessibility accommodations available for applicants with disabilities.