Senior Data Engineer - Remote

Overview

We seek a highly skilled Senior Data Engineer to join our team. In this pivotal role, you will design and implement real-time distributed data processing systems to analyze public data and detect emerging threats.

In Short

• Design and implement distributed data processing systems for real-time public data analysis and threat detection.
• Lead R&D initiatives in machine learning, NLP, computer vision, and data analytics.
• Oversee the creation and annotation of custom datasets for classification, unsupervised pre-training, and tagging tasks.
• Optimize ETL processes for diverse data formats, including social media, news, and web sources.
• Develop and manage database architectures for real-time streaming analytics with a focus on performance and scalability.
• Drive automation, continuous integration, deployment, and performance optimization while ensuring security compliance.
• Design, implement, and optimize robust REST APIs; ensure data integrity through test suites and instrumentation.
• Manage development initiatives, feature rollouts, and strategic trade-offs (e.g., cost vs. performance).
• Apply machine learning performance evaluation techniques to address system limitations.

Requirements

• Bachelor's degree in Computer Science or a related field.
• 5+ years of experience in data engineering and building data platforms.
• 2+ years of experience in Machine Learning or a closely related field.
• Proven expertise in deploying cloud-based products and optimizing processing pipelines for streaming analytics.
• Proficiency with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, ElasticSearch, Redis, Druid).
• Expertise in big data processing systems (e.g., Apache Spark, Flink, Beam), Kafka, and Airflow.
• Strong Python programming skills and experience with build automation and CI/CD tools.
• Exceptional project management skills with a demonstrated ability to lead teams and deliver complex projects.

Benefits

• Competitive Salary: Earn a USD salary that matches your skills and experience.
• Paid Time Off: We value work-life balance, offering PTO so you can recharge.
• Birthday Off
• Health Insurance Subsidy: Your health matters, and we help with a subsidy to cover your care.
• Salary Reviews every year!
• Paid Training and Certifications