Operations Engineer - Big Data - Remote

Overview

As one of the top ten digital asset exchanges globally, we aim to provide first-class service experiences in trading, security, and blockchain product innovation. Our goal is to enable everyone to participate in building the crypto market and ensure that the most cutting-edge and promising cryptocurrency projects can be safely launched and traded.

In Short

• Responsible for deploying, monitoring, maintaining, and optimizing PB-scale big data clusters to ensure stability and performance.
• Monitor and analyze system logs to quickly locate and resolve faults.
• Research the principles of components like Doris, Hbase, k8s, and Flink to continuously optimize service architecture.
• Conduct regular performance evaluations of big data components and propose improvements to enhance platform stability.
• Advance the construction of an automated operations platform to improve operational efficiency.
• Write and maintain operational documentation, including user manuals and emergency impact processes.

Requirements

• Bachelor's degree or higher in a computer-related field with over 3 years of experience in big data platform operations.
• Familiarity with Doris: FE/BE architecture, data sharding, and table model optimization.
• Proficiency in Flink: job scheduling, state management, and resource monitoring (especially in On YARN/K8s environments).
• Expertise in HBase: read/write performance optimization, Phoenix integration, and HDFS storage layer tuning.
• Knowledge of Kafka: ISR mechanism, replica synchronization, consumer group management, and Kafka Connect applications.
• Solid Linux system operations skills, proficient in using Shell/Python to write operational scripts.
• Experience in building Prometheus+Grafana monitoring systems, with knowledge of tools like Zabbix/ELK.
• Familiarity with containerization technologies (Docker/K8s) and understanding of CI/CD pipeline construction.
• Strong sense of responsibility, excellent fault diagnosis skills, and ability to work under pressure.

Benefits

• Opportunity to work with top-tier technical partners in a high-performance environment.
• Unlimited development space and promising future.
• Participation in cutting-edge projects in the crypto market.