As a Senior Spark Data Engineer at FirstEnergy, you will work on an Agile team that is digitally enabling the company by building data pipelines that drive analytic solutions.
In Short
Serve as the subject matter expert in technologies used for our data strategy in the cloud.
Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.
Solve complex data problems to deliver insights that helps the organization's business to achieve their goals.
Create data products for analytics and data scientist team members to improve their productivity.
Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organization's productivity as a team.
Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
Requirements
Bachelor’s degree in a quantitative discipline such as Computer Science, MIS or related field with 10 years of related experience.
Strong knowledge of using Spark for fast imagery and big data processing.
Expert knowledge in managing and tuning of Data Lake and Lakehouse storage objects with accompanying data engineering pipelines.
Expert knowledge in Python and SQL development and troubleshooting.
Experience in Agile/Scrum development with DevOps methodologies geared toward rapid prototyping and piloting of cloud solutions.
Unix/Linux experience is preferred.
Experience in creating, analyzing and documenting ER and Dimensional models.
Understanding of data replication tools.
Experience in designing and/or developing Analytics applications using tools such as Power BI, QlikView, SAS, RapidMiner or other comparable products.
Willingness to travel throughout organization and service territory and work extended hours, as required.
Benefits
Competitive pay plus incentive compensation.
Company-sponsored pension plan.
401(k) savings plan with matching employer contribution.
Choice of medical, prescription drug, dental, vision, and life insurance programs.
Skills development training with tuition reimbursement.