DATA ENGINEERING MANAGER
Unique opportunity to join an AI-powered, SaaS solution provider whose mission is to enable utility providers to optimise grid and customer behaviours and accelerate our journey towards a clean energy future.
Headquartered in Silicon Valley the company has spent the last 10 years perfecting their solution, registered their patents, and are now fully funded to grow rapidly and bring AI to utilities and homes around the world.
With an existing client base in Ireland, they are establishing an R&D operation here to help them scale at speed and drive changes in consumer behaviours towards a clean energy future.
You can join them on this journey and enjoy fully remote working within Ireland.
THE ROLE:
As a dynamic Data Engineering Manager, you will join a highly energetic and innovative team that believes nothing is impossible with some creativity and hard work. You’ll be tasked with architecting scalable solutions, hiring and mentoring talented teams and working with product managers to build great products. At present, the company ingests 2 Bn data points every day, which needs to scale to handling 200 Bn data points every single day and you will help to achieve this ambitious goal
RESPONSIBILITIES:
- Own the overall solution design and implementation of the core infrastructure for backend systems. This includes requirement analysis, scope discussion, design, architecture, implementation, delivery and resolving production issues related to engineering. The core back end system is a large scale data platform that ingests data, applies ML models and streams the output to a Data lake and serving layer.
- End-end backend engineering infra charter includes Dev ops, Global deployment, Security and compliances according to latest practices.
- Ability to guide the team in debugging production issues and write best-of-the breed code.
- Drive “engineering excellence” (defects, productivity through automation, performance of products etc) through clearly defined metrics.
- Stay current with the latest tools, technology ideas and methodologies; share knowledge by clearly articulating results and ideas to key decision-makers.
- Hiring, mentoring and retaining a very talented team.
YOUR EXPERIENCE:
- 8-12 years of strong experience in product development.
- Experience in Big Data technologies like Hadoop, Spark is a must (At Least 3-4 years of experience).
- Good to have exposure to NoSQL (Cassandra, hdfs) databases, Elastic Search, Kafka (2-3 years preferred).
- Experience with DAG-based data processing is highly desirable.
- Excellent track record of designing and delivering System architecture, implementation and deployment of successful solutions in a customer-facing role.
- Fluency in Java, Spring, REST Services.
- Strong understanding of non-functional requirements like security, test automation etc.
- Exposure to Agile development methodologies.
- Ability to hire, mentor and retain best-of-the-breed engineers.
- SAAS experience is a plus.
The role can be offered fully remote within Ireland and an attractive package is on offer for the right candidate