Great opportunity to join a globally distributed team of over 190 working from over 28 countries who are on a mission to enable customers to extract the data they need to continue to innovate and grow their businesses.
You could join a successful team that has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. Currently, over 2,000 companies and 1 million developers rely on their tools and services to get the data they need from the web.
As a Java engineer you'll be responsible for managing our Hadoop/HBase clusters and our storage backend application that runs on top of these clusters.
We are looking for an engineer to join our Infrastructure team to help, maintain and improve our technology stack which includes Hadoop, HBase, ELK, Prometheus/Grafana and many more.
Roles & Responsibilities:
- Deploying and monitoring of the Hadoop/HBase services.
- Storage backend application development with Java and Python.
- Plan and deploy software upgrades, both at application and Hadoop/HBase layers.
- Write tools and scripts to automate common tasks in managing the Hadoop
clusters.
- Troubleshooting Hadoop/HBase service issues.
- Help improve monitoring and identify key performance metrics.
- Proactively ensure service runs with minimal disruption.
Requirements:
- 5+ years experience doing DevOps work (deploying, maintaining, monitoring, and application development) with Hadoop/HBase technology, in moderate to large scale clusters.
- Deep understanding of HDFS and HBase internals.
- Experience with Hadoop MapReduce development.
- Solid experience in Linux troubleshooting, tuning, profiling, and monitoring.
- Solid experience with Java, and understanding of the JVM.
- Skills in the following programming languages: Python, Bash/Shell scripting.
- Experience with Docker.
- Understanding of load balancing and reverse proxying techniques.
- Soft skills:
- Highly organized, able to multitask, able to work individually, as well as within a team, and across teams
- Strong oral and written communication skills in English
- Flexibility around working hours - if there is an issue you should use your initiative and help resolve it.
- Maintaining and respecting confidentiality of large amounts of information you have access to.
- Bonus points:
- Open source contributions related to HBase or other NoSQL databases.