Mid and Senior Hadoop Operations Engineer (Warsaw, hybrid)

We are an international recruitment agency established in 1987 in Israel and operating in Poland since 2014. We specialize in permanent and temporary recruitment. Our headquarters are located in Poznań, and we also have branches in Warsaw, Gdańsk, and Wrocław.

Currently, for our clients in the BPO/SSC industry, we are looking for a talented individual for the position of Senior Hadoop Administrator.

Tasks:

• Carry out SRE duties for Big Data on various open-source platforms such as Hadoop, Spark, and HBASE.
• Keep an eye on the platforms and adhere to runbooks/SOPs to manage platform and application problems.
• Familiarize yourself with the cluster maintenance processes and implement changes as per the documented installation and validation plans.
• Showcase robust troubleshooting and debugging skills, aiming to pinpoint and rectify the issue, while also offering advice on how to prevent such problems in the future.
• Conduct thorough root cause analysis of major production incidents, document for future reference, and put in place proactive measures to enhance system reliability.
• Automate routine tasks using scripts or automation tools to lessen manual work, decrease the chance of human errors, and boost system reliability.

Requirements:

• At least 2-3 years of experience for a junior level role and 5+ for mid-level/senior level working as a Hadoop Site reliability engineer.
• High level Knowledge on Hadoop platforms and core Hadoop components.
• Troubleshooting both Hadoop platform service, application problems and identifying the root cause.
• Writing ansible playbooks and automate manual tasks using Ansible, shell scripting and python scripting.
• Should be familiar with Unix/Linux system internals, networking, and distributed systems.