This website uses cookies. Read our cookie policy for more information. By continuing to browse this site you are agreeing to our use of cookies.

hidden og tag linkedin

Big Data / Devops / Data Science Engineer, London, UK

Job Type:
Contract
Job Sector:
Data
Job Category:
Data Science & Data Engineering
Country:
UK
Area:
London
Location:
London
Salary:
600 to 700 per day
Job Ref:
HQ00023846

BIG DATA / DEVOPS / DATA SCIENCE / HADOOP / SPARK / PYTHON

Big Data DevOps Engineer

Rate: £650-700PD
Location: Canary Wharf
Duration: 6 Months
Start: ASAP

My global banking client based in Canary Wharf is urgently looking for a DataOps (Big Data / DevOps Engineer) to join their Data team on an initial 6 month contract.

Role and responsibilities

• You Responsible for productionising and deploying data science artifacts
• Responsible for implementing metrics gathering processes
• Responsible for resolving problems with real-time DS processes in production
• Responsible for managing the data science stack (SPARK, PYTHON, TOMCAT)
• Available to help with quality control of Spark code written by data scientists
• Available to trouble-shoot Spark jobs running on the Analytical environment
• Available to support data ingestion team

Requirements

• Expert in YARN, Spark- the Hadoop ecosystem should have no secret from you!
• Excellent knowledge on Hadoop Administration / scheduling / priority.
• Expert in Kafka queue management / maintenance.
• Expert in HBase management, able to troubleshoot hotspots across Region Servers.
• Expert in Zookeeper configuration / maintenance.
• Typical stack HIVE, OOZIE, SPARK, FLUME, IMPALA applies.
• Good knowledge of data formats (Parquet, Avro).
• Good knowledge of Java and Python, Scala definitively a plus.
• Knowledge installing / administrating notebooks (Jupyter)
• Excellent knowledge on CI (maven, nexus, Jenkins).
• Basic understanding of data science concepts. Understanding of PMML (Predictive Model Markup Language)

Level of Experience:

• 7+ years’ experience in software engineering
• 4+ years’ experience as system admin / devops engineer
• 3+ years’ experience working on Cloudera prod environment.
• Financial services experience a definitive plus.

Contact Details:
Tel: 0203 301 9932
Fax: 0203 301 9901
Contact: James Jarvis

You may return to your current search results by clicking here.

Latest Job Listings