This opportunity is being managed by Sasza Bryza
Consultant
Sr. Data Engineer
Salary:
Negotiable
Opportunity type:
Location:
Birmingham, West Midlands
Specialism:
Date posted:
Posting date:
22 Aug 2019
Opportunity reference:
SH9991_1566461406
Opportunity description
This vacancy has now expired. Please see similar roles below...
Key Responsibilities:
- Lead the design, implementation, and continuous delivery of pipelines using distributed Azure based big data technologies supporting data processing initiatives across batch and streaming datasets
- Responsible for development using Scala, Python languages and Big Data Frameworks such as Spark, EMR, Kafka, Storm, Jenkins, Jfrog Artifactory and DataBricks
- Provide oversight and direction on deployed Azure platform components
- Process and manage high volume real time customer interaction streams
- Support the data analytic team in the creation of data models and product/propositions.
- Development and implementation of data flows and ETL's to ingest data, using both streaming and batch technologies from multiple sources
- Design and development of the deployment processes using continuous integration
- Provide technical review of the solution and identify project risks and estimate development time for such solution.
- Support entire development process and conduct code reviews.
Similar opportunities
Salary
£800 - £1300 per day
Location
London
Salary
£70000.00 - £85000.00 per annum
Location
Reading, Berkshire
Salary
£47000 - £75000 per annum + Bonus and Benefits
Location
London
Salary
£60000.00 - £65000.00 per annum + Car Allowance, Bonus and Benefits
Location
Isleworth, London