This opportunity is being managed by Ellie Rouget
Consultant
Data Engineer
Salary:
Up to £400 per day
Opportunity type:
- Interim
Location:
Hertfordshire
Specialism:
- Disruptive Technology
Date posted:
Posting date:
19 Nov 2019
Opportunity reference:
BBBH10699_1574169739
Opportunity description
This vacancy has now expired. Please see similar roles below...
An exciting opportunity for a Data Engineer to work for a multinational manufacturing company based in Hertfordshire on a 6 month contract
The Data Engineer will be responsible for building and maintaining data pipelines in AWS to ingest data from various source systems
To successfully deliver in this role you will have:
- An understanding of AWS architecture
- Held roles in the BI workspace for 2-4 years
- In-depth knowledge of Spark and Python
- Knowledge of Redshift or Snowflake
- Knowledge of other AWS services used to ETL workflows, such as Data Pipeline and Glue,
- Familiarity with Microsoft Power BI or other data visualization tools such as Cognos, Tableau
- Familiarity with database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework
- Knowledge of SQL
- Experience with AGILE project methodology and practice
The Data Engineers main responsibilities will be:
- Building complex data pipelines architecture in AWS in projects which develop new BI solutions
- Optimizing existing data flows in AWS
- Together with IT solution architects building infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources to AWS
- Working closely with data analysts to provide required data structures
- Keeping the data secure across the end-to-end solutions
- Working with Service Delivery Manager and Project Manager in developing and executing project plans within assigned schedule and timeline.
- Design, build and deploy BI solutions
- Maintain and support data analytics platforms