We are looking for a Lead Data Engineer to work within Analytics, BI/MI and Data Science for an award-winning AWS Premier Consulting Partner. The Data Engineer position will be mainly based from home with occasional visits to either the London or Ipswich office when required, they will propose and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue and Matillion. Experience-Analysing and cleansing data using a variety of tools and techniques
AWS Data Lake related componentsRedshift, Glue and S3ETL and using patterns for cloud data warehouse solutions (eg. ELT)MatillionVariety of Data Formats, JSON, XML, CVS, Parquet etcBuilding and maintaining data dictionaries/meta dataLinux and Cloud EnvironmentsData Visualisation Technologies eg Amazon QuickSight, Tableau, Looker, QlikSense DesirableExperience with large data Hadoop, MapReduce, Spark, etcProviding data via micro service APIOther public cloud data lakeAWS Certifications (Solutions Architect Associate and Big Data Speciality)Machine Learning Competitive Salary plus bonus and 10 days allocated training. If this position is of interest please submit your CV or email