AWS Data Engineer

Working for this technology solutions company as a Data Engineer you will be part of a technical team making sure new developments meet high-quality standards.

This role demands a strong technical background with exceptional analytical skills. You will be a motivated individual who understands and enjoys the DevOps way of life and has experience with Data Engineering technologies.

Key activities

• Develop, customise and manage integration tools, databases, warehouses, and analytical systems with the use of data related instruments/instance
• Develop of end-to-end data pipelines
• Deploy ETL pipelines to production environments in cloud (AWS)
• Implement and design the architect of various ETL pipelines
• Test, monitor, and maintenance of existing pipelines
• Work closely with the business and technical teams to solve their problems and take the ownership of developing, deploying, and supporting the solutions
• Monitor the overall performance and stability of the system. Adjust and adapt the automated pipeline as data/models/requirements change
• Make improvement and process recommendations that have an impact on the business
  
  

Skills, Knowledge And Experience

• Proven experience in a similar role with technology driven organisations
• Data Engineering experience (Hadoop, Airflow, Oozie, Pentaho)
• Scripting Knowledge (Python, Scala, PowerShell, Linux Shell scripting, Splunk)
• Database experience (SQL and NoSQL databases)
• Experience in Risk Management and applying risk mindset in day-to-day activities
• Strong understanding of cloud computing principles and services, with proficiency in AWS
• Experience working in distributed teams
• Hands on technical person able to triage defects across environment, integration & code
• Ability to work with different project teams (across environment, integration & development) and bring cohesiveness across the teams to focus on diagnosing defects
• Excellent communication and collaboration skills
  
  

Apply now to secure an interview or contact Dylan tasker on 9236 7756 for a confidential discussion