Senior Data Engineer

Company:
Location: Dublin

*** Mention DataYoshi when applying ***

Job Description

Our Dublin based client is looking for an experienced AWS Data Engineer to join their team. Exciting opportunity with a global company.

Job Responsibilities

  • Build and lead the creation of optimal data pipeline architecture.
  • Stay on top of industry trends and enable the successful data solutions by highest of industry standards.
  • Partner with various stakeholders and business users to optimize data engineering.
  • Enable all team members in the data engineering team through training, mentoring and growing their knowledge
  • Be the leader on complex data sets that meet the functional and non-functional business requirements.
  • Key member in identifying, designing, and implementing internal process improvements
  • Key member of the team that builds the infrastructure required for optimal extraction, transformation, and loading of data
  • Work with multiple stakeholders including the Executive, Product, Data and Design teams to support all data needs
  • Work across a numbers of AWS regions.
  • Work with data and analytics experts to strive for best in class operation in our data systems.

Experience Required

  • Advanced Python knowledge and experience
  • Must have experience building and optimizing pipelines and data sets, preferably on AWS data lake.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills that are directly related to dat
  • capable of growing processes that support data transformation and data structures,
  • A track record and working history of processing and extracting information from large datasets.
  • Experience in managing and leading, supporting and working with a highly cross-functional team that operates globally
  • Ideally you will have experience using the following software tools:
  • Big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: Glue, Lambda, EMR, RDS, Redshift

Essential and Desirable Skills

  • 12+ years of total experience in a complex, technical environment
  • AWS Certified Solutions Architect – Professional level

Educational Requirements

  • Bachelor/Master/Engineering degree in IT / Computer Science/ software engineering or relevant field

*** Mention DataYoshi when applying ***

Offers you may like...

  • Finexio

    Senior Data Engineer
    Remote
  • Everyday Health - Pregnancy & Parenting

    Senior Data Engineer - Everyday Health
    Remote
  • Imperva

    Senior Data Engineer, Marketing
    Pawtucket, RI 02860
  • Datafin IT Recruitment

    Senior Data Engineer New
    Cape Town, Western Cape
  • Luxoft

    Senior Data Engineer
    Wrocław, dolnośląskie