Data Engineer

Company:
Location: Dublin, County Dublin

*** Mention DataYoshi when applying ***

Job Title: Data Engineer Location: Dublin, Ireland Duration: 6 month contract with extension Telecommunication Connect is looking for an experienced Data Software Engineer who can help us maintain our AWS Data Warehouse. Our data warehouse stack is built on AWS for data storage, SSIS for ETL and Tableau for data visualisation. The candidate must have practical hands-on experience with each of these tools. JOB DUTIES:

  • Actively break down tasks, provide estimates and track and manage requirements, dependencies and progress of assigned stories in Jira.
  • Create and maintain Entity relationship diagrams, source to target mappings
  • Enter and maintain metadata in Data Cataloging tools
  • Develop and maintain ETL pipelines from internal and external sources all the way through to S3 and Redshift
  • Develop and maintain SSIS packages through BIML and C# extensions
  • Develop and maintain ETL workflows orchestrated on AWS with Apache Airflow
  • Create and maintain the assigned pipelines across Dev, Test and Prod environments (supported by CI/CD engineers)
  • Ensure all developed solutions include unit tests and integration with the team;s test suite.

MUST HAVE SKILLS:

  • 5+ years proven experience working with SSIS ETL tools. Experience programming with T-SQL and PG-SQL is essential.
  • 2+ years proven experience with Redshift and S3.
  • 2 + years C# development Experience
  • Advanced knowledge of Python Programming
  • Experience developing and maintaining E2E ETL pipelines and best practices for them
  • Excellent communicator with the ability and experience to coordinate work directly with multiple internal team members.
  • Documentation skills with ability to create Entity Relationship Diagrams and Source to Target mappings.
  • Must have worked with automated CI/CD tools and patterns.

DESIRED SKILLS:

  • Experience working with Agile methodologies.
  • Experience with Airflow or similar orchestration & ingestion tools.
  • Project leadership experience.
  • Tableau familiarity, especially within self hosted AWS implementations
  • Experience implementing and using Informatica Enterprise Data Catalog
  • Experience with Qlik Replicate/Qlik Compose or similar tools

EDUCATION/CERTIFICATIONS: BSc in Computer Science or equivalent technical background.

*** Mention DataYoshi when applying ***

Offers you may like...

  • Grubhub Holdings, Inc.

    Senior Data Engineer
    New York, NY 10018
  • Splunk

    Data Engineer, DevOps - Remote OK
    Sun Prairie, WI 53590
  • Cognizant Technology Solutions

    Senior Data Engineer (Remote) - Advanced Technolog...
    Chicago, IL 60601
  • Lessonly

    Senior Data Engineer
    Indianapolis, IN 46202
  • Numerator

    Sr. Data Engineer
    Chicago, IL 60606