Sr Talend Engineer ( Data Engineer)

Who Is Hiring

We are currently working with a leading data consultancy company that specialise in all things data and analytics. If you love all things data, this is the role for you.

As a Senior Talend Engineer you will be responsible for developing data pipelines, reliable workflows and designing an ID resolution process. You will also have an influence over the company’s growth and success as you identify and develop innovation solutions using core cloud data warehouse tools, that will enhance the company’s services.

Utilizing your knowledge and experience you will also have the opportunity to create and implement a strategy for ingestion and integration of data.

What You’ll Be Doing

• Design and implement data ingestion pipelines
• Develop reliable workflows to ingest and gather data from customer files
• Ensuring that data pipelines extract, validate, and normalize data once it is ingested
• Provide assistance in creating a strategy for ingestion and integration of data
• Write high-quality and maintainable code that has extensive test coverage
• Design and implement an ID resolution process in Talend
• Utilize Spark/Talend pipelines to match and build parquet files
• Work alongside the client to determine fuzzy matching requirements and then implement the fuzzy matching algorithms
• Constantly strive to identify opportunities for improvement
  
  

What You’ll Bring In This Role

• Expertise in Talend, Talend Big Data Integration, Talend Data Integration, Python and Spark
• Know-how of how to work on Data Pipeline Development and customer identity resolution enhancement
• Ability to migrate from Talend to Spark
• Knowledge of process and source system analysis along with data profiling
• An eye to spot opportunities to conform, clean and consolidate data
• Experience of testing Talend workflows
• Ability to deliver innovative solutions utilizing Event Stream platforms, core cloud data warehouse tools and Spark, and other relevant Big Data technologies
• Apply Now