TransUnion

Data Engineer II

Job description

TransUnion's Job Applicant Privacy Notice


What We'll Bring


Bachelor’s Degree, with 5-8 years related IT experience.


In-depth experience in Java or Scala.


Adept at data pre-processing & complex data transformations using Hive programming.


Experience in working with HiveQL and performance tuning of Hive queries.


Extensive experience on distributed systems frameworks like Hadoop including hands on experience on HDFS, MapReduce etc.


Proficient in working with large scale multi-node clusters with technologies like Apache Spark, Apache Flink, Apache Beam.


Excellent SQL skills and in-depth understanding of relational databases.


Adept at working on UNIX environments and exposure to shell scripting.


Excellent understanding of Oracle and MySql relation databases.


Experience in working with MongoDB or any No-SQL DB would be an advantage


Familiarity with big data platforms like Dataproc/GCP will be an advantage.


Experience in working with cloud-based services like AWS or GCP


Work with an innovative bend of mind to develop creative solutions for data on boarding


What You'll Bring


Neustar, a TransUnion company, was recently acquired and all recruiting is taking place in coordination with TransUnion.


What You Will Be Doing


The Data Engineer will want the challenge of working on implementing solutions for on boarding large volumes of data feeding into the front-end application.


Play a key role in end-to-end data on boarding and in creating a data pipeline for the end application.


In depth analysis of source data to provide insights for data mapping & business rules setup.


Develop, code & implement the data pipeline


Work closely with technical product managers, solution architects and other internal stakeholders to address issues in data pipeline and to make sure data is ingested accurately and on time.


Assist and shadow rest of the team members and accomplish the tasks in a timely manner


Work in a high paced and rewarding environment with bleeding edge technologies and innovative concepts


What We Would Love To See


Bachelor’s Degree, with 5-8 years related IT experience.


In-depth experience in Java or Scala.


Adept at data pre-processing & complex data transformations using Hive programming.


Experience in working with HiveQL and performance tuning of Hive queries.


Extensive experience on distributed systems frameworks like Hadoop including hands on experience on HDFS, MapReduce etc.


Proficient in working with large scale multi-node clusters with technologies like Apache Spark, Apache Flink, Apache Beam.


Excellent SQL skills and in-depth understanding of relational databases.


Adept at working on UNIX environments and exposure to shell scripting.


Excellent understanding of Oracle and MySql relation databases.


Experience in working with MongoDB or any No-SQL DB would be an advantage


Familiarity with big data platforms like Dataproc/GCP will be an advantage.


Experience in working with cloud-based services like AWS or GCP


Work with an innovative bend of mind to develop creative solutions for data on boarding


Ability to work closely with fellow Developers and Managers to understand requirements


An effective communicator, able to clearly articulate solutions; clear, succinct and persuasive at all levels


We’re excited to announce Neustar has joined the TransUnion team as part of an acquisition that took place in late 2021. As part of the transition, there may be changes specific to the organizational alignment and title of this position. All other details of this position, such as job responsibilities, will not be impacted due to the transition. Neustar’s addition to TransUnion is leading to accelerated growth to our marketing, risk and communications businesses and furthers our data-oriented strategy. We hope you’ll join us in the next phase of this journey.


#Neustar


Impact You'll Make


Bachelor’s Degree, with 5-8 years related IT experience.


In-depth experience in Java or Scala.


Adept at data pre-processing & complex data transformations using Hive programming.


Experience in working with HiveQL and performance tuning of Hive queries.


Extensive experience on distributed systems frameworks like Hadoop including hands on experience on HDFS, MapReduce etc.


Proficient in working with large scale multi-node clusters with technologies like Apache Spark, Apache Flink, Apache Beam.


Excellent SQL skills and in-depth understanding of relational databases.


Adept at working on UNIX environments and exposure to shell scripting.


Excellent understanding of Oracle and MySql relation databases.


Experience in working with MongoDB or any No-SQL DB would be an advantage


Familiarity with big data platforms like Dataproc/GCP will be an advantage.


Experience in working with cloud-based services like AWS or GCP


Work with an innovative bend of mind to develop creative solutions for data on boarding


TransUnion Job Title


Sr Engineer, Data Science and Analytics

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs

Data Engineer Data Analyst

Vista
March 29, 2023
ICF
March 29, 2023