Data Engineer

Job description



We are looking for a Data Engineer to join the IBM Watson Media engineering team and help us maintain and improve the key aspects of our leading SaaS video streaming platform.

As a Data Engineer at IBM Watson Media, you will be responsible for building and operating the data pipeline of our unit. You will have the opportunity to learn and work with tools like Kubernetes, Terraform, Helm, Airflow, Athena, Elasticsearch, Pinot, Kafka, Flink, Python or Tableau to get the most out of our most valuable resource, all data from different areas of our platform. With this we want to make sure we have all critical insights of our platform's usage and we give meaningful information to our customers whenever they need it.

Your Role and Responsibilities

  • design, implement, maintain and operate efficient and reliable data pipelines to move data across systems
  • develop and deploy changes via infrastructure as code
  • support multiple teams (product, engineering, marketing, finance etc) in high visibility roles
  • implement data workflow to aggregate and structure data for high-performance analytics
  • monitor performance of the data platform and optimize as needed
  • provide on-call duty for the supported systems

Required Technical and Professional Expertise

  • Experience with query languages (eg. SQL, Hive etc.)
  • Experience with a scripting language (eg. Python) and a statically typed programming language (eg. Java)
  • Experience with relational databases
  • Strong collaboration and problem-solving skills
  • Working experience with container orchestration solutions (e.g. Kubernetes), Helm and infrastructure as code systems (e.g. Terraform)
  • Curiosity to understand the business use of data tools
  • Fluency in English

Preferred Technical And Professional Expertise

  • Experience with functional programming (example: Scala)
  • You have a bachelor’s degree in Computer Science or equivalent training, education and experience
  • Experience in monitoring systems (eg. Prometheus)
  • System administration and automation skills

About Business Unit

IBM Watson Media is the leading Live Video Streaming, AI and Video Hosting Solution for businesses. Our comprehensive video streaming platform is built for scale and reliability, to optimize video quality and workflow, and powered by IBM Watson AI for video search and automated closed captioning. Our products are used by thousands of enterprises, service providers, educators, and media companies worldwide from startups to Fortune 500 companies like Salesforce, Pinterest, SONY, Mazda, Herman Miller and Roland. With our help, they create large scale live streams, host video entertainment venues with pay-per-view access for subscribers, conduct video marketing activities like product launches or webinars, stream executive townhalls and trainings and create powerful virtual and hybrid events.

This job requires you to be fully COVID-19 vaccinated prior to your start date and proof of vaccination status will be required before your start date. During the Onboarding process you will be asked to confirm your vaccination status, in case you are unable to get vaccinated for any reason, you can let us know at that stage. Please let us know if you are unable to be vaccinated due to medical or religious reasons. IBM will consider such requests on a case by case basis subject to submission of required proof by the candidate before a stipulated date.

Your Life @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

About IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business. At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

Location Statement

When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience.

For additional information about location requirements, please discuss with the recruiter following submission of your application.

Being You @ IBM

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.