Pantheon Inc.

Big Data Engineer (Apache Kafka / Nifi) - 56884

Job description

Who We are
Our client is more than just one of the largest energy companies. It is the start of what could be an incredible journey. It’s the place where people think independently, take initiative, grow to their full potential and shape the future of energy. They strongly believe that diversity drives innovation so their inclusive workplaces help everyone thrive, regardless of their background. Safety and wellbeing of their employees is at the heart of everything they do. Their skills and competencies are built through training and work experiences in a wide range of assignments. With the use of cutting edge technology it holds an industry leading inventory of resources to help meet our societies growing energy demands.

What you will do
Develop or enhance Big Data pipelines using Nifi, Kafka, Spark and/or Flink-SQL for processing of structured and unstructured data
Proactively automate monitoring, alerting based on workflow needs
Develop or enhance Hadoop workflows including data ingestion, extraction and processing of structured and unstructured data
Engage in proof of concepts, technical demos and interaction with customers and other technical teams
Work to utilize common CI/CD best practices across different teams (data scientists, data visualization analysts, web developers etc.) when working on the same project
Explore and develop skills in newer technologies according to big data technology roadmap


What you need to have

Fluent English
Working experience with Big Data Event streaming Technologies
Applied Experience with Kafka and/or Nifi
Applied Experience with Scala and/or Python
Familiarity with the SQL language
Cloud experience (Azure and/or AWS)


Nice to have

Experience with Spark and / or Flink-SQL
Experience with the Cloudera platform or products (e.g.: CDP, Nifi, Kafka, Minifi)
Familiarity with Azure DevOps
Familiarity using Git
Experience in UNIX or UNIX-like systems
Experience with SCRUM or other similar Agile framework

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.