Staff Big Data Engineer (Remote)

Job description

Who are we? At Kohl's, we are revolutionizing the retail industry by leveraging the power of technology to create exceptional customer experiences. We are seeking passionate and innovative Big Data Software Engineers to join our product-centric environment that will unleash your full potential. As a Senior Big Data Software Engineer at Kohl's, you will play a crucial role in developing and maintaining our data infrastructure and analytics solutions. You will be responsible for designing, building, and optimizing scalable big data pipelines and applications, leveraging technologies such as Python, Spark, SQL, Airflow, and Google Cloud Platform (GCP). You will work closely with cross-functional teams to understand data requirements, identify opportunities for data-driven insights, and develop solutions to address complex business problems. So, if you're ready to join a team that values your expertise, encourages your creativity, and provides you with the tools to thrive, then look no further. Apply now and be part of our exciting journey to redefine the future of retail!

What You’ll Be Doing
  • Drive development, testing, deployments, and iterative improvement of product capabilities and features in collaboration with designers, product managers, and other engineers on the product team
  • Develop and maintain scalable data processing systems using Python, Spark, SQL, Airflow, and GCP (Google Cloud Platform).
  • Design, implement, and optimize data pipelines, ETL processes, and data workflows to support analytics and reporting requirements.
  • Collaborate with the DevOps team to ensure the deployment, scalability, and security of big data infrastructure and applications.
  • Contribute to code reviews, documentation, and best practices to foster a collaborative and high-quality engineering culture. Pairs with and mentors engineers while evangelizing best practices.
  • Demonstrated understanding of source control systems such as GIT
  • Extensive Database Design experience including either SQL
  • Implementing ETL process with Big Data Technologies
  • Experience working with Cloud Technologies such as: AWS, Azure, Google Cloud
  • Experience with Dash-boarding tools such as: Tableau, Qlik, Sigma
  • Required: Spark, Python, Scala and Airflow
  • Preferred: MapReduce, Pig, Hive, Kafka, Sqoop, and Flume
  • Strong Knowledge of build management tools such as Jenkins or Maven
  • Experience in designing and creating automation workflows and execution
  • Extensive knowledge of Apache Airflow Developing DAG, Performance tuning of the DAGs and task implementation
  • Experience working with distributed caching technologies such as REDIS
  • Hands-on lead developer/architect who excels in a dynamic, fast-moving, and agile environment building high quality and high-performance Data Engineering software
  • You will be expected to work equally between design, hands-on development, and providing mentorship to our other developers
req# : R328294

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Micron Technology
September 28, 2023

Staff Big Data Engineer

Loblaw Digital
September 28, 2023

Staff BI Data Engineer

Affinity Solutions
September 28, 2023