All new
Data Science
jobs, in one place.

Updated daily to help you be the first to apply ⏱

avatar4avatar1avatar5avatar3avatar2
Data Engineer - PySpark, Remote
  • Python
  • Spark
  • PySpark
  • Databricks
  • Excel
  • Scala
  • Kafka
Harnham
London
123 days ago

DATA ENGINEER - PYSPARK

FULLY REMOTE - 2-3 DAYS IN THE OFFICE PER MONTH

SALARY DETAILS ON REQUEST

This company are a young insurance business who have been trying to challenge the status-quo since inception. They have recently gone through a large scale data transformation and this has led to a data driven CEO/CPO being hired.

A key component to this transformation is a new, greenfield data platform that is being built. As a Data Engineer, you will join this project in early stages and heavily contribute to the build.

COMPANY:

This company build and develop insurance products for the digital age - they are currently in the middle of an exciting tech transformation to become a fully fledged fintech/insuretech business. The decision has been made to transform the entire IT estate, which includes building a greenfield data platform from the ground up to enable both batch and real time data usage.

This platform will be built within an AWS infrastructure and heavily relies on Spark and PySpark. You will also build real-time data pipelines using kafka/kinesis.

ROLE:

  • Design and build scalable data pipelines using PySpark.
  • Build data infrastructure within AWS, utilising a number of AWS services.
  • Orchestrate data workflows using Databricks (on AWS).
  • Bring experience of AGILE ways of working and software engineering best practices to the team.

YOUR SKILLS & EXPERIENCES:

  • Excellent python software engineering skills
  • Experience with PySpark
  • Experience with AWS or other cloud environments
  • Experience with docker/databricks/airflow

HOW TO APPLY:

Please register your interest by sending you CV to Joshua Carter via the apply link on this page. (The Company have outlined a fully remote interview process and have a remote on-boarding policy in place)

    Related Jobs

  • Data Scientist

    • Modeling
    • SQL
    • scikit-learn
    O'Reilly Media
    Remote
    12 days ago
  • Data Engineer, Sr - (Pop Health Analytics /Care Management)

    • SQL
    Health Catalyst
    Remote
    6 days ago
  • Data Analyst Senior - Remote

    • Data Visualization
    Progressiv...
    Mayfield Village
    15 days ago
  • Data and Machine Learning Engineer

    • Python
    • SQL
    • BigQuery
    WEX Inc.
    Remote
    7 days ago
  • Data Scientist (m/f/d) - remote

    • Python
    • Data Visualization
    • Tableau
    Yelp
    Hamburg
    Today