Title: Senior Data Engineer Job Type: Permanent Salary: £75,000 - £85,000 Location: Hybrid: 1-day per week in Leeds The Client Our client is committed to capturing the true essence of every sporting moment and is expecting data to revolutionise the communication between coaches, athletes and fans. As part of their expanding football division, they require a skilled Senior Data Engineer to work collaboratively on products related to football. Your primary responsibility is to create and establish a sturdy foundation for all their football-related data by defining and establishing a football data platform. Integration of all client data sources into a unified and accurate central platform is your core task. You will work closely with data scientists and their partner companies to collaborate on features and put their models into production. Additionally, you will be responsible for building a customer-facing API and data feeds for the client. It is worth noting that you will have the opportunity to interact with experienced professionals from various sectors of sports while working in a fast-growing organisation. Hybrid This position is 4 days remote, with 1 day per week working in the Leeds office. The client would also like for someone to be willing to come onsite for 1 day per month to the Kennington, London office. Essential Experience Fully hands on data engineering experience. 6-10 years experience in Data space Python
- Experienced writing testing and clean OOP Python code Testing
- Unit Testing, Functional Testing Cloud
- EC2, Route53, S3, Lambda, RDS, Glue Databases
- Mandatory: MySQL. Desirable
- MongoDB Data Engineering
- Data Processing specifically: Distributed computing and data processing tech (PySpark, Lambda) Batch Processing of large data sets Scalable Data Storage (storing data at scale) ETL API Development Desirable Experience Data Engineering
- Data Processing specifically: streaming data (streaming at scale) Worked in startup environment before Worked in a real-time processing projects before Worked for a data company in Sport Any Tech Lead experience, leading a team of 1-2 developers (or more) Thus, Mentoring experience is highly desirable The Project Build and maintain robust ETL pipelines Design and build data feed production modules Ingest and merge data from multiple internal and external sources Design, develop and deploy APIs for internal and external use Monitor data quality for accuracy and completeness Collaborate with the data science team on feature development, model deployment and monitoring Strong requirements gathering skills Good experience working in Agile environments Interview Process Stage 1: 30-minute initial video call to clarify role and fit Stage 2: 45-minute interview with Head of Engineering Stage 3: 60-minute potential final interview Company Benefits 25-day holiday Flexible working hours Company pension scheme Company life assurance