Data Engineer

Lloyd’s List Intelligence are the trusted experts delivering transparent and actionable maritime data empowering 60,000 professionals around the globe to make confident decisions that drive the safe, efficient, and lawful movement of trade by sea. Our advanced analytics, artificial intelligence, and industry expertise transform our unparalleled data into unique insight delivered through data and analytics services, news and commentary, and publications.

We have teams working across the globe in data and analytics, product management, editorial and market analysis, technology, marketing, sales, and customer success.

Role Profile

Reporting into the Head of Data Engineering, we are seeking a Data Engineer to join our team of existing Data Engineers, Software Engineers, and Data Services Analysts to assist with the ongoing maintenance and innovation of our data processing and ingestion pipelines and systems.

The successful candidate will join a team of engineers responsible for data architecture, back-end development, and maintenance of our data ingestion, streaming and analytical systems. The team is tasked with ensuring our various data ingestion systems achieve a high level of reliability and work closely with our product, data science and software engineering teams to support existing and new data workflows.

This role is balanced working model between home and in our modern and centrally located UK - London office close to St Paul’s, Blackfriars, and Farringdon with an excellent and a wide variety of services and transport links situated nearby.

Key Responsibilities

• Collaborate with Product teams ensuring that raw data is cleansed and transformed and useable by downstream consumers (ML Engineers, BI analytics)
• Expect level PL-SQL
• Assist and advise on the re-development and modernisation of end-to-end ETL pipelines and introduce new technologies where appropriate in a real-time streaming environment dealing with very large data volumes
• Working with AWS cloud infrastructure (specifically SQS, SNS, Redshift, OpenSearch, Athena, Kinesis, AWS code pipeline) to develop, innovate and maintain data flowing through various queues and data warehouses
• Working with a variety of data repository platforms (including SQL stores such as Oracle), as well as implementing data visualisation and network analysis (e.g GraphdB)
• Maintain and ‘productionise’ machine learning and AI models
• Assist in the creation of next generation data ingestion platforms – sourcing data using Webscrapes, APIs, Email, and flat file (FTP) methods
• Understanding conflict resolution methods and assist subject matter experts in the debugging on data ingestion and managing overall feed uptimes across a large set of data collectors.
• Create and maintain detailed documentation and functional design specifications including data flows and data conversion
• Provide technical information to assist in the development of client facing product documentation
• Adhere to change management protocols and version control
• Present advanced technical designs with non-technical stakeholders

What we are looking for:

Essential

• Bachelor’s honours degree preferably in computer science, or engineering field, or demonstrable technical experience in a related engineering discipline
• At least 3 years of ETL experience using flat files to transposed Data Models
• Experience in troubleshooting and debugging SQL (Oracle & other SQL platforms), SNS, SQS, Kinesis and AWS Lambda
• Strong Data Mining and Analytical skills required to encode sophisticated business transformation logic in a pipeline and serve predictive models
• Familiarity with the design, development, and maintenance of best-in-class BI capabilities, including data warehouse data structures and data pipelines (Redshift, Athena etc)
• Familiarity with Agile development process
• Exceptional analytical thinking ability, ease with quantitative analysis, and excellent problem-solving skills
• Self–discipline and willingness to learn
• Ability to make connections with technical and non-technical stakeholders
• Excellent verbal and written communication skills

Desirable

• Experience of streaming or ‘real-time’ processing at high data volumes
• Previous experience using JAVA and C#
• Familiarity of architectural design patterns for micro-services leveraging relational and big data technologies
• Demonstrable experience working with Big Data environments
• Experience of the SAS Analytics platform of particular interest

Our Promise to You – Benefits

• 25 Days Holiday rising to 27 after 2 years’ service and a day off for your birthday
• Work anywhere policy (up to 4 weeks per year, subject to approval)
• Life Assurance for 4 x Salary
• Company pension scheme: employee contribution of 5% basic salary, matched by an employer contribution of 5%
• Up to 4 Days Paid Volunteering
• Healthy Lifestyle Subsidy up toa £250
• Enhanced Family Leave (Maternity, Paternity, Shared Parental Leave)
• Flexible benefits including Private Healthcare Plan and Dental Insurance

We know that sometimes the 'perfect candidate' doesn't exist, and that people can be put off applying for a job if they don't fit all the requirements. If you're excited about working for us and have most, but not all of the skills or experience we're looking for, please go ahead and apply. You could be just what we need!

We believe strongly in the value of diversity and creating supportive, inclusive environments where our colleagues can succeed. As such, we are proud to be an Equal Opportunity Employer. We do not discriminate on the basis of race, colour, ancestry, national origin, religion, or religious creed, mental or physical disability, medical condition, genetic information, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity, gender expression, age, marital status, military or veteran status, citizenship, or other protected characteristics under federal, state or local law.

Please let us know of any adjustments we need to make for you to show us your best self.