Airport Insights - Senior Data Engineer

Purpose of the role

Today, Data is the most valuable asset for an IT Company: For Amadeus, an in-depth understanding of how an airport is running gives edges when making strategic, operational and sustainable decisions.
Collecting relevant and good-quality data and turning it into usable business intelligence is key for decision-makers. However, harnessing the tremendous amount of data generated by our applications and the applications our customers uses to exploit them efficiently is an incredibly complex challenge.

Our team, Airport Insight, is in charge of the new platform part of the Amadeus Airport IT solutions that leverage the latest cloud and big/fast data technologies to collect, centralize, correlate and generate comprehensive, near real-time and dynamic reports to make the most out of these data.
We leverage Azure-managed services to provide a cloud-native streaming data platform which interfaces with Microsoft Power BI to offer actionable insights after transforming the data coming from all across the Amadeus and the airports ecosystems.
This platform is also the foundation for the usage of Artificial Intelligence within Airport IT solutions.

The Airport Insight development team is currently composed of Business Analysts, Data Scientists and Software Development Engineers and we are looking right now for a Senior Data Engineer to join us in our London Heathrow office.
The ideal candidate should have a proven track record in implementing data ingestion and transformation pipelines for large-scale data warehousing systems. Additionally, we are seeking someone with deep technical expertise and strong collaborative skills to play an important role in fuelling and guiding the technical vision of the Airport Insights product, as well as developing and delivering production implementation.

You will work with the other team members to ensure the delivery of high-quality customer requirements, and with the application architects, Big/Fast Data Train and Amadeus Security Office in order to build and deliver all the way to Production the various elements of Airport Insight.

The team organisation follows Agile principles and since the transformation to SAFe methodology, we are part of the Galaxy Express 999 Release Train within the Airports and Airline Operation organization.
This allows us to give more visibility on the delivery, transparency and alignment with all the stakeholders and dependent teams and better manage our priorities at the Business Domain level.

Main responsibilities

Planning

• Co-ordinates and plans own activities and those of others.
• Contributes to the planning of major projects providing sizings and costing.
• Aware of costs and profitability in a work area and/or large projects.
• Records time accurately.
• Proactively reports progress and highlights/escalates issues and anticipated problems up the decision chain.

Solution design

• Analyse needs and requirements, from customer and internal sources, and propose functional/technical solution recommendations with supporting rationale
• Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory)
• Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks or big data stack
• Writes and/or contributes to feasibility studies/analysis documents which have key impact in the organisation.
• Takes responsibility across the full project life cycle.
• Coordinate those interactions from building phase to delivery to ensure the compliance of the delivered functionality.
• Carry out the functional walk-through of the product with the Development team and Product Management
• Contribute with QA teams to product quality by giving inputs for the test strategy

Technical Function

• Acts as a technical authority of the Airport Insight application, working in partnership with clients and internal Amadeus Stakeholders - TPE, Data Train, Security Office, Cloud architects.
• Propose, enforce and implement processes and development techniques to drive the team towards technical excellence.
• Applies knowledge and skills through the handling of complex problems and/or coordinating work, which may extend beyond own area of expertise.
• Presents highly complex ideas, preparing a case to overcome objections and influencing others to their way of thinking.
• Identifies technical risks and takes responsibility for mitigating and managing them.
• Delivers, including personally producing, comprehensive and high-quality operational software and documentation necessary for the application.

Business Knowledge

• Anticipates customer needs and works in partnership with the customer to define requirements and feasibility for short and long-term solutions.
• Looks beyond the immediate problem to wider implications, anticipating and identifying trends.
• Has a breadth of knowledge in more than one application area.

Procedural Knowledge

• Champions standards of quality and delivery and promotes good practice.

Working with others

• Is a lead contributor individually and as a team member, providing direction for others.
• Influences change and see it through.
• Builds networks internally and externally.
• Works with minimal supervision often in a complex environment.
• May represent Amadeus when dealing with external interfaces.

Skills Development

• Conversant with technology and industry trends.
• Able to adapt to new technologies and become rapidly competent in using them.

Application Management

• Improves technical application issues by updating existing software and associated documentation to ensure stability, availability and reliability.

Support Maintain and optimise

• Troubleshoot and investigate defects raised by our customers to ensure compliance of our products to the specifications and system integrity
• Communicate with customers on the steps taken to solve the issues

Tutoring - Support

• Shares expertise with colleagues and others, offering mentoring and guidance and controlling the standards of less experienced programmers.
• Acts as a facilitator and mentor, moving the team forward.

Job Holder Profile

Education

Post-secondary degree in Computer Science or related technical field or equivalent experience

Relevant work experience

• 3-5 years of experience in data warehouse stack
• Computer Science fundamentals in object-oriented design, data structures
• Computer Science fundamentals in algorithm design, problem-solving, and complexity analysis
• Strong technical experience with Spark, Scala, Open Source Big Data products and SQL
• Knowledge in public or private cloud environment is a plus

Business understanding

• An understanding of what it takes to design, build and operate a large scale, complex system that has to operate flawlessly 24x7, 365 days per year.
• We believe in aiming for excellence, taking responsibility, working together and putting our customers first. We need you to display these qualities too.
• Good analytical and critical thinking skills with excellent interpersonal skills – you will work with other operations and development teams on a daily basis.

Skills

Computing

• Strong technical skills with hands on experience in building enterprise products.
• Strong technical knowledge and hands on experience with object-oriented design
• Good knowledge of data structures, algorithms and distributed systems design
• Experienced with Scala/Java, Python, Spark and SQL
• Strong review skills – design, architecture and code review
• Knowledge of software best practices, like TDD / BDD and Continuous Integration (CI)
• Cloud computing and streaming data platform paradigms and technologies

Languages

• Fluent English

Specific knowledge

• Airline or Airport IT industry experience is a plus

Other

• Strong interpersonal, communication and presentation skills
• Ability to coach and mentor technical leads, design engineers
• Resolve design issues, integration issues, propose long term architecture to overcome it
• Ability to learn and adapt new technology and processes
• Accountability for Results & Proactivity
• Mindset of innovation and resilience

Diversity & Inclusion

We are an Equal Opportunity Employer and seek to hire the best candidate regardless of age, beliefs, disability, ethnicity, gender or sexual orientation.