Avanade

Data Engineer Consultant

Job description

Job Description

Job Description

Welcome to Avanade X!

Short for Experiences, Avanade X is where strategy and technology converge with design to create human impact. At Avanade X we create relevant and enduring experiences to accelerate growth. We bring together data, creativity, and engineering to help clients imagine beyond convention, give technology purpose and make what matters.

Do you love making sure that information is available and consumable? So do we.

As a Data Engineer Consultant, you know the importance of data to the business. You design and set up projects that bring together information from various sources to enable analysis and decision-making. You make sure that data is accessible and easy to use for routine and ad-hoc analysis.

Day-to-day, you will be:

  • Use your knowledge to plan and deliver data warehouses and storage
  • Take part in crafting and running bespoke data services for individual projects
  • Stay up to date with business best practice in using and retrieving data
  • Support client's application within data and applications operations team as primary support member
  • Monitor and troubleshoot client's data pipeline using Python, SQL and Spark skills
  • Respond to incident tickets/concerns raised by client, attend weekly meetings with client to provide updates and answer questions
  • Utilize Python programming, Azure DevOps and Hadoop ecosystem (HDFS, YARN, Hive, Oozie) to support the application
  • Collaborate with various teams to stabilize the application by fixing bugs in the code, data reconciliation, automation, etc.
  • Design, develop, adapt, and maintain data warehouse architecture and relational databases that support data mining
  • Customize storage and extraction, metadata, and information repositories
  • Build and use effective metrics and monitoring processes
  • Help to develop business intelligence tools
  • Craft and maintain report forms and formats, information dashboards, data generators and canned reports, as well as other information portals and resources

About you:

You’re a Data Engineer who knows how to find, store, analyze, transform and present a range of information from different sources so that everyone can access what they need effectively.

Your skills and experience likely include:

  • Hands-on in structured problem-solving.
  • Excellent collaboration skills with business analysts and data scientists.
  • The ability to apply methods to tackle business problems using one or more Azure Data and Analytics services combined with building data pipelines, data streams, and system integration.
  • Being engaged in end-to-end Data Ingestion → Data Transformation → Data Persistence → Performance Optimization process.

Minimum technical requirements:

Good understanding and experience with at least two of the following platforms \ frameworks

  • Databricks
  • Azure Synapse
  • Azure Data Factory
  • Graphs
  • SQL Server, Azure Data Lake, CosmosDB
  • Git
  • Good understanding of batch and streaming typical architectures.
  • Python
  • Pyspark
  • SQL
  • Databricks
  • DevOps

The following are important for us, any knowledge/experience would be a huge advantage:

  • Snowflake
  • Azure Synapse Analytics
  • Delta Lake
  • Azure Streaming Analytics
  • Azure IoT

About Avanade

Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals in 26 countries make a genuine human impact for our clients, their employees and their customers.

We have been recognized as Microsoft’s Global SI Partner of the Year more than any other company. With the most Microsoft certifications (60,000+) and 18 (out of 18) Gold-level Microsoft competencies, we are uniquely positioned to help businesses grow and solve their toughest challenges.

We are a people first company, committed to providing an inclusive workplace where employees feel comfortable being their authentic selves. As a responsible business, we are building a sustainable world and helping young people from underrepresented communities fulfil their potential.

Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation. Learn more at www.avanade.com .

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Fanatics, Inc.
January 29, 2023
MasterBrand Cabinets LLC
January 29, 2023
Paxos
January 29, 2023