AWS Data Engineer

Job description

Duration: 5+ Months

Job Description:

  • Experienced in ETL optimization, designing, coding, and tuning using Apache Spark or similar technologies.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Demonstrate efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
  • Experience with languages like Python, R, and other programming language
  • Extensive experience developing Spark applications and Scala programming languages.
  • Familiar with various cloud data sources and architectures such as AWS/S3, EC2, EMR, Lambda, Parquet, Kafka
  • Experience with both relational database design (SQL), non-relational (NoSQL) databases, real-time technologies
  • Familiarity with Docker, CI/CD (such as Jenkins/Gitlab), AWS
  • Strong understanding of cloud architecture and Big data fundamentals.
  • Support continuing increases in data velocity, volume, and complexity Self-directed, ability to multi-task, sharp analytical abilities, excellent communication skills, capable of working effectively in a dynamic environment
  • Collaborate closely with fellow data team members as well as tech and product teams and company leaders
  • Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines and knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
  • Strong OO & FP design patterns, data structure, and algorithm design skills
  • Experience with or knowledge of Agile Software Development methodologies
  • Experience developing and/or consuming web interfaces (REST API) and associated skills (HTTP, web services)
  • Experience with digital advertising technologies.

The Capgemini Freelancer Gateway is enabled by a cutting-edge software platform that leads the contingent labor world for technology innovation. The software platform leverages Machine Learning and Artificial Intelligence to make sure the right people end up in the right job.

A global leader in consulting, technology services, and digital transformation, Capgemini is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital, and platforms. Building on its strong 50 year heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. It is a multicultural company of over 200,000 team members in more than 40 countries. The Group reported 2018 global revenues of EUR 13.2 billion.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
August 10, 2022

AWS Data Engineer

August 10, 2022