Data Engineer

Job description

Company Overview
Incedo is a US-based consulting, data science and technology services firm with over 2,500 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.
Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities are also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.
Role Description
Will be responsible to design, develop, integrate, and maintain Enterprise level Big Data Systems with both batch and streaming datasets. Should have a very strong understanding of MPP databases, Shared Nothing, Shared-disk, and other Modern Big Data tech stack like Spark, Hadoop, AWS Redshift, Confluent Kafka, AWS Kinesis, and other Streaming technologies. This individual is expected to design Big Data systems based on Industry best practices and architectural guidance of Big Data systems, with understanding of integration with other data sources and tools like Markit, Business objects, Informatica, MS SQL, PL/SQL, etc. Enhance/Maintain/support existing applications. Collaborate with other developers in designing.

Job Description
  • Partner with business leadership to identify problems, and opportunities for technology innovation with a focus on Big Data implementations.
  • Help establish a clear, consistent technology vision through collaboration, influence, and enablement.
  • Research, recommend, design, and develop Big Data systems with a sound understanding of the Big Data application architecture and Integration.
  • Identify and assess the organizational impact of enterprise architecture and standards, including change in skills, processes, and structures with an emphasis on the DataWarehouse.
  • Should have developed ETL pipeline using Python & Spark or PySpark
  • Extensive experience in SQL query tuning -
  • Experience working in an onsite client technical consulting environment preferred.
  • Source code version control management using tools like Git/GitHub
  • Experiences working within Agile Frameworks, such as Scrum or Kanban
  • Excellent communication skills to be able to interact directly with non-technical client stakeholders and act in a business-to-technical translation role.
  • In educational qualification – the candidate must have someone with Computer Science degree
  • Experience: Focus on 4+ years of total experience with 1+ years of experience in Databricks and PySpark
  • Creating robust and extensible data pipelines for production systems
  • Creating secure, performant, and well-modeled data stores
  • Must be fluent in any one of the scripting languages such as Python/Java
Company Value We are an Equal Opportunity Employer. We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Competencies R1: Driving world-class quality R1: Expertise (technical / domain / functional) R2: Expertise R2: Process Orientation / Innovation R2: Team collaboration / Management R3: Communication R3: Learning mindset R3: Positive attitude R3: Problem Solving

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.