Data Engineer

• 3-6 years of Experience in Java/Scala.

• 2+ years of hands-on experience in Hadoop programming

• 2+ years hands-on experience in Java, Scala, Spark, Python, PySpark

• 2+ years of hands-on experience in building REST APIs

• Experience with Cloud-based HaaS/PaaS solutions such as AWS EMR

• Hands-on experience with Kafka, NiFi, AWS, Maven, Stash and Bamboo

• Hands-on experience to write MapReduce jobs.

• Strong exposure in Object Oriented concepts and implementation

• Strong knowledge of spark architecture.

• Familiarity with cloud databases like AWS Redshift, Aurora MySQL.

• Knowledge of workflow/schedulers like Oozie or Apache AirFlow.

• Analytical and problem-solving skills, applied to Big Data domain

• Good aptitude in multi-threading and concurrency concepts

• Work with DevOps team to create and maintain data pipelines
• Maintain / Enhance existing Algorithms
• Validate / Verify algorithmic results
• Build/maintain UNIX shell scripts
• Manage Web Application that delivers Algorithmic Output to users
• Work with Cloud security and Network security teams to implement solutions

Contract

04/15/2021