Hadoop/Spark Data Engineer

Company:
Location: Austin, TX

*** Mention DataYoshi when applying ***

Job Title: Hadoop / Spark Data Engineer
Location: Location – Austin, TX
  • Should have Experience working in Spark and Hadoop Cluster with thousands of nodes
  • Design and develop Spark and Hadoop ETL pipelines to process the Terabytes of data in various In
system.
  • Develop automated script to check data quality.
  • Good SQL skills.
  • Develop various transformations for stored procedure.
  • Develop Spark applications with Cassandra lookups to optimize joins
  • Optimize and tune Spark queries, Hive queries and Map-Reduce.

*** Mention DataYoshi when applying ***

Offers you may like...

  • StepWise

    Data Engineer - Python/Hadoop/Scala
    São Carlos, SP
  • itForte

    Data Engineer - Scala/Python/Java/Hadoop/Spark/Kaf...
    Lisboa
  • LiveIntent, Inc.

    Data Engineer (Hadoop/Spark)
    København
  • WorldWide People

    Data Engineer Big Data Hadoop/Spark SQL, Python et...
    Paris (75)
  • NEURONCREDIT PTE. LTD.

    Senior Data Engineer (Hadoop/Sparks/Scala/Python)
    Outram