4+ years of software development experience with Hadoop framework components(HDFS, Spark, Sqoop, Hive, HQL,
Spark, Scala, PySpark)
4+ years of experience using Python, SQL and shell scripting
Experience in developing and tuning spark applications
Excellent understanding of spark architecture, data frames and tuning spark
Strong knowledge of database concepts, systems architecture, and data structures is a must
Process oriented with strong analytical and problem solving skills
Excellent written and verbal communication skills
Bachelor's degree in Computer Science or related field