Data Engineer

Responsibilities:

• 8 years of total IT experience in DWBI with at least 4 years in AWS
• End to end implementation of Cloud data engineering solution AWS (EC2, S3, EMR, Spectrum, Dynamo DB, RDS, Redshift, Glue, Kinesis)
• End to end implementation of Big data solution on Cloudera Hortonworks MapR ecosystem
• Batch solution and distributed computing using ETLELT (SSIS Informatica Talend Spark SQL Spark Data frame AWS Glue ADF)
• DWBI (MSBI, Oracle, Teradata), Data modeling, performance tuning, memory optimization DB partitioning
• Frameworks, reusable components, accelerators, CICD automation
• Languages (Python, Scala)