The recruitment team at Myticas Consulting is looking for a Data Engineer and analytics team to o work with some of the emerging technologies in the data engineering and in the cloud. This is an opportunity to build high performance scalable data pipelines while adopting industry best practices on data management, quality, and automation. In this role you will represent the data organization and will be working with key stakeholders across the organization on strategic business initiatives. We need someone adept with SQL, Python and AWS.
5+ years of experience working with enterprise data platforms, building and managing data lakes, and using big data technologies
3+ years of experience working within the AWS platform. Experience solutioning on AWS infrastructure using services like AWS IAM, S3, Lambda, Lake formation, and Redshift
2+ years of experience with using Python for data engineering and developing high performance, and scalable data pipelines
Prior experience with traditional ETL tools like Talend Open Studio, Informatica, Pentaho, or something similar is strongly preferred
Experience with automating and orchestrating jobs on a big data platform using Airflow, Jenkins, or similar technologies
Good understanding and experience working with various products in the big data ecosystem like Spark, EMR, Hive, NoSQL databases like DynamoDB, and Cassandra
Prior experience with working in a SQL server based environment and using SSIS, SSRS, and TSQL is preferred.
Has to be a team player and open to working with newer technologies as well as supporting legacy systems