Data Engineer

Analyze and organize raw data. Automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability. Prepare data for prescriptive and predictive modelling. To design, build and support data pipelines for ingestion, transformation, deployment, conversion, and validation Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies Conduct data assessment, perform data quality and performance checks, and transform and load raw data using SQL and ETL tools Professional Skills & Qualification Proven experience as a Data Engineer, devOps engineer or similar role. Understanding of data structures, data modeling and software architecture. Hands-on-experience with SQL/NO-SQL (MySQL/ Postgres/Cassandra /MongoDB). Good knowledge and coding experience in one or more programming languages such as Python, Java, JavaScript. Knowledge of web scraping and tools. Knowledge of... Object-oriented programming. Experience with AWS cloud services (EC2). Experience in Deploying Machine Learning/Deep Learning models on cloud. Experience with big data tools: Hadoop, Spark. Experience with applications designed to display archived web content. Experience with AWS cloud services (EC2). Knowledge of Data Analytics pipeline. Deep knowledge of math, probability & statistics. Outstanding analytical and problem-solving skills. 2-4 years experience with a Bachelor s Degree in Computer Science, Engineering, Technology or related field required,

This job is provided by Shine.com