August 20, 2023
Apply Now
Audubon, PA, United States
August 20, 2023
Apply NowJob description
Our client is looking for a Data Engineer that will be responsible for:
- Identifying, creating, and preparing data required for modern BI/ML solutions
- Building data architectures, and data pipelines to collectively bring together data
- Designing solutions using Microsoft Azure services and other tools
- Assuring that data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements
- Automating tasks and deploying production standard code (with unit testing, continuous integration, versioning, etc.)
- Loading transformed data into storage and reporting structures such as data warehouses, real-time reporting systems and analytics applications
- Experience in data engineering and cloud data processing services (Azure Cloud Platform)
- Hands on Experience in Data Warehousing & ETL tools
- Experience in Big Data technologies (e.g. Hadoop, Spark, Databricks, Snowflake)
- Experience building and optimizing 'big data' data pipelines, architectures, and data sets
- Knowledge of SQL and Python/PySpark
- Open mindset, ability to quickly adapt to new technologies and learn new practices
- Knowledge of Oracle PL/SQL, Java is a plus
- Performance/security-oriented data modeling and data design, including partitions, different type of indexes, views, and most effective data management practices
- Azure Synapse Analytics, Azure DevOps
- Knowledge of Purview, Snowflake, Qlik, or Tableau is a plus
- Bachelor’s Degree in Computer Science or similar
- Azure Data Engineer certification (preferred)
- Communication skills
- Collaboration skills
- Presentation skills
