Position Description
The Data Engineer will play a crucial role in designing, implementing, and maintaining our organization's data infrastructure. This role will contribute to the efficient storage, retrieval, and analysis of data, enabling informed decision-making across our organization.
Responsibilities
- Collaborate with cross-functional teams to understand data requirements to design efficient data warehouse solutions
- Develop and maintain a robust data warehouse architecture that ensures scalability, performance, and data integrity
- Implement pipelines to move raw data in Azure Synapse using Azure Data Factory, SQL, Python, C# in line with well-established architectural standard related to Data Lakehouse and
- Data Warehouse modeling standards
- Data Quality Assurance - ensure data accuracy, consistency, and integrity throughout all processes, and implement data governance best practices.
- Monitor and tune the data warehouse performance to ensure optimal query execution and data retrieval times
- Identify and resolve bottlenecks in the ETL pipelines and data warehouse infrastructure
- Develop and maintain data models, including dimensional and star schemas, to support efficient querying and reporting
- Collaborate with reporting and analytics teams to understand requirements and translate them into effective data structures
- Implement security measures to protect sensitive data within the data warehouse
- Work closely with developers, analysts, and other stakeholders to understand their data needs and provide necessary support
- Document data warehouse processes, data dictionaries, and ETL workflows for knowledge sharing and future reference
- Design, implement, and document data architecture and data modeling solutions
- Participate with Data Analyst(s) as needed to define minimal viable data assets in support of the visual needs.
- Review and provide architectural guidance for analytic solutions
- Triage and troubleshoot data anomalies submitted by the user community
Knowledge, Skills, & Abilities
- Experience with ETL tools and techniques for data integration
- Strong understanding of data modeling concepts, including dimensional modeling and normalization
- Strong communication skills to collaborate with technical and non-technical stakeholders
- Experience with version control systems (e.g., Git) and agile development methodologies is a plus
- Experience in Python/PySpark notebooks
- Experience in Azure Data Factory or SSIS, Azure DW, Azure Data Lake, and Power BI
- Experience with Microsoft Fabric a plus
Requirements
- Proven experience as a Data Warehouse Engineer or in a similar role
- Practical experience in Python related to data engineering (spark, pandas, etc)
- Practical experience in SQL related to data engineering
- Proficiency in designing and implementing data warehouse solutions using technologies such as MS SQL databases and Azure Synapse or other cloud-based data warehousing services
- Ability and initiative to learn and research new concepts, ideas, and technologies quickly
- Ability to work independently as well as function as an integral part of a team, take initiative and contribute in a fast-paced environment
Why Work for Flynn?
Flynn Group offers a variety of benefits and perks to encourage and empower our employees. We are committed to helping each employee work and live to his or her fullest potential. We offer a variety of benefits and perks while working for us:
- Medical/Dental/Vision
- Retirement and Savings Plan
- Short- and Long-Term Disability
- Basic Life Insurance
- Voluntary Life Insurance
- Tuition Reimbursement
- Paid Time Off
- Flexible/Hybrid Work Schedules
- Company Outings
- Dining Discounts
- PC/Laptop Purchase Assistance
- On-Site Fitness Center
- On-Site Daycare
- On-Site Café
- FUN Work Environment!
The Flynn Group is an Equal Opportunity Employer