Description
Robert Half is in need of a Lead Azure Data Engineer. You will have a great opportunity to be a part of a forward-thinking team. This position needs someone who can handle sudden-changing work environments. As the lead, you will be the subject matter expert for your team and will be asked to collaborate with other teams to meet business requirements. This person must have an upbeat attitude and willing to wear multiple hats.
Responsibilities
- Develop efficient solutions/processes to expedite new dataset ingestion.
- Develop comprehensive data quality checks for the data platform, including alerts, notifications and automation for exception handling.
- Requirements gathering from data consumers
- Manage code releases and promote development work to the Production environment.
- Fine tune performance of complex queries against large datasets.
- Develop/refine workflow automation jobs.
- Assist business teams with complex query development working with stakeholders to understand their analysis requirements and build efficient queries accordingly.
- Build result sets and analysis models to specification using Python.
- Collaborate with UI teams on UI integration for the data platform.
Requirements
- 5+ years in a leadership Data Engineer role.
- Extensive experience within AWS cloud framework.
- Proficient with the use of Snowflake and Pyspark.
- Deep understanding of ETL pipelines and how to build them.
- Deep knowledge of workflow automation tools including workflow development/scripting.
- Strong understanding of relational database design, data warehousing and operational data stores. Ability to model new datasets effectively within existing environments.
- Highly effective time management skills and the ability to work independently and deliver in a fast paced environment.
- Excellent communication skills including the ability to communicate effectively in both formal and informal contexts in a manner tailored for the audience.
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Robert Half puts you in the best position to succeed by advocating on your behalf and promoting you to employers. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity – even on the go.
Robert Half will consider qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance. All applicants applying for U.S. job openings must be authorized to work in the United States. Benefits are available to temporary professionals. Visit
© 2022 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to