Job description

TITLE: Lead Data Engineer
Location:Houston, Texas

Job Description

Our client is currently seeking an experienced Data Engineer to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Lead Data Engineer will work closely with Business domain experts and Data Scientists to solve real-world oil and gas midstream problems using advanced analytics, machine learning, and artificial intelligence. This individual will provide analytical and technical leadership to the team to advance the data engineering practice within the organization.

Responsibilities include:
  • Work directly with Business domain experts and Data Scientists to understand the analytics objective and deliver trusted, cleansed, curated data sets in a timely manner
  • Architect and implement high quality analytical applications and data products
  • Automate manual data flows for repeated use and scalability
  • Align and integrate disparate data sources together creating new data sets for analysis
  • Develop and maintain conceptual and logical Enterprise Data Models
  • Assists data analysts and data scientists with data extraction, feature engineering, query optimization, and data processing
  • Perform data platform performance tuning and query optimization
  • Implement data quality checks to ensure data accuracy, consistency, and reliability
  • Identify opportunities for data improvements and presents recommendations to management

Qualifications

The successful candidate will meet the following qualifications:
  • 10+ years of experience working as a data professional
  • 7+ years of experience in SQL
  • 5+ years of programming experience in Python
  • Experience with creating conceptual, logical, and physical data models
  • Experience with data management best practices including data catalog, master data management, and data lineage
  • Experience in presenting and explaining complex concepts to stakeholders
  • Experience with Data Lake storage formats such as Parquet, Delta Lake, and Apache Iceberg
  • Experience with distributed processing frameworks such as PySpark and Dask
  • Experience with software development practices such as Design Principles and Patterns, Unit Testing, CI/CD, and version control
$150,000 Salary

About Infinity Consulting Solutions
At Infinity Consulting Solutions our mission is to cultivate successful long term relationships with candidates and clients matching the right candidate with the right client. We believe technology cannot replace the real personal relationships we cultivate. We reject the notion that technology alone is the answer to staffing which is why we our successful partnerships rely on collaboration NOT automation. ICS has been providing flexible staffing solutions for over 20 years in Information Technology, Compliance, Accounting / Finance and Corporate Support. Our staffing solutions include Contract, Temp to Perm and Permanent Placement.
ICS is an Equal Opportunity Employer.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.