Data Engineer

Trident Consulting is seeking a Data Engineer for one of our clients in Plano, TX A global leader in business and technology services.

Role: Data Engineer

Location: Plano, TX (Hybrid - 3 days office in a week)

Type: Contract

Job Description

Required Skills: Strong Pyspark resource with good SQL and AWS experience

Job Summary: Skilled in Business Intelligence/Data Warehouse, Data and Technical Architecture, Methodology, Architecture, Data Governance, Data Modeling, ETL Tools, Big Data, Data Lake. Strong expertise applying industry best practice methods and sound enterprise architecture, data architecture/ management, and integration techniques across domains.

Responsibilities

• End to End responsibility for data modeling (OLTP, OLAP)
• Data analysis experience with writing complex queries, unions, joins and aggregations.
• Data analysis experience using major RDBMS solutions like snowflake, redshift etc
• Experience with ELT, ETL processes using glue, glue brew transformations.
• Use airflow to schedule and time data transfers.
• Understanding of deep JSON structures and partitioning using Kafka, spark, Scala, s3 etc.
• Work with Data Scientist team to build segmentations, Client use cases, forecasting etc
• Experience working with sagemaker, jupyter notebooks for deep data analysis.
• Work with the BI specialists to design develop and enhance connectors to get closer to business use cases.
• Migration of existing custom pipelines to a normalized connector approach.
  
  

About Trident

Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements.

Some of our recent awards include

• 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America
• 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area