Job description

Transforming the Future with Convergence of Simulation and Data

Data Engineer General

Job Summary:

Our client in Dearborn, MI is looking for an Data Engineer General. This is a contract position.

What You Will Do:

  • Our client's Data Factory Platform covers all business processes and technical components involved in ingesting a wide range of enterprise data into the GDIA Data Factory (Data Lake) and the transformation of that data into consumable data sets in support of analytics.
  • The Ingestion Patterns team will own end to end responsibility for the platform operating model which includes defining the business integration model, platform governance processes, problem management processes and resiliency actions. Additionally, the team will be responsible for defining standards and best practices across all tenants and consumers of Platform resources. Data Factory Engineers will be responsible for designing ingestion patterns and modernization of our client's big data solutions on GCP cloud integrating native GCP services and 3rd party data technologies. Experience with large scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of GCP and 3rd party technologies for deploying on GCP cloud.

Key responsibilities include:

  • Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successfully deployment of our client's Data Platform.
  • Implement methods for standardization of all parts of the pipeline to maximize data usability and consistency.
  • Identify, develop, evaluate and summarize Proof of Concepts to prove out solutions.
  • Test and compare competing solutions and report out a point of view on the best solution.
  • Design and build solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) services: BigQuery, DataFlow, Pub/Sub, Data Fusion.

Basics:

  • BS in Computer Science or related.
  • Someone who understands Cloud as being a way to operate and not a place to host systems.
  • Someone in this domain who understands data architectures and design independent of the technology.
  • Someone who understands fundamental techniques such as parallel processing, partitioning, sharding in terms of how and when to apply these approaches vs how they are used in a tech stack like MR/Hive/TD etc... as these concepts are powerful when applied at the right time and place in our data engineering and analytics projects.
  • In-depth understanding of Google's product technology and underlying architectures.
  • Experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc, etc.
  • Experience with development eco-system such as Git, Jenkins, Terraform and Tekton for CI/CD.
  • Coding skills in Python & Java.
  • Exceptional problem solving and communication skills.
  • Experience in working with Agile and Lean methodologies.
  • 5+ years of application development experience required.
  • 3+ years of GCP experience.

Preferred:

  • Google Cloud Platform (GCP) Certification preferred.

How You Will Be Successful:

  • Envision the Future
  • Communicate Honestly and Broadly
  • Seek Technology and Business “First”
  • Embrace Diversity and Take Risks

What We Offer:

  • Competitive Salary
  • Comprehensive Benefit Package
  • 401(k) with matching contributions
  • Paid Time Off
  • Employee Discounts
  • Free training on all Altair products

Why Work with Us:

Altair is a global technology company providing software and cloud solutions in the areas of data analytics, product development, and high-performance computing (HPC). Altair enables organizations in nearly every industry to compete more effectively in a connected world, while creating a more sustainable future. With more than 3,000 engineers, scientists, and creative thinkers in 25 countries, we help solve our customer’s toughest challenges and deliver unparalleled service, helping the innovators innovate, drive better decisions, and turn today’s problems into tomorrow’s opportunities.

Our vision is to transform customer decision making with data analytics, simulation, and high-performance computing.

For more than 30 years, we have been helping our customers integrate electronics and controls with mechanical design to expand product value, develop AI, simulation and data-driven digital twins to drive better decisions, and deliver advanced HPC and cloud solutions to support unlimited idea exploration. To learn more, please visit altair.com

Ready to go? #ONLYFORWARD

At our core we are explorers; adventures; pioneers. We are the brains behind some of the world’s most revolutionary innovations and are not only comfortable in new and unchartered waters, we dive headfirst. We are the original trailblazers that make the impossible possible, discovering new solutions to our customer’s toughest challenges.

Altair is an equal opportunity employer. Our backgrounds are diverse, and every member of our global team is critical to our success. Altair’s history demonstrations a belief that empowering each individual authentic voice reinforces a culture that thrives because of the uniqueness among our team.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
GlobalLogic
August 15, 2022

Data Engineer III

IBM
August 15, 2022