Data Engineer

Company:
Location: Carnaxide

*** Mention DataYoshi when applying ***

General Information

Location:
  • City: Carnaxide
  • Country: Portugal
  • Region: Europe

Job Category: Information & Knowledge
Job Type: Regular
Type of Contract: Permanent
Working time: Full-time
Work schedule: Day shift
Solvay is a science company whose technologies bring benefits to many aspects of daily life. With more than 24,100 employees in 64 countries, Solvay bonds people, ideas and elements to reinvent progress. The Group seeks to create sustainable shared value for all, notably through its Solvay One Planet plan crafted around three pillars: protecting the climate, preserving resources and fostering better life. The Group’s innovative solutions contribute to safer, cleaner, and more sustainable products found in homes, food and consumer goods, planes, cars, batteries, smart devices, health care applications, water and air purification systems. Founded in 1863, Solvay today ranks among the world’s top three companies for the vast majority of its activities and delivered net sales of €10.2 billion in 2019. Solvay is listed on Euronext Brussels (SOLB) and Paris and in the United States, where its shares (SOLVY) are traded through a Level I ADR program.

Solvay Busines Services (SBS) is the global organization supporting internal and external growth by integrating the major end-to-end administrative processes as well as the information services of the Solvay Group, through three strategic objectives: strategic agility and customer centricity, service excellence and talents and innovation.

Job Overview and Responsibilities

Data Engineers are part of a multi-disciplinary team along with Scrum Masters, Data Analysts, and Data Stewards to deliver data focused solutions. They have a key role to play within the Data team
by designing and building cutting edge data pipelines which can collect, process, transform and curate large amounts of data volumes in velocity and variety, while also integrating the needed data quality controls, metadata and monitoring mechanisms for a E2E data supply chain.

His/her key responsibilities will be:
  • Participate in sprint planning to estimate development effort
  • Implements data pipelines for ingestion, creation, and transformation of sources and data «models (batch or streaming)
  • Develop and execute jobs to import data periodically
  • Delivers data sourcing approach and datasets for analysis, with activities including data staging, ELT, data quality, archiving and retention
  • Profile data and validate whether fit for purpose
  • Integrates the new data into existing analytical datasets
  • Executes system unitary, integration & performance tests

Education and Experience

University degree in Information Systems, Computer Science, Engineering or related areas
Minimum: >5 years of hands-on experience with data engineering, including data modeling, data integration and data quality

Skills

Hard Skills:
  • Experience with Agile methodologies and DevOps/DataOps
  • Experience in Requirements Engineering, Solution Architecture, Design, Development and Deployment
  • Experience in integrating data into analytical platforms
  • Experience with ingestion technologies (SAP InfoSteward, SAP BW, Spark, Kafka, Talend,
Google Big Query) and storage (HDFS, HBase, Hive, Relational, etc.)
  • Experience in data profiling, source-target mappings, ELT development, SQL optimization, testing and implementation
  • Expertise in SQL & other data manipulation languages essential (Pig, Python, Java)
  • Experience with structured/unstructured data
  • Track record of implementing databases and data access middleware and high volume processing involving large data stores

Behavioral skills:
  • customer focus
  • Excellent oral and written communication skills
  • Able to work independently, creatively and collaboratively as part of a team
  • Strong analytical and problem-solving skills
  • Curiosity and appetite for Data and IT Domains

Language skills:
English: mandatory
French: optional

Additional information :
Travels may be required (projects, trainings, team meetings)

Additional Information

*** Mention DataYoshi when applying ***

Offers you may like...

  • SmartBLKTrade Limited (SBT)

    Research Data Scientist / Big Data Engineer, AI De...
    Hong Kong
  • Synergy Global Technologies Inc.

    Data Engineer (REMOTE)
    Remote
  • ACTS, Inc.

    Data Engineer
    Jacksonville, FL 32202
  • Humana

    Senior Cloud SIEM/Data Engineer(remote virtual hom...
    Louisville, KY
  • Facebook

    Data Engineer, Infrastructure Strategy
    Remote