Data Engineer (IT Specialist)

Company:
Location: Gaspar, SC

*** Mention DataYoshi when applying ***

The Data Engineer is an IT position who reports directly to the Enterprise Application and Architecture Manager.

The Data Engineer will be responsible for the architecture definition, execution and delivery of data engineering for Data & Analytics projects.


Main responsibilities


  • Map and understand the new data sources with the IT and business areas, defining all data flow, best practices and governance for ETL processes (Extraction, Transformation and Load).
  • Projects and define Data Standards through data modeling (ETL, Data Lake, SQL, etc...)
  • Data and Service Catalog management and development
  • Data lifecycle management (Curating, Harmonization, Cleansing and Integration)
  • Design and define data pipelines involving multiple systems and services, e.g., SAP, SAP BW, Azure Services, AWS Services, SAP Cloud Platform, SQL Bases, NoSQL, Industrial Sensors, Excel, APIs, etc.
  • Define and maintain DataOps governance, as well as manage support services with suppliers.
  • Define and build data pipeline for more efficient and repeatable data science projects
  • Ensure the performance of scripts and developments related to data processing
  • Propose, execute and manage continuous improvement plans.
  • Define and implement data governance techniques
  • Train other IT teams and teams in data engineering principles and techniques
  • Train your peers on specialized topics in data engineering
  • Ensure single source of truth for data pools to be read by others e.g., PowerBI, Tableau, SAP BI, etc.
  • High degree of process and data knowledge required to extract “value”


Required experience and skills


  • Candidates must have six years or more (seniors) - of experience in relevant Data Warehousing, Business Intelligence or Big Data projects.
  • Ideally, candidates should know about agile methodologies and applications of DevOps / MLOps methods for building ML and data science pipelines.
  • Candidates must demonstrate that they were protagonists in launching Data & Analytics projects.
  • Knowledge and experience to code in languages such as: Python, SAS, Java, Scala, C#.
  • Experience with popular database programming languages including (SQL, PL / SQL, others) for relational databases and future non-relational databases such as NoSQL / Hadoop oriented databases like MongoDB, Cassandra and others.
  • Proven knowledge of distributed data/computing tools: MapReduce, Hadoop, Spark, Hive, Kafka, also SQL and so on.
  • Experience working in various deployment environments including (cloud, local and hybrid), various operating systems and container techniques such as (Docker, Kubernetes, AWS Elastic Container Service and others).
  • Differential: Experiences in SAP ECC/BW environments.
  • High degree of process and data knowledge required to extract “value”
  • Bachelor's or master's degree in computer science or similarly relevant field
  • Advanced English, Spanish is a plus


Job location: São Paulo (SP)

*** Mention DataYoshi when applying ***

Offers you may like...

  • WestRock

    Business Intelligence Data Engineer
    West Lafayette, IN 47907
  • Principal Financial Group

    Sr. Data Engineer (Machine Learning Engineer)
    Des Moines, IA 50392
  • Panzura, LLC

    Data Engineer
    Remote
  • Charles Schwab

    Senior Cyber Security Risk Data Engineer
    Phoenix, AZ 85016
  • visualbi

    Senior Informatica Data Engineer
    Plano, TX