Senior Data Engineer

Company:
Location: Kraków, małopolskie

*** Mention DataYoshi when applying ***

Requirements:

  • Sound knowledge and experience of best practices in software architecture, development and operation in an always-up, always-available service and around the 4 V's of big data (knowledge of Azure cloud data pipeline components like Data Factory and technical SAP are significant plus)
  • Sound knowledge of software/warehouse/cloud development and programming (e.g. Apache Spark, Apache Hive. Apache Kafka and big data in general) -
  • Sound knowledge of data lineage and access control frameworks (e.g. Apache Atlas, Apache Ranger) -
  • Experience with or knowledge of Agile Software Development methodologies
  • Experience with self-service reporting (e.g. PowerBI)
  • Excellent problem solving and troubleshooting skills
  • Process oriented with good documentation skills
  • Excellent oral and written communication skills with a keen sense of customer service
  • BS or MS degree in Computer Science or a related technical field
  • 5+ years of related job experience (preferably data processing systems in a manufacturing industry)

Responsibilities:

  • Designs, develops and maintains scalable data pipelines with unstructured and structured data
  • Collaborates with analytics, business and production teams to improve data models (e.g. product parts, product variants/options, sensor data collection) that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
  • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
  • Writes unit/integration tests, contributes to engineering wiki, and documents work
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
  • Works closely with a team of frontend and backend engineers, product managers, and analysts
  • Helps in defining and designing company data assets, data integrations and data quality framework
  • Designs and evaluates open source and vendor tools for data lineage and compliance requirements such as GDPR

We offer:

trending_up

Possibility of professional development

school

Trainings

fitness_center

Sport package

local_hospital

Private medical healthcare

*** Mention DataYoshi when applying ***

Offers you may like...

  • SV Academy

    Senior Data Analyst
    Remote
  • HR Genie

    Senior Data Analyst (CJM and NPS)
    Johannesburg, Gauteng
  • Sii Polska

    Senior Data Analyst
    Warszawa, mazowieckie
  • Lionbridge Technologies

    Senior Data Analyst
    Ballina, County Mayo
  • Comtel Solutions Pte Ltd

    Senior Data Analyst
    Singapore