Join our cutting-edge Enterprise Data Analytics Platform team and become a key member of our data-driven future. As a Senior Data Engineer, you'll be at the forefront of innovation, crafting solutions that leverage Python, Databricks and AWS to transform our data landscape.
We are seeking a highly skilled Senior Data Engineer with deep expertise in Python and Apache Spark. The successful candidate will be ultimately responsible for the full development lifecycle of a reusable data ingestion solution to enhance our data processing capabilities.
Your Role:
- Pioneer the evolution of our data engineering ecosystem, setting new standards for efficiency and scalability
- Design and develop a reusable Python package for data ingestion on the Databricks platform.
- Collaborate with architects, platform engineers, machine learning engineers and data scientists to understand data requirements and translate them into efficient data ingestion processes.
- Optimize data ingestion pipelines for performance, scalability, and testability.
- Ensure data quality and integrity throughout the ingestion process.
- Document processes, code, and methodologies comprehensively for team use.
- Provide technical leadership and mentorship to fostering a culture of excellence in data engineering
- Stay current with industry trends and best practices in data engineering and Databricks.
Your Core Competences:
- Deep knowledge of data engineering with a focus on Python.
- Strong expertise in developing data pipelines and ETL processes using Python.
- Proven experience with Databricks and Spark.
- Familiarity with Delta Lake and other big data technologies.
- Proficient in SQL and experience with relational databases.
- Understanding of data governance principles and practices.
- Experience with cloud platforms such as AWS or Azure is desirable.
What's In It For You
- Work Life Balance: flexible working hours (no core time), extensive hybrid working options / work from home, 30 days / year remote work from any EU-country outside Austria
- Easy Moving: work permit support
- Top-notch Equipment: modern tools & technologies
- International Spirit: multi-cultural teams, English as company language, team building events
- Learning & Agile Working: as part of our DNA & culture
- Canteen: healthy, tasty, and heavily subsidized
- Saving: with vouchers / discounts from our staffs' council (eg. supermarket)
- Further Goodies: free public transport pass, salary account & credit card (optional), reduced gym membership, gender-neutral parental leave, bilingual company kindergarten, child care during holidays etc.
- Salary: the offered gross yearly salary ranges starting 75.000 Euro (basis full-time) including overtime, depending on qualification and experience.)
For questions regarding our application process, please feel free to take a look on our
website or check out our
FAQ.
Your contact:
Martin Trnka
Talent Acquisition Team