Data Engineer

Findmore Consulting S.A. is a company specialized in Information Technologies founded in 2006 and with more than 400 consultants. Our services include infrastructure and cloud, software development and agility where contribute to major projects in Portugal and Europe.We're looking for talented, purpose-driven people to join our teams!

Main Tasks & Responsibilities:

• Create and maintain optimal data pipeline architecture;
• Assemble large, complex data sets that meet functional / non-functional business requirements;
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc;
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources;
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics;
• Work with data and analytics experts to strive for greater functionality in our data systems.

Main Technical Requirements:

• Minimum 3 years’ experience;
• Experience building and optimizing data pipelines, architectures, and data sets;
• Experience performing root cause analysis on data pipelines and identify opportunities for improvement;
• Experience with Apache Spark (must have);
• Experience with object-oriented/functional/scripting languages: Python, Java, Scala (master at least one);
• Knowledge of SQL;
• Knowledge of Unix shell scripting (ex: Bash);
• Experience with Airflow (nice to have, not mandatory);
• Experience with Azure Databricks (nice to have, not mandatory);
• Knowledge in Azure Cloud Services, Azure Data Lake, Azure Databricks, Networking, Security (nice to have);
• Knowledge of Docker and Kubernetes;
• Experience in Jira and Confluence.

Other Requirements:

• EU citizenship;
• Ability to simplify complex problems and obtain a workable solution;
• Experience in functional development;
• Good proficiency in English.