Senior Machine Learning Engineer

The Company:

Join an award-winning machine learning, business intelligence and data engineering consultancy with a passion for delivering results and building the future.

This Organisation is continuing their rapid growth into 2021, seeking Data Engineers who are ready to join the team, helping to design and deliver our Data and ML projects.

With a start-up culture and applying cutting-edge technology to real-world business problems, you have the opportunity to drive impact at some of Australia’s leading enterprises as well as to learn and grow within a team of data-driven professionals. The work is varied and challenging and will require someone who is dynamic in their thinking, a builder mentality as well as a willingness to collaborate with our broader teams.

Amazon Australia's Partner of the year for Data, Analytics and Machine Learning as well as Databricks’ Australian Partner of the Year.

The Position:

As a Senior Machine Learning Engineer, you will be part of a team delivering data platform and pipeline infrastructure across a wide range of customers and industries. You will join a cross-functional delivery team with a broad skill set who are always available to support and mentor you to develop your career at a fast pace.

Upcoming Projects:

• CI/CD development of ETL/ELT pipelines
• Utilise AWS data and analytics services and Kafka, Fivetran and dbt,
• Cloud data warehouse builds using Redshift and Snowflake
• Data lakehouse solutions using Databricks Delta Lake and AWS LakeFormation.

Responsibilities:

• Problems scoping - working with business and technical stakeholders to formulate a problem and develop solutions with a sharp focus on delivery and execution.
• Participate in the design and architecture of end-to-end data systems and products
• Work with large, complex data across different industries/ and problems to understand a system, develop pipelines and storage systems in order to serve the data as products to downstream consumers such as ML and BI teams
• Build robust, scalable, maintainable data infrastructure using cloud best-practice and the AWS “well-architected” framework
• Collaborate with a cross-functional team consisting of data scientists, developers, BI developers and strategy consultants.
• Mentor more junior members of the team from a technical perspective.

Technical Skills:

• Data warehousing, ETL and ELT, preferably using AWS analytics services
• Programming: SDLC best practices and TDD using Python or other languages
• Databases: SQL skills and RDBMS databases - experience in dbt (data build tool) is a big plus
• Automation: Infrastructure as code (IaC), CI/CD
• Experienced in Apache Spark (Databrick or EMR)
• Experienced in work flow orchestration solutions such as Apache Airflow, Prefect, and AWS Step Functions.
• Working knowledge of Big Data querying tools like Hive, Impala or Presto and Amazon Athena

Aboriginal and Torres Strait Islander Peoples are encouraged to apply.
To apply please click apply or call Matthew Baillie on 02 8289 3136 for a confidential discussion.