Big Data Engineer

Company:
Location: Stockholm

*** Mention DataYoshi when applying ***

At Databricks you will work on some of the most complex distributed processing and machine learning problems in the world and our customers challenge us with interesting new big data and AI use cases. As a Data Engineer at Databricks, you will shape the future big data and the machine learning landscape for leading Fortune 500 organizations.

You will be in a customer-facing role that requires deep hands-on expertise in Apache Spark™ and data engineering, along with a variety of knowledge of the big data ecosystem. You will guide our largest customers, for example implementing pipelines from data engineering through model building and deployment. A successful Data Engineer is curious and excels in collaboration. As part of joining Databricks, you will have a direct channel to the developers of Apache Spark™, Delta Lake, and MLflow, and the opportunity to attend top big data conferences.

The impact you will have:

  • Guide strategic customers as they implement transformational big data projects, including end-to-end design, build and deployment of industry-leading big data and AI applications
  • Use your expertise in data engineering best practices to guide customers to do the same, through building proofs of concept and prototypes, architecting solutions and even pair-programming with customer teams
  • Architect and validate migration of workloads from 3rd party databases and data platforms to Apache Spark™
  • Promote Apache Spark™ and Databricks, Delta Lake and MLflow across the developer community through meetups and conferences
  • Coordinate with Account Executives, Customer Success Engineers and Solution Architects for expanding the use of Databricks platform within strategic enterprise customers weekly

What we look for:

We are hiring at a range of levels and adjust our competency expectations, however for a senior-level role we would expect the following:

  • Deep hands-on expertise in Apache Spark™ (Scala or Python)
  • Design and implementation experience in Big Data technologies (Apache Spark™, Hadoop ecosystem, Apache Kafka, NoSQL databases) and familiarity with data architecture patterns (data warehouse, data lake, streaming, Lambda/Kappa architecture)
  • Familiarity with a full range of data engineering approaches, covering theoretical best practices and the technical applications of these methods
  • Experience building and deploying a range of data engineering pipelines into production, including using automation best practices for CI/CD
  • Familiarity with databases and analytics technologies in the industry including Data Warehousing/ETL, Relational Databases, or MPP
  • Experience with performance tuning, troubleshooting, and debugging Apache Spark™ and other big data solutions
  • Comfortable with talking up and down the IT chain of command including directors, managers, architects and developers
  • Experience with cloud providers such as AWS, Azure or GCP
  • Familiarity with AWS/EC2 cloud deployment models (Public vs. VPC)
  • Travel will be 30-40% regionally

Benefits

  • Employer contributions to public or private health plan
  • Equity awards
  • Gym reimbursement
  • Annual personal development fund
  • Work headphones reimbursement
  • Business travel insurance

About Databricks

Databricks is the data and AI company. Thousands of organizations worldwide — including Comcast, Condé Nast, Nationwide and H&M — rely on Databricks' open and unified platform for data engineering, machine learning and analytics. Databricks is venture-backed and headquartered in San Francisco, with offices around the globe. Founded by the original creators of Apache Spark™, Delta Lake and MLflow, Databricks is on a mission to help data teams solve the world's toughest problems. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Our Commitment to Diversity and Inclusion

At Databricks, we foster a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, colour, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

*** Mention DataYoshi when applying ***

Offers you may like...

  • SII Deutschland GmbH

    DATA ANALYST BIG DATA (m/w/d)
    85055 Ingolstadt
  • Disys India Private Limited

    Big Data/Machine Learning Engineer - Lead
    United States
  • Commerzbank AG – Poland

    Big Data Engineer – Hadoop
    Łódź, łódzkie
  • Citi

    Sr Big Data Engineer Irving/Tampa C13 (R2037063)
    Tampa, FL
  • Bmtech group

    Senior Big Data Engineer
    Austin, TX