Lead - Data Engineer

Company:
Location: Los Angeles, CA

*** Mention DataYoshi when applying ***

OVERVIEW OF THE COMPANY

Fox Corporation

Under the FOX banner, we produce and distribute content through some of the world’s leading and most valued brands, including: FOX News, FOX Sports, the Fox Network, and the FOX Television Stations. We empower a diverse range of creators to imagine and develop culturally significant content, while building an organization that thrives on creative ideas, operational expertise and strategic thinking.

JOB DESCRIPTION

As a key member of the Data Services Management team, you will be integral in envisioning, implementing, and evangelizing new features, pipelines, and platforms that not only deliver data but insight. You will be at the forefront of assessing the most impactful data needs throughout the business and leading the charge in identifying automated solutions that help bring data to life. You have experience building and maintaining ETLs, data pipelines, and data models. Beyond your strong technical skills, you are a collaborator who is a passionate advocate for empowering and enlightening others with the power of data to help turn information into knowledge and actionable insights.

A SNAPSHOT OF YOUR RESPONSIBILITIES

  • Drive and participate in the definition, the direction, and the development of the FOX CPE data Engineering platform

  • Work with internal stakeholders, data science team to scope the requirements, evaluate business needs and objectives

  • Design and develop highly scalable, reliable, extensive, and maintainable Data pipelines

  • Establish and implement best engineering practices such as architectural design, unit and regression testing, test-driven development, pair programming, and continuous integration frameworks

  • Work with the infrastructure team to ensure that all the required monitoring, exception handling and fault tolerance is in place for a production-quality data platform

  • Team up with analysts, product managers, and other stakeholders to understand evolving business needs and translate reporting capabilities accordingly

  • Identify and investigate emerging trends within our market and the industry as a whole

  • Assist with process improvement with a customer-focused, progressive mindset

  • Understand data classification and adhere to the information protection and privacy restrictions on data

WHAT YOU WILL NEED

  • 8+ years as a professional Database engineer with experience in production scale platforms and 5 years in a Lead role

  • Experience in CICD framework, Preferably GitHubActions for version controlling

  • Strong experience in data mining and the development of ETL processes using SQL or tools like Informatica, Matillion, Talend, etc.

  • Strong experience with distributed data architectures and big data processing technologies (Spark, EMR, Hadoop, Hive)

  • Strong experience with Realtime Frameworks, collection, and processing Realtime data using kinesis Data Streams, KCL, KDA and Firehoses

  • Expert knowledge of AWS Analysis services like Redshift, Glue, Athena, Lake formation and Step functions

  • Excellent knowledge and expertise with SQL, T-SQL, Postgress and Relational & Multi-dimensional Databases

  • Strong knowledge of Python or similar scripting language

  • Expert understanding of the agile software development life cycle

  • Strong understanding of AWS security services including KMS, CloudTrail, STS

  • Strong understanding of data warehousing concepts and Data Modeling

  • Discerning appreciation of best practices in designing data lakes/lake houses, mentoring junior members, peer review and recommendation

  • Proven ability to deliver high quality, production ready code

  • Strong customer service and communication skills (verbal and written) to effectively interact with a diverse team of people across business and engineering.

NICE TO HAVE, BUT NOT A DEAL BREAKER

  • Bachelor’s degree in computer science

  • Experience with SFMC, Google BigQuery

  • Experience with Delta Lake technologies

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.

*** Mention DataYoshi when applying ***