Senior Data Engineer

Company:
Location: Carlsbad, CA 92008

*** Mention DataYoshi when applying ***

Agency :

Havas Edge San Diego

Job Description Summary :

OPEN TO REMOTE BASED TALENT. Please inquire with our Talent team should you have any questions.

The Senior Data Engineer is responsible for developing and supporting our data warehouse solutions built on the Microsoft SQL Server and AWS technology stacks. These solutions include ETL, data modeling, data quality assessment and data delivery.

You will play a critical role in the development of data warehouse/data lake solutions utilized by internal and external clients. Additionally, will mentor team members on how to leverage the Hadoop ecosystem to ingest and uncover the value hidden in our large and diverse data sources.

The Senior Data Engineer will work alongside other engineers and developers and will report to our Director of Information System, Data Architecture & Management.

Job Description :

WHAT YOU’LL DO

  • Create high performance data warehouse and ETL solutions using SSIS, Python and Spark
  • Build data flow automation to retrieve, transform and load data
  • Leverage different systems and various testing tools to ensure data quality and data integrity of our growing array of data sources
  • Design and develop tables, views, triggers, indexes, constraints, and stored procedures
  • Performance tuning and optimization of ETL, SQL and database structures
  • Monitor long running transactions and can optimize query executions using best practices and methodologies
  • Work closely with product engineers and developers to fix data issues
  • Manage data warehouse structure and file storage rules
  • Maintain best practices for handling, storing, and using data
  • Data management functions including:
    • Metadata management
    • Create, alter, delete, grant permissions, indexing, updating
    • Query tuning
  • Design data models for enterprise-wide data integration incorporating:
    • Structured and unstructured data
    • Real time, on-demand, batch, and varying timing schedules
  • Tools heavily utilized within the role, but not limited to: 
    • SQL Server/SSIS
    • Unix/Linux
    • Python/Java
    • Web Analytics Platforms – Google, Adobe, etc.
    • Cloud Technologies – AWS, Azure, Google
  • Help lead the design and development of scalable data pipeline solutions in Hadoop; train team members on how to leverage the Hadoop ecosystem to ingest and uncover the value hidden in our large and diverse data sources
  • Serve as a mentor to other engineers and developers; assist with hiring, interviewing, and training as needed
  • Other responsibilities as assigned

WHO YOU ARE

Position Requirements:

  • Minimum 5-7 years of experience developing large scale complex database solutions
  • Minimum 3-5 years’ experience with SQL including writing SQL queries and ability to tune queries
  • Minimum 3 years’ of ETL experience; python programming ETL and analyzing data sets
  • You are experienced in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hadoop, Spark, and column-oriented databases such as Redshift
  • You have substantial experience working with big data infrastructure tools such as Python, SQS, and Redshift
  • You have experience working in any of the following: Spark, Spark Streaming, AWS, EMR, IAM, S3
  • You have a thorough understanding and knowledge of ETL and data warehouse principles
  • You have experience in data modeling and working with large data sets
  • You are knowledgeable in database structures, theories, principles, and best practices
  • You have previous working experience with BI database design; knowledge of BI and query tools such as Tableau and PowerBI
  • You can manage multiple projects simultaneously and can prioritize workload effectively and efficiently
  • You work well under pressure, while maintaining accuracy, strict confidentiality, and a professional demeanor
  • You know how to manage up: respectful of when and how to engage senior level support
  • You are approachable and can interact with people at all levels of the organization (internal and external stakeholders) and fostering strong cross-functional teamwork
  • You have solid interpersonal communication skills, both written and verbal
  • You are skilled in creating, maintaining, and updating technical documents
  • You have previous experience in participating or leading presentations, talking with clarity and confidence, and presenting complex ideas in a user-friendly language
  • You have a high level of attention to detail and organization
  • You have a desire and ability to thrive in a fast-paced, dead-line driven environment
  • You are self-motivated and productive in both an independent and collaborative team setting
  • You are self-aware: e valuates barriers for growth and proactively seeks out resources to overcome

Preferred Education, Experience, and Skills:

  • Bachelor’s Degree in Computer Science, Information Systems, Applied Mathematics, Statistics, Data Science, or related field of study
  • You have prior experience working with Web and Digital marketing data
  • You are familiar with multi-threading/concurrency, synchronization, and locking
  • You have some experience working with NoSQL database implementations, MongoDB preferred, lambda architecture and serverless applications
  • You have working knowledge and an understanding of the media/digital media industry
  • You are familiar in statistical analysis and machine learning libraries; a plus but not required
  • You have previous DevOps experience; a plus but not required

Skills :

Contract Type :

Permanent

Here at Havas across the group we pride ourselves on being committed to offering equal opportunities to all potential employees and have zero tolerance for discrimination. We are an equal opportunity employer and welcome applicants irrespective of age, sex, race, ethnicity, disability and other factors that have no bearing on an individual’s ability to perform their job.

Due to high volume of applications, only eligible or matching candidates will be contacted by us.

*** Mention DataYoshi when applying ***

Offers you may like...

  • Trianz

    Senior Data Analyst
    Remote
  • Bolt

    Senior Data Analyst, Product
    Warszawa, mazowieckie
  • ATB Financial

    Senior Data Analyst
    Remote
  • The Hong Kong Jockey Club

    Senior Data Analyst (Treasury)
    Happy Valley, Hong Kong Island
  • BIPO SERVICE (SINGAPORE) PTE. LTD.

    Senior Data Analyst
    Tanjong Pagar