Allstate

Avail- Staff Data Engineer- Senior level (Remote-h...

Job description

The world isn’t standing still, and neither is Allstate. We’re moving quickly, looking across our businesses and brands and taking bold steps to better serve customers’ evolving needs. That’s why now is an exciting time to join our team. You’ll have opportunities to take risks, challenge the status quo and shape the future for the greater good.

You’ll do all this in an environment of excellence and the highest ethical standards – a place where values such as integrity, inclusive diversity and accountability are paramount. We empower every employee to lead, drive change and give back where they work and live. Our people are our greatest strength, and we work as one team in service of our customers and communities.

Everything we do at Allstate is driven by a shared purpose: to protect people from life’s uncertainties so they can realize their hopes and dreams. For more than 89 years we’ve thrived by staying a step ahead of whatever’s coming next – to give customers peace of mind no matter what changes they face. We acted with conviction to advocate for seat belts, air bags and graduated driving laws. We help give survivors of domestic violence a voice through financial empowerment. We’ve been an industry leader in pricing sophistication, telematics, digital photo claims and, more recently, device and identity protection. We are the Good Hands. We don’t follow the trends. We set them.

Compensation Data

Job Summary


Seeking an experienced Staff Data Engineer to implement integrations with various data
sources, set up a data warehouse, create scalable data pipelines for ETL and machine learning
model training, and deploy machine learning models on production in a scalable way.


Job Description


  • Design and implement scalable data workflows and pipelines, and integrate diverse data
sources and sinks
  • Design appropriate complex database schemas and optimize database deployment
architectures for analytics query loads
  • Implement data transforms and organization for various data stores (data lakes and
warehouses)
  • Design and implement new platform architectures for building and serving
computationally challenging machine learning models under tight response time
requirements
  • Provide tooling and automation for infrastructure, continuous testing, and continuous
deploy of data systems
  • Work with the platform operations team to monitor and maintain live production systems


Education and Experience


  • 10 or more years of experience in software engineering or equivalent academic
experience
  • Advanced (Master’s or PhD) degree in Computer Science or Computer Engineering or
related technical discipline, or equivalent experience
Functional Experience
  • Significant prior experience in projects using elements of the current and future Avail
tech stack: Redshift, Airflow, Python, PostgresQL, MongoDB, Kafka, EMR, Spark.
  • Experience in creating both batch and real-time architectures for training machine
learning models against large volumes of data (at least 1TB in each daily job) and
deploying them to production servers at a global scale. Proven history of ability to
implement inference services that respond at speed (within 20ms) and volume
(thousands of requests per second).
  • Deep (5+ years) experience in at least one systems programming language (Java,
Scala, Rust, C, C++)
  • Familiarity with theoretical foundations necessary for implementation of training and
inference in machine learning models, such as cross validation, vector and matrix
operations, statistical sampling and model representation.
  • Advanced experience in Data Modelling and Data Warehousing and facilitating analytics
workflows and functions
  • Advanced experience in creating ETL pipelines in applications involving high volumes of
data (e.g., in e-commerce, ad-tech, finance)
  • Experience building secure and high-performance integrations for data ingestion from
external data sources and APIs
  • Advanced skills in software engineering disciplines and best practices
  • High degree of familiarity with software development processes such as Scrum, CI/CD
  • Experience in using Jenkins CI tools to create testing and deployment automation
  • Experience in performing operations and automation of various data ecosystems in
production environments on AWS
  • Familiarity with functional programming languages and experience in defining data
pipeline transformations using functional concepts


The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen.


Good Work. Good Life. Good Hands®.


As a Fortune 100 company and industry leader, we provide a competitive salary – but that’s just the beginning. Our Total Rewards package also offers benefits like tuition assistance, medical and dental insurance, as well as a robust pension and 401(k). Plus, you’ll have access to a wide variety of programs to help you balance your work and personal life - including a generous paid time off policy. For a full description of Allstate’s benefits, visit allstate.jobs/benefits/


Learn more about life at Allstate. Connect with us on Twitter, Facebook, Instagram and LinkedIn or watch a video.


Allstate generally does not sponsor individuals for employment-based visas for this position.


Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.


For jobs in San Francisco, please click “here” for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click “here” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.


To view the “EEO is the Law” poster click “here”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs


To view the FMLA poster, click “here”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.


It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.