Big Data Engineer/Administrator (100% Remote)
The Automobile Club of Southern California is seeking an experienced Big Data Engineer with Administrator skills and in-depth working knowledge and experience utilizing DevOps and agile principles to manage a Big Data platform.
This position provides technical and/or organizational support for the Data & Analytics team to carry out projects designed to improve company revenue and/or reduce costs. It is an innovative team seeking to improve the way the company operates by analyzing data in new ways and using the latest technology for accessing, storing, and analyzing data.
This position provides most of the executional work under the direction of the Big Data leadership team and is expected to be able to work with a wide variety of technologies and tools.
Requirements
- Operations and administration of an Apache Hadoop Ecosystem
- Utilizing Team Foundation Server Git, Jenkins, Ansible, Nexus IQ/Repo, and SonarQube to enable CI / CD.
- Develop automation using scripting languages such as Python, Shell, PowerShell, and Bash
- Implement and support Hadoop Applications such as Sqoop, Hue, Impala, Hive, Hbase
- Implement and support streaming technologies such as Kafka, Spark & Kudu
- Partner with the infrastructure, network, marketing, application, and business intelligence teams to guarantee high data quality and availability.
- Collaborate with application teams to perform Hadoop updates, patches, version upgrades when required.
- Work with enterprise and solution architects to develop a Big Data cloud architecture and implement it.
- Working as part of DevOps teams to accelerate the delivery of business value
Qualifications:
- 3+ years of hands-on experience architecting and building virtual private cloud environments using Amazon Web Services or Google Private Cloud
- 4+ experience managing a Cloudera data platform in the cloud
- 3+ years of experience implementing Cloud Big Data platforms such as AWS SageMaker and Google Auto ML
- 4+ years of Linux/Red/CentOS Hat administration
- 3+ years of experience implementing and utilizing Continuous Integration and Continuous Deployment pipelines (CI/CD)
- A passion for technology - we are looking for someone keen to leverage their existing skills and seek out new skills and solutions.
- The ability to manage numerous requests concurrently and strategically prioritize when necessary.
- Experience in two or more of the following databases: DB2, MS SQL Server, Oracle, MySQL, Mongo, Cassandra.
- Experience utilizing an on-premise and cloud infrastructure and integrating them
- Hands-on experience implementing high performance, available, reliable, and secured software and scaling horizontally
- Experience implementing and managing API Web Services and versioning
- Bachelor’s in Computer Science
Keys to the position:
- Administration of Linux/Windows
- AWS/ Google Private Cloud
- Databases: MS SQL Server, Oracle or BD2
- Installations and upgrades
- Leadership characteristics
The position that you are applying for has a Work from Home program where a few days a month the team comes into the office for meetings and collaboration.
#LI-RA1
Remarkable benefits:- Health coverage for medical, dental, vision
- 401(K) saving plan with company match AND Pension
- Tuition assistance
- PTO for community volunteer programs
- Wellness program
- Employee discounts
The Automobile Club of Southern California is part of the largest federation of AAA clubs in the nation. We have 14,000 employees in 21 states helping 17 million members. The strength of our organization is our employees. Bringing together and supporting different cultures, backgrounds, personalities, and strengths creates a team capable of delivering legendary, lifetime service to our members. When we embrace our diversity – we win. All of Us! With our national brand recognition, long-standing reputation since 1902, and constantly growing membership, we are seeking career-minded, service-driven professionals to join our team.
“Through dedicated employees we proudly deliver legendary service and beneficial products that provide members peace of mind and value.”
AAA is an Equal Opportunity Employer
The Automobile Club of Southern California will consider for employment all qualified applicants, including those with criminal histories, in a manner consistent with the requirements of applicable federal, state and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance.