BASIC FUNCTIONS: This position performs complex research and data engineering assignments within a functional engineering area or product line and provides direct input to project plans, schedules, and methodology in developing cross-functional products. This position performs date engineering design - typically across multiple systems; mentors junior team members; talks to users/customers and translates their requests into solutions.
Skills:
First and foremost, you need the right character and attitude; we work in a cross-functional and highly collaborative environment. There is, of course, a baseline of skills that we are looking for, and you should be able to demonstrate skills in the following:
Fluent in Python
Advanced experience in SQL and working with various database technologies
Strong experience with Parquet, ORC, or other big data columnar storage format
Experience building big data pipelines, architectures, and data sets
Experience with a majority of the AWS big data stack (S3, IAM, Glue ETL, Glue Catalog, Glue Crawlers, Athena, EMR, SageMaker, Zeppelin)
Demonstrated ability to build processes that support data transformation, data structures, metadata, dependency, and workload management
Good interpersonal and written communication as well as problem-solving skills
Happy to learn new technologies and keep abreast of new technology developments
Experience working in a collaborative Agile environment (Scrum/Kanban)
Experience and willingness to mentor other engineers as needed to help the team succeed
Participate in an on-call rotation
Experience with some/all of the following would be valuable to us:
AirFlow
CI/CD experience using tools such as Jenkins, TeamCity, Docker, Terraform (or other infrastructure-as-code toolsets)
Microservices
Datadog
Designing / architecting software and software patterns
Experience & Education
5+ years of professional Data Engineering experience
BS Computer Science, Information Science, or equivalent experience required
#LI-ZM1#LI-Remote
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. If a qualified individual with a disability or disabled veteran needs a reasonable accommodation to use or access our online system, that individual should please contact [email protected] or if you are based in the US you may also contact us on 1.855.833.5120.