Job description
The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders. This role will create abstractions to speed the platform’s adoption and build reliable pipelines to support growing data processing and analytics needs. Ideally this person will be a self-starter, detail and quality oriented, and excited about the prospects of having a big impact with data at EVERFI.
Responsibilities
- Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
- Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
- Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
- Develop data pipelines that provide fast, optimized, and robust end-to-end solutions
- Automate manual processes and create a platform in favor of self-service data consumption
- Deploy and configure components to production environments.
- Participate in on-call schedule to provide emergency incident support
- Mentor and train teammates on design and operation of data platform
- Stay current with industry trends, making recommendations as needed to help the company excel
- Other job-related duties as assigned
Skills, Experience and Qualifications
- Bachelor’s Degree in Computer Science or Engineering a plus
- 3+ years of relevant industry experience in Data Engineering working with large scale data driven systems
- Experience designing data schemas and fine-tuning queries around large, complex data sets
- Extensive experience working with big data frameworks, like Hive, Spark, Presto and Airflow
- Experience with data streaming systems such as Apache Kafka
- Deep understanding of SQL and data warehouse systems, especially Redshift and Snowflake
- Expertise in object-oriented and/or functional programming languages (Python preferred)
- Strong overall programming skills, able to write modular, maintainable code
- understanding of DevOps principles such as automating of CI/CD pipelines and Infrastructure as code
- Understanding of polyglot data persistence (relational, key/value, document, column)
- Excellent problem-solving skills and the ability to proactively solve issues
- Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
- Ability to be flexible with working in tandem with a team of engineers or alone, as required
Stay up to date on everything Blackbaud, follow us on Linkedin , Twitter , Instagram , Facebook and YouTube
Blackbaud is a remote-first company which embraces a flexible remote work culture. Blackbaud supports hiring and career development for all roles from the location you are in today!
Blackbaud is proud to be an equal opportunity employer and is committed to maintaining a diverse and inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law.
To all recruitment agencies: We do not accept unsolicited agency resumes and are not responsible for any fees related to unsolicited resumes.
