Title: Data Engineer - Remote (CA, TN, CT, FL, MT, or NE)
Pay/Salary/Benefits/Perks: Up to 130k plus bonus
Work from Home Policy: Remote (CA, TN, CT, FL, MT, NE)
Interview Process: Streamlined process, 2 interviews
Key Skills: 8+ years PostgresSQL, Python, Java, Spark, ETL; Must be located in one of the following states: CA, TN, CT, FL, MT, or NE
Responsibilities:
- Develop data processing & querying logic on RDBMS and Data Lake.
- Convert business requirements into technical solutions
- Provide technical support to requirements, development, and testing.
- Develop end-user training and reference materials.
- Draft standards and procedures affecting data analysis and process modeling
- Support initiatives related to scalability and performance.
- Conduct performance tuning reviews for improvements
- Have experience working with GitLab and being able to build and implement CI/CD pipelines for continuous development on different stages (dev, QA, production).
Qualifications:
- Must be located in one of the following states: CA, TN, CT, FL, MT, or NE
- 8+ years database developer experience on Postgres or Oracle. Including SQL, stored procedures using pgpl/sql or pl/sql programing languages
- 5+ years doing ETL processes
- 4+ years of:
- Data engineering experience, specifically using Spark, scala or pyspark.
- Python development
- AWS environment (RDS, Lambda, Step functions, Kinesis, Athena, )
- Object-Oriented programming language (Java, C, C++, ).
- General experience with:
- Linux/Unix OS
- Containerized development
- CI/CD automated deployment
- Performance tuning and optimization in PostgreSQL or Oracle
- Bonus:
- AWS experience
- Elasticsearch index build and querying experience.
- Databricks working experience.
- Understand how web-based applications work.
- Big data/data lake, and database structures such as normalization, datamarts, fact tables, dimensions, views, indexing, and partitions.