Job description
· Design, code, test, document, and maintain high-quality and scalable big data solutions.
· Ingest and transform data using variety of technologies from variety of sources (APIs, streaming, Files, Databases .).
· Develop reusable patterns and encourage innovation that will increase teams velocity.
· Design and develop applications in an agile environment, deploy using CI/CD.
· Participate with prototypes as well as design and code reviews, own or assist with incident and problem management.
· The ideal candidate will be a self-starter who can learn things quickly, who is enthusiastic and actively engaged.
Required 3-5 years of experience with the following technologies:
- Hadoop, Python, Hive, SQL, Shell scripting.
- Apache Spark.
- NoSQL and relational databases.
Required 1-3 years of experience with the following technologies:
- Scheduling tools like Airflow / Tivoli Work scheduler.
- Working in Agile/Scrum environment.
- Jenkins or similar CICD tool, GitHub.
Preferred 2-5 years of experience with the following technologies:
- Apache Kafka.
- APIs.
