JD-Big Data Engineer G2

JD- Big Data Engineer (G2)

Preferrable 3-6 years of experience as Big data engineer.

Prior experience with scalable architecture and distributed processing.

Strong Programming expertise in Python, SQL, Pyspark

Expertise on major big data solutions like Spark, Hive

Experience in big data orchestrator like Airflow

Good hands-on experience on GIT or other code versioning tools

Experience on cloud-based data stores like Redshift and Big Query is an advantage.

Experience in cloud solution architecture preferrable GCP and Azure.

Nice To Have

Good experience on microservices architecture, docker and Kubernetes as orchestration.

ML ops and ML experience using Spark

Understanding of logging, monitoring, and alerting of production big data pipelines

JD- Big Data Engineer (G3)

Preferrable 7-10 years of experience as Big data engineer.

Prior experience with scalable architecture and distributed processing.

Strong Programming expertise in Python, SQL, Pyspark

Expertise on major big data solutions like Spark, Hive

Experience in big data orchestrator like Airflow

Good hands-on experience on GIT or other code versioning tools

Strong spark optimizations/tunning skills

Basic ML experience

Experience on cloud-based data stores like Redshift and Big Query is an advantage.

Experience in cloud solution architecture preferrable GCP and Azure.

Nice To Have

Good experience on microservices architecture, docker and Kubernetes as orchestration.

ML ops and ML experience using Spark

Understanding of logging, monitoring, and alerting of production big data pipelines