Data Engineer - Senior | McLean, VA (Remote to sta...

Pay Rates : USD 70/Hourly/W-2

Job Code : JPC - 12504

No of Positions : 1

Our client is looking for Data Engineer - Senior in Tysons Corner, VA. Kindly go through the requirement and let me know your interest to move forward

Here are the details:

Job Title: Data Engineer - Senior

Location: Remote for now, may need to be onsite in McLean, VA

Duration: 12 months contract

Required Skills:

7+ years Python, Strong PySpark * Don’t want someone with heavy data science, really wants to work through data platforms Need to have In depth python based data engineering, has taken on batch jobs for Spark, experience with AWS

Job Description: Our client is seeking a Senior Python/PySpark Engineer with 7+ years of experience to join their Marketing Platform team.

The primary responsibilities include:

• Development/enhancement
• Deployment to cloud
• Maintenance of data pipelines which are critical, low-latency performing and highly available.

Top Requirements:

• Spark - batch streaming process, Pyspark, push jobs through Apache Airflow. Spark SQL for configuring datasets
• Python – build/own development, able to consume/call API’s.
• AWS – EMR, lambda, S3, IAM – interacting with other groups/data, EC2
• Airflow – managing jobs to push pipelines

Preferred:

• SQL
• Databricks
• Kafka/kinesis