Big Data Engineer

Position Summary

Data Engineers form an important part of the Data Analytics Team within Samsung Care Organization. They have extensive experience with ETL design, coding, and testing as well as engineering software platforms and large-scale data infrastructures. Big Data Engineers have the capability to architect highly scalable end-to-end pipeline using different open source tools, including building and operationalizing high-performance algorithms.Big Data Engineers understand how to apply technologies to solve big data problems on cloud and on premise systems with expert knowledge in programming languages like Python, Linux shell scripts, SQL and technologies like Hive, Impala, and Spark.

Role and Responsibilities

Big data engineers implement complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable deliverables across customer-facing platforms. They have a strong aptitude to decide on the needed hardware and software design and can guide the development of such designs through both proof of concepts and complete implementations.Additional qualifications should include:• Tune big data solutions to improve performance and end-user experience• Proficient in designing efficient and robust data workflows• Documenting requirements as well as resolve conflicts or ambiguities• Experience working in teams and collaborate with others to clarify requirements• Excellent oral and written communication skills



Responsibilities and Duties:

• Translate complex functional and technical requirements into detailed design
• Design for now and future success
• Design and Develop scalable industry standard ETL pipelines using big data technologies.
• Loading from disparate data sets. by leveraging various big data technologies EMR, Hive, Spark. Presto etc.
• Code and query Optimization.
• Design and implement data modeling
• High-speed querying using in-memory technologies such as Spark.
• Following and contributing best engineering practice for source control, release management, deployment etc.
• Production support, job scheduling/monitoring, ETL data quality, data freshness reporting
  
  

Skills and Qualifications

Background/Experience Required:

Bachelors or Masters in Computer Engineering.

4 years of experience in the Big data Solutions such as pyspark,python, hive and experience on AWS.





Necessary Skills and Attributes:

• 3+ years of experience writing complex SQL queries (Hive QL/Spark SQL preferred).
• 3+ years of Python development experience
• 3+ years of demonstrated technical proficiency with Hadoop and big data projects
• 2+ years of hands on development experience on developing ETL pipelines
• Fluent in writing shell scripts [bash]
• Experience working with AWS components [EMR, S3]
• Working experience in Apache Airflow
• Writing high-performance, reliable and maintainable code.
• Knowledge and ability to implement workflow/schedulers within Oozie
• Knowledge of Data Modelling Concepts
• Analytical and problem-solving skills, applied to Big Data domain
• Proven understanding and hands on experience with Hadoop, Hive, Pig, Impala, and Spark
• Good aptitude in multi-threading and concurrency concepts.
• B.S. or M.S. in Computer Science or Engineering
  
  

* Please visit Samsung membership to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please click here.



At Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.



* Samsung Electronics America, Inc. and its subsidiaries are committed to employing a diverse workforce, and provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.



COVID-19 Vaccine Mandate

Samsung Electronics America requires all employees to be fully vaccinated against COVID-19, unless a medical or religious exemption, or an exemption required under state/local law, is approved. Offers of employment are contingent upon proof that a candidate is fully vaccinated or qualifies for an exemption. More details on how to apply for an exemption are provided after the application process is complete.



Reasonable Accommodations for Qualified Individuals with Disabilities During the Application Process

Samsung Electronics America is committed to providing reasonable accommodations for qualified individuals with disabilities in our job application process. If you have a disability and require a reasonable accommodation in order to participate in the application process, please contact our Reasonable Accommodation Team (855-557-3247) or [email protected] for assistance. This number is for accommodation requests only and is not intended for general employment inquiries.