BTI Solutions

Data Engineer / Plano, TX / Mobile / AM769754

Job description

Data Engineer:
  • Ingesting, extracting, moving, transforming, cleaning, loading massive structured and unstructured data in Hadoop environment both in batch and real-time
  • SQL, scripting language and object-oriented language “guru” and are always on a lookout to optimize and automate pipelines.
  • Policies and processes related to data security and data privacy.
  • Interface with leadership and team members to get clarity on your requirements, end goals and deliverables.
  • Continuously overlook on the products deployed and strives for better end-user experience
  • Work with Data Scientist to Design, Architect and Deploy scalable and reliable Data Products
  • Use JIRA and Confluence as tools for Agile Project Management
  • Interface with team members regularly to brain storm ideas, communicate progress and risks.
  • Work with Data Scientists and Product Managers to clearly understand the data requirements
  • Debug the data pipelines with ease
  • Adept in documenting the data modeling work. Ensure that the documentation is complete and reviewed.
  • Full job description will be given upon application

Requirements:
  • Expert in SQL and NoSQL development
  • Agile Principles/Scrum/Kanban
  • Expert in Hadoop (Hive and Impala) & Spark (Spark/Scala)
  • Proficient in a scripting language
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Presto
  • Proficient in object-oriented language – Python/Scala preferred
  • Experience in Telecom/retail/e-commerce/consumer packaged goods (CPG), Mobile or Consumer electronics industries
  • Proficient in using Big Data stack (Hadoop, Hive, Spark, Kafka, Kerberos, OOZIE, impala, etc.)
  • Adept in multi-threading and concurrency concepts.
  • Bachelor’s degree with 5+ years of related experience


Why Work for Us?
Established in 2006, BTI is an ISO 9001:2008 certified company that continues to grow dramatically within the telecommunications industry. BTI Solutions offers a competitive benefits package that includes: Medical, Dental and Vision, Life insurance, 401K, plus more. BTI Solutions, Inc. is an Equal Opportunity Employer M/F/D/V.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.