Job description
About the Position
The Data Engineer will develop and support next generation architecture for the advanced supply chain analytics offering. The job will design, create, manage, and use of large datasets across a variety of data platforms. The position crafts, implements, and operates stable, scalable, low-cost solutions to replicate data from production systems into the BI data store.
Functions
• Partner with key distribution, transportation, and material handling business managers to design and implement efficient and scalable Extract, Transform, Load (ETL) solutions
• Assist in developing and improving the current ETL/BI architecture, emphasizing data security, data quality and timeliness, scalability, and extensibility
• Design low latency data architectures at scale to enable data driven decision-making
• Delivery of performant and scalable data products and platforms, both Online Transactional Processing (OLTP) and Online Analytical Processing (OLAP), to consume, process, analyze and present data from the data ecosystem, while driving data engineering best practices
• Ensure the integrity and uninterrupted processing of batch and real-time data pipelines to ingest and process data from various internal data sources and third-party platforms
• Work closely with Data Science and Business Intelligence team to develop and maintain company-level Key Performance Indicators (KPIs), accompanying core metrics and develop architecture to drive business growth
Qualifications
• Bachelor’s degree in Computer Science. Master’s or PhD degrees preferred
• 6-8 years Data Engineering experience: proven track record working with large datasets and closely working with data analysts, software, and infrastructure engineers
• Expert level skills writing/optimizing complex SQL and schema buildout with structured and unstructured data, including star schemas, constellations, and snowflake schemas
• 5-6 years of experience with Python
• Experience with ETL tool like SSIS etc.
• Strong background in working with Big Data technologies like: Spark, Kafka, Hadoop, etc. preferred
• Experienced in developing and delivering on technical roadmaps and architectures for platforms or cross-functional problems that impact multiple teams
• Experience in data mining, profiling, and analysis
• Experience with workflow orchestration tools and rules-driven process automation engine systems
• Good understanding of Continuous Integration (CI)/ Continuous Delivery (CD) principles
• Demonstrated track record of dealing with ambiguity, prioritizing needs, and delivering results in a dynamic business environment
• Proven ability to develop unconventional solutions; Sees opportunities to innovate and leads the way
• Experienced in designing data solutions utilizing AWS cloud data platforms and tools
Competencies
• Business Acumen - Knowledgeable in current and possible future policies, practices, trends, technology, and information affecting his/her business and organization.
• Communicate for Impact - Proactively communicate with all stakeholders throughout the life cycle of programs and projects.
• Influencing Others - Can quickly find common ground and can solve problems for the good of the organization with a minimal amount of noise. Authentically gains trust and support of peers.
• Managing Transitions/ Change Management - Effectively plans, manages and communicates changes in processes with appropriate stakeholders.
• Strategic Agility - Enable Kenco to remain competitive by adjusting and adapting to innovative ideas necessary to support Kenco’s long-term organizational strategy.
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)
