Luxoft

Data Engineer - Onshore

Job description

Project Description

About the Project

Luxoft has contract with a major Telecommunications provider to engage with Network Engineering and Operations organization to establish integrated cloud technology platforms to ingest information from various Network Engineering support applications in order to better optimize management and planning for the future network.

To do this Network Engineering Ops is managing data ingestion into a Snowflake Azure based deployment which allows for one cohesive platform to serve all types of users and workloads in a consistent way. Centralizing data in a unified, governed, managed data platform allows all authorized users to access accurate and timely data for analysis that is useful for highly transnational datasets. It is also useful that it can store structured and unstructured data. Additionally Network Eng. & Ops is leveraging a Palantir Deep™ instance platform for the creation and management of cost forecasting scenarios.

Responsibilities

    Network Engineering and Operations goals will require data from various legacy network engineering support applications to be set up to feed useful information into the Snowflake and Palantir Deep applications.

    Under the terms of this SOW, Supplier will provide Deliverables in the following areas in support of the Network Engineering and Operations initiative (the Project), including but not limited to:

    Data Ingest Data Quality Management and Support
    Team to ingest data from/to Snowflake, On Prem, or Azure to Palantir and perform necessary data grooming and ongoing flow support to ensure informational requirements. Generally following monthly sprints but needs may shift depending upon parking lot prioritizations or cross-team integration planning. Team will also monitor data quality and resolve any issues related to data health.

Skills

Must have

    Snowflake, Palantir, Scala, Java, HiveQL, SPARK, SQL, Python, Hadoop, Cloud

Nice to have

    Azure Cloud, Teradata

Languages

English: A1 Beginner

Seniority

Senior

Relocation package

If needed, we can help you with relocation process.

Vacancy Specialization

BigData Development

Ref Number

VR-76370

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.