Data Engineer, Senior (AF-IN)

Location: Bengaluru, Karnataka

*** Mention DataYoshi when applying ***

Join Affinidi and be part of the future of identity: secure, portable and controlled by the individual.

Affinidi empowers individuals and organisations with ownership and control of their verifiable data, to unlock value across borders and platforms.

Leveraging on the building blocks that Affinidi provides, trusted institutions and entities can issue verifiable credentials to users, which can in turn be shared with other applications to access services in an open and interoperable ecosystem.

Currently undergoing development are two applications that leverage Affinidi's technology – Trustana, a curated B2B marketplace and trade platform connecting verifiable, international partners for seamless cross-border trade; and Good Worker, an online job matching platform for seasonal workers and employers in India.

Affinidi, along with the applications Trustana and Good Worker, are seeded by Temasek, a global investment company headquartered in Singapore.

We are building a motivated and entrepreneurial team who is passionate about identity, decentralization and technology to make this happen. This role at Affinidi provides a unique opportunity for a high performing individual to have broad impact. You will work closely with a talented and diverse group of engineers, product managers and industry experts.

Key Responsibilities

  • Build, review, and also test production code for data processing, collection, transformation and storage
  • Ownership of end-to-end data pipelines and automation of data quality reporting process to ensure data integrity
  • Design, architecture and implement data model using cloud-native infrastructure and services to solve from MVP to scale
  • Design data warehouse and schema with a strong analytics mindset
  • Workflow flexibility and strong teamwork skills
  • Collaboration with SME/Software engineers and Data Science experts
  • Write efficient, well documented and highly readable code

Ideal Candidate Requirements

  • 4+ years of experience with Software Engineering using Python and familiarity with modern relational and non-relational databases
  • 4+ years of experience in Big Data development under distributed computing platform such as Spark, Hadoop, etc
  • Experience in building, monitoring, maintaining scalable data pipelines in production system with both structured and unstructured data sources
  • Experience in data management and data application development in cloud computing platform such as AWS, GCP, or Azure
  • Experience in container technology such as Docker
  • Working knowledge of Linux Shell scripting
  • Familiarity with version control tool such as Git and CI/CD DevOps flow
  • Proficiency with data wrangling and data visualization using scripting language such as Python and/or R
  • Having any of the following is considered a plus:
    • Working knowledge of Typescript
    • Working knowledge of Kubernetes
    • Statistical knowledge for data analytics and modeling

Equal Opportunity Statement

Our company embraces diversity in all of its forms and fosters an inclusive environment for all people to do the best work of their lives with us.

We're an equal opportunity employer. All applicants will be considered for employment without attention to ethnicity, religion, sexual orientation, gender identity, family or parental status, national origin, veteran, neurodiversity status or disability status.

*** Mention DataYoshi when applying ***

Offers you may like...

  • Experfy Inc

    Big Data Engineer
  • EXOS

    Sr. Data Engineer
  • Amgen

    Sr Data Engineer - (Remote U.S.)
    Los Angeles, CA
  • Mayo Clinic

    Senior Data Engineer
    Phoenix, AZ 85001
  • Loram

    Customer Support Data Engineer - LTI, Georgetown, ...
    Georgetown, TX 78626