Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Your Role and Responsibilities
Do you love writing fast code and crafting software systems to solve sophisticated problems? As the engineer on our team, you will be working on solving enterprise-level problems using cutting-edge technology and creating impact in the world of Artificial Intelligence. Join the team, build and deploy leading solutions for a broad range of applications.

Role & Responsibilities

• Minimum 10 years of Data Engineering experience and at least 5 years in large scale Data Lake/Platform ecosystem
• Expertise in Data Lakehouse architecture and end-to-end Databricks techniques including Data Science components
• Proven in-depth experience in Databricks, Spark, Python/SQL, Scala, Kafka, Streaming, events, bots, AWS/cloud ecosystem
• Have worked on multiple TBs/PBs of data volume use cases from ingestion to consumption
• Worked on end-to-end data lifecycle from Data Ingestion, Data Transformation, and Data Consumption layer. Versed with API and its usability
• Have worked on big data use cases as in telemetry, logs, and real-time data ingestion through APIs
• Expert proficiency with storage and ETL tools, including Presto, Spark, Scala, and the Python data stack.
• Experience with analytics/visualization toolsets such as PowerBi/Tableau
• Strong Python and/or SQL skills Ability to manipulate JSON/XML data and exposure with other data manipulation platforms
• Well versed with AWS framework such as SQS, Stream, Kubernetes, EC2, S3, have deployed dockers/containers
• Profound knowledge of DevOps pipeline, worked with CI/CD across code bases
• Have worked across Elastic, Kibana/Grafana will be plus
• Expert in big data technologies such as Spark, Kafka, Airflow, APIs
  

Required Technical and Professional Expertise

• Good understanding of ML Ops techniques with model building at scale
• Apply machine learning and/or statistical techniques to time series classification and telemetry anomaly detection problems
• Hands-on Data Engineering and agile software development environment.
• Knowledgeable about the latest data analytics tools, machine learning.
• Expertise in MapReduce, Hadoop, Hive, Presto
• Experience with structured data such as Avro, Parquet, Protobuf, Thrift, and concepts like schema evolution

Preferred Technical and Professional Expertise

• You are very motivated, highly passionate, and curious about new technologies. You take pride in your work and strive to achieve incredible results and possess excellent communication and planning skills.
• Self-motivated and able to work independently within project timelines
• Excellent oral and written communication skills Learn and use internally available analytic technologies

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

This job requires you to provide your COVID-19 vaccination status with supporting documentation, where legally permissible.

Are you craving to learn more? Prepared to solve some of the world's most unique challenges? And ready to shape the future for millions of people? If so, then it's time to join us, express your individuality, unleash your curiosity and discover new possibilities.

Every IBMer, and potential ones like yourself, has a voice, carves their own path, and uses their expertise to help co-create and add to our story. Together, we have the power to make meaningful change – to alter the fabric of our clients, of society and IBM itself, to create a truly positive impact and make the world work better for everyone.

It's time to define your career.

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM offers a wide range of resources for eligible IBMers to thrive both inside and outside of work. In addition to a competitive benefits program consisting of medical and life insurance, retirement plans, and time off, eligible employees may also have access to:

• 12 weeks of paid parental bonding leave. Family care options are also available to support eligible employees during COVID-19.
• World-class training and educational resources on our personalized, AI-driven learning platform. IBM's learning culture supports your restless attitude to grow your skills and build the depth and scale of knowledge needed to achieve your career goals.
• Well-being programs to support mental and physical health.
• Financial programs that empower you to plan, save, and manage your money (including expert financial counseling, 401(k), IBM stock discount, etc.).
• Select educational reimbursement opportunities.
• Diverse and inclusive employee resource groups where you can network and connect with IBMers across the globe.
• Giving and volunteer programs to benefit charitable organizations and local communities.
• Discounts on retail products, services, and experiences.

We consider qualified applicants with criminal histories, consistent with applicable law.

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.