Job description
Why Work for Us
We Power the Nation
Make the most of your talents and develop products that can create impact on a national scale. We are an in-house software team, assembled to move with speed and deliver with quality.
We Build Reliable Solutions. For Customers, Company And Country
You will be part of the SP Digital and together, you will innovate, create, and deploy digital products that will empower more than 3,800 employees within SP Group and improve the quality of life for the 1.5 million commercial, industrial and residential customers that SP Group serves. We build solutions that enable sustainable high quality lifestyles and help consumers save energy and cost, as well as supporting national goals for a sustainable liveable city.
Now, imagine the impact you can create!!
What You’ll DO:
- Create and maintain multiple robust and high-performance data processing pipeline within Cloud, Private Data Centre and Hybrid data ecosystem
- Assemble large, complex data sets from a wide variety of data sources
- Collaborate with Data Scientist, Machine Learning Engineer, Business Analyst and Business users to derive actionable insights and reliable foresights into customer acquisition, operational efficiency and other key business performance metrics
- Develop, deploy and maintain multiple microservices, rest API and reporting services
- Design and implement internal processes to automate manual workflow, optimize data delivery and re-designing infrastructure for greater scalability, etc
- Establish expertise in designing, analyzing and troubleshooting large-scale distributed systems
What You’ll NEED:
- Experience building and operating large scale data lake and data warehouse
- Experience with Hadoop ecosystem and big data tools, including Spark and Kafka
- Experience with stream-processing systems including Spark-Streaming
- Advance working experience with relational SQL and NoSQL databases, including Hive, Hbase and Postgres
- Deep understanding in SQL and able to optimize data queries
- Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc
- A successful history of manipulating, processing and extracting value from large disconnected datasets
- Experience applying modern development principles (Scrum, TDD, continuous integration, and code reviews)
Good to Have:
- Experience with ETL tools such as Talend Big Data, Apache Nifi, etc
- Experience working with Hortonworks Data Platform or Cloudera Data Platform
- Experience with Metadata Management tools
- Exposure to Data Governance processes and tools
- Proven ability in supporting and working with cross-functional teams in a dynamic environment
Thank you for your interest in SP Group. You will be contacted if you are shortlisted for an interview.
