- Involve in research and development of business-oriented general real-time computing IDE and operation platform. Improvising solutions to improve the efficiency of real-time operation development, shorten the online cycle of business research and development, lower the threshold of real-time calculation, and ensure the long-term stable operation of operation services.
- Deep understanding of the business scenarios and the company's trading platform. Collaborate with business departments to design solutions for product landing and promote the development of platform trading business.
- Responsible for the research and development of real-time computing technology solutions that integrate with the existing offline operation IDE, scheduling platform, monitoring and alarm platform, and log collection platform.
- Explore the Kappa architecture solution with integration of batch and flow, separation of computing and storage, and support of multiple computing engines.
- Bachelor degree or above in computer or related majors, with more than 2 years of work experience, and relevant development and design experience in big data platforms
- Familiar with Java development and language foundation, familiar with mainstream Java framework, understand the basic implementation principles of JVM
- Familiar with the commonly used open-source frameworks of the Hadoop ecosystem, experience in real-time streaming computing platform development/real-time data warehouse construction and design is preferred.
- In-depth understanding of commonly used stream computing frameworks, such as Flink, Spark Stream, etc., familiar with flink Sql development, and Flink CDC process, those who have contributed patches to the community are preferred
- Familiar with job development such as Zeppelin, Notebook, Hue one, task scheduling framework Airflow, Argo, Azkaban, Oozie, Dolphin Scheduler one, task monitoring and alarm platforms are preferred
- Familiar with real-time computing OLAP framework, Presto, ClickHouse, Doris, etc. are preferred
- Full of enthusiasm and expectation for the blockchain and digital currency industry, and is committed to working hard for the development of the industry