Collect and process raw data at scale for a variety of projects and initiatives.
Design and develop data applications using selected tools and frameworks as required and requested for a variety of teams and projects.
Work closely with the engineering team to integrate your work into our production systems.
Process unstructured data into a form suitable for analysis.
Analyze processed data.
Support business decisions with ad hoc analysis as needed.
Monitoring data performance and modifying infrastructure as needed.
Bachelor’s degree in computer engineering or computer science.
At least 3 – 5 years of recent experience in data engineering；
In-depth knowledge of Hadoop, Spark, and similar frameworks.
Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.
Familiarity with Mesos, AWS, and Docker tools.
Excellent project management skills.
Good communication skills.
Ability to solve complex networking, data, and software issues.