Title: Data Engineer
Description
Seeking an experienced Data Engineer with a proven record of developing advanced reporting data models on complex, disparate systems, preferably in a Big Data warehouse environment. The candidate will be a member of a team developing and evolving an internal business intelligence infrastructure for large online media store. The data models developed by this team will supply information to engineering, business operations, and external content providers regarding status of online media, including incoming and outgoing volume, workflow status, and availability status.
Responsibilities
The specific responsibilities of the Data Engineer position include, but are not limited to, the development and deployment of data models and reports that provide business intelligence to engineering and operations groups.
Development of data models using Oracle that summarize complex data into usable, digestible datasets, dashboards, and reports.
Development of algorithms, routines, and jobs to extract, transform and normalize, and load the databases with operational data in preparation for reporting and analysis.
Develop, test, and implement scheduled and ad hoc reports that enable data driven decisions
Investigation, profiling, and resolution of performance bottlenecks attendant to usage of the databases, either when loading or extracting. This will likely involve interaction with key users to ensure that performance is suited to their particular needs.
Implementation of extracts and reports from the production databases, in support of repeated, periodic, automated requests, as well as ad-hoc requests as needed by key stakeholders.
Required Skills
Strong experience writing SQL on Oracle
Strong experience writing Oracle PLSQL
Experience writing shell scripts
Experience reverse engineering Oracle data models to write complex SQL reports
Skilled in advanced SQL performance tuning, particularly involving complex PLSQL development, capable of re-writing SQL to reduce execution time.
Strong understanding of distributed transactions between Oracle databases.
Proficiency in OS X and Linux server environments.
Ability to document and communicate Project status, issues, and risks in a timely manner to team and senior management.
Minimum of 4 years developing SQL reports.
Desirable Skills
Knowledge of online media (video, etc)
Familiar with Tableau or SuperSet
Familiar Spark SQL
Familiar with Hadoop and HDFS
Familiar with job scheduling systems for orchestrating data pipelines
Able to solve problems independently using available resources.
Pro-actively seeks to develop solutions to complex problems.
