Senior Data Engineer

YOUR MISSION: Your mission is to manage and optimize our cloud data platform. This means you will be responsible for working on a variety of data projects which includes orchestrating our data pipelines using modern big data tools as well as the engineering of existing transactional processing systems while meeting our security requirements.

YOUR LEGACY: Your legacy will include ensuring that every Urgently team across our growing organization is able to access data from any source within minutes and that none of our data is ever lost. The result? You helped Urgently become the world’s leading mobility assistance company.

WHAT YOU’LL BE RESPONSIBLE FOR:

1) First 3 months:

• Understand our platform development environment and philosophy.

• Learn our cloud platform and applications’ infrastructure

• Grasp our engineering teams’ work culture.

2) First 6 months:

• Integrate a number of 3rd party data sources

• Employ various cloud tools to marry our internal and external systems and third party APIs together

• Develop data platform services

• Build monitoring infrastructure / services to give visibility into the pipeline’s status

• Interface with different teams to make data available for reporting and analytics

4) Ongoing...

• Continue to optimize our data platform

• Gather data requirements from other teams and implement solutions for them

• Ensure integrity between our various systems and champion the flow of data across all of our systems ensuring data consistency

• Work with structured and unstructured data at scale from a variety of different data sources (key-value, document, columnar etc.) as well as traditional RDBMSs

• Constantly monitor and support our complete data ecosystem

• Maintain the data platform security and integrity

• Operate and manage the services in production

WHO YOU ARE:

Technical Skills :

• Bachelor's Degree in computers science or applied mathematics

• 7+ years of software development in startups or companies working on big data technologies.

• Working experience with Redshift and know the best practices for tuning Redshift’s performance

• Advanced knowledge of Python

• Experience writing and understanding complex SQL queries

• Advanced knowledge of AWS Big Data services, such as EMR, Glue, Athena

• Working experience orchestrating data pipelines with tools like Airflow

• Experience with stream-processing systems such as Apache Spark Streaming, Kinesis, Apache Kafka

• Working experience with RDS, Elasticsearch, Lambda functions, EC2, S3

• Working knowledge of messaging and data pipeline tools like Apache Kafka, Kinesis, SNS, SQS

• Working experience with logging and monitoring tools like Elasticsearch Service, Cloudwatch

• Knowledge of infrastructure as code and CloudFormation

• Working experience on automating the deployment and operation of data pipelines

Industry Experience:

• You have been involved in developing at least one data pipeline that involved collecting/streaming, storing and processing (ETL) the data for various business use cases.

• You have been an Integral part of a team working with structured, semi-structured and unstructured large data sets from real time/batch streaming data feeds.

• Problem Solving: You are known for proactively solving problems before they can become real problems. You are the kind of person who is constantly upgrading your skill sets & is always looking for ways to enhance the data platforms you’re working on.

• Team Member: You pride yourself on working collaboratively with all of your teammates. You are transparent in your communication and proactively share what you learn with the team.

NICE TO HAVES:

• Have Amazon Web Services certificate(s)

• Have worked with data pipeline and governance tools: Azkaban, Luigi etc.

• Experience working with NoSQL databases like Apache Solr, MongoDB

• Have knowledge of HDFS, Flume, Hive, MapReduce

• Have worked with one of the data warehouse tools like Google BigQuery, Snowflake

• Experience with reporting tools like Tableau, Power BI

THE NITTY GRITTY:

• Location = Great news! You have the option of working from anywhere in the U.S.!

• Manager = You’ll report to Director of Data Engineering

• Compensation = Commensurate with experience for a company of Urgently’s size

• Benefits = At Urgently, we have awesome benefits! We provide short term disability, long term disability, and life insurance to you - all free of charge! We also offer three different medical plans to choose from, two dental plans (on the base dental plan, we pay the full cost for employee-only coverage!), a vision plan, and other valuable benefits. You’ll have 12 holidays off and unlimited paid time off. We match 100% on the first 3% you contribute to our 401(k)and then 50% of the next 2% you contribute. So, if you contribute 5% of your paycheck, we’ll match 4% of that. Free money!

OUR FAIR HIRING PRACTICES:

At Urgently, we don’t just accept difference - we celebrate it, we support it, and we thrive on it for the benefit of our employees, our customers and the communities where we operate. We are an equal opportunity employer which means that employment and advancement at Urgently is based on a person's merit and qualifications.

We do not discriminate against any applicant or employee on the basis of race, ethnicity, color, national origin, ancestry, citizenship, religion, creed, sex (including pregnancy, childbirth, breastfeeding or related medical conditions), sexual orientation, gender, gender identity or expression, physical or mental disability, or any other characteristic protected by federal, state or local law.

You should also know that we adhere to these same principles in all aspects of employment, including, but not limited to, recruitment, hiring, job assignment, compensation, promotion, access to benefits and training, discipline, and termination of employment.

Applicants with disabilities may be entitled to reasonable accommodation under the Americans with Disabilities Act and similar applicable state laws. Please let us know if you need assistance completing any forms or to otherwise participate in the application process

For more information, visit www.geturgently.com