LiveIntent is looking for an enterprising
Senior Data Engineer, full of ideas, with an interest in programming and large scale data processing, to join our highly competent development team in Copenhagen! Our team in Copenhagen is responsible for the development and deployment of the company’s next-generation technology closely collaborating with the company’s other branches in New York and Berlin.
LiveIntent Copenhagen started as a Danish start-up company in 2013 and was acquired by LiveIntent in November 2015. The team is led by people who have been with us since the start in 2013 and consists of a further approx. 30 new hires that have been added since the end of 2016. We develop and operate a very complex analytical data processing pipeline which is a basic component of all the company's products.
About The Job
The Compute Infrastructure team empowers Data Scientists and Data Engineers through a Scala data warehouse framework designed for data modeling and the creation of type-safe and easily testable batch jobs. Our team also orchestrates a compute environment that simplifies the execution of Spark jobs, facilitating the analysis of terabytes of data with ease and cost-effectiveness. The runtime environment is based on Hadoop clusters on EC2 spot instances, dynamically scaling up as required, ensuring high resource utilization and stability
What you will be doing as part of the Compute Infrastructure team:
- Operate and implement new features in the framework and the services managed by the team
- Engaging with data scientist and identify ways of improving their experience and productivity of using our framework and services
- Identify and implement computational improvements
- Making improvements and/or fixing bugs by submitting patches to open source projects that are in our stack. For example Spark, Hadoop, Airflow and many others
- Act as a office topic expert on Spark and Scala
Your Profile
You are interested in back-end technologies and architecture and are passionate about learning new things. You may also be interested in math, statistics, or adtech solutions. You also have at least a couple of years of practical experience in the industry, and preferably also have a practical and/or deep theoretical understanding of some of the following:
- Spark and/or other large scale data-processing framework
- Programming in Scala or other JVM based language
- Kubernetes
- Basic knowledge about Amazon Web Services (EC2, S3, Athena, etc)
You have a degree in computer science, software engineering, physics, math, or chemistry. You approach problems analytically and solutions pragmatically. You are full of good ideas, able to see opportunities and weaknesses in other people’s ideas, and able to find ways to discuss ideas in a distanced and constructive manner. You love to go in depth with different topics and are curious about learning about things within new subjects. You want to understand and get involved with the problems the company is facing. You thrive in a dynamic environment where work priorities can change, and therefore tasks may not always be finished. You can hand over tasks, but prefer to finish them yourself. You are able to work independently and enterprisingly. When people come to you with a problem, bug or a question you’ll want to help them immediately.
The Company
LiveIntent, one of the world’s largest people-based marketing platforms, connects 2,500 publishing and advertising brands with over 250 MM verified people every month across all types of media. With the hashed email address at the center of its industry-leading identity graph, LiveIntent provides brands with solutions that help them monetize, acquire, and retain real people, even where cookies don’t work. LiveIntent enriches a brand’s data, making it possible for them to deepen their understanding of their audiences, and more effectively market to people wherever they are present and paying attention. LiveIntent has offices located in New York, Berlin, and Copenhagen
.
The Copenhagen branch started as a Danish startup company in 2013 and was acquired by LiveIntent in November 2015. We develop and operate both an online, real-time service that receives billions of requests from all over the world and from other LiveIntent components, and an offline, batch-oriented analytical data processing pipeline that prepares data for the online service by processing billions of data points.
We Offer
You can look forward to being a key player in a challenging and dynamic developmental story where you will be part of a team with some of the industry's hottest talents. There will be rich opportunities to learn from others, and you will have the flexibility to dive into experiments on your own. We are passionate about new solutions, technologies and algorithms, but pragmatic in our choice of solutions.
We believe in freedom and flexibility under responsibility so that office hours can be adapted to your life as long as meetings are covered. If you need to work from home one day, it is completely fine, as long as you live up to what is expected. We are an international company, with frequent contact between the departments in Berlin and New York City. The position is located in our office in Copenhagen.
Does that sound exciting? If so, send us an application! We are a small office with a social atmosphere so your personal profile is just as valuable to us as your technical skills. A cover letter will therefore be greatly appreciated.