Job description
Lucid (a Cint Group company) is a research technology platform that provides programmatic access to first-party data. With respondents in more than 100 countries, Lucid enables anyone, in any industry, to survey online audiences and get the answers they need. These answers reveal the sentiments, motivations, and behaviors of target demographics – data that can be used to build business strategies, measure the impact of digital advertising, publish research, and more. Founded in 2010, Lucid is headquartered in New Orleans, LA with offices throughout the US, Europe, and Asia.
Senior Data Engineer
Location: New Orleans, LA
Responsibilites:
Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of structured and unstructured data sources using big data technologies preferably using AWS services. Build analytics tools that utilize data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders, including the Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs. Keep our data separated and secure through multiple AWS regions. Create data tools for analytics and data science team members and assist them in building and optimizing our product into an innovative industry leader. Assemble large, complex data sets that meet functional / non-functional business requirements. Create and maintain optimal data pipeline architecture. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Work with data and analytics experts to strive for greater functionality in our data systems. Telecommuting (remote work) is permitted.
Qualifications
Requires a Master's degree in Computer Engineering, Computer Science, Statistics, Informatics, or a related field plus 5 years of related work experience. Requires 5 years of experience in the following: Advanced working SQL knowledge; working with relational databases, query authoring (SQL) and databases and CDC processes, including MSSQL and PgSQL, with Custom Code written in Python, Java, or Scala; Using Spark for large-scale distributed processing with custom code written in Java and Scala and messaging layer using Kinesis; AWS cloud services, including EC2, EMR, RDS, Redshift, Athena, and Lambda; Working in the languages of Python, Java, and Golang; and Spark-streaming that is specifically used with the ability to Code in Scala and Java, such as Storm or Spark-Streaming.
Lucid's Hiring Commitment
At Lucid we foster a collaborative and inspiring workplace. We pride ourselves in doing this by recruiting, hiring and retaining diverse, passionate, and forward-thinking talent. Lucid is committed to and encourages an inclusive environment and we are dedicated to providing equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.
