November 10, 2021
Apply Now
Bengaluru, Karnataka, India
November 10, 2021
Apply NowJob description
BrightTALK is a division of TechTarget, the largest source of B2B purchase intent data for Marketing and Sales to accelerate revenue growth.
As the leader in B2B Purchase Intent data, TechTarget understands the critical, time sensitive nature of application integrations for our customers as well as the level of complexity involved and is committed to ensuring our customers’ Sales and Marketing teams are set up for success. The Senior Data Engineer / Lead will play a key role in the Design and Development of Data models, datasets, and ETL/ELT pipelines from a variety of data sources to the Data Warehouse / Data Lake on Google Cloud Platform (GCP). Our products rely heavily on this foundational data layer and are rapidly moving in the direction of more real-time streaming data flows. The candidate must have a keen sense for the business drivers and help execute the data strategy. The candidate must be familiar with industry trends and best practices around data engineering on the cloud and apply them appropriately.
Responsibilities
- Design, develop, and implement end-to-end data solutions (storage, integration, processing, access) in Google Cloud Platform (GCP)
- Create ETL/ELT pipelines that transform and process terabytes of structured and unstructured data in real-time
- Design data models for optimal storage and retrieval to support sub-second latency
- Deploy and monitor large database clusters that are performant and highly available
- Be a hands-on contributor on the team
- Collaborate with product/application architects to develop holistic solutions
- Implement operational procedures (logging, monitoring, alerting, etc.) for dependable running of pipelines/jobs
- Autonomous. You own what you work on. You move fast, take ownership, and get things done
Requirements
- BS Degree in Computer Science or a related field
- 10+ years industry experience, with at least 2 years working onGoogle Cloud Platform (GCP)
- Proficient in development with Python/SQL
- Experienced in developing large scale ETL pipelines
- Developing REST APIs to data sources.
- Expertise in data warehouse modeling and implementation
- Experience in Big Data technology stack (BigQuery preferred)
- Experience in Lean/Agile software development approach and DevOps integration for CI/CD
- Experience with Oracle/MySQL, PL/SQL(primarily for understanding existing datasets)
- Experience with Linux/Unix
- Good verbal and written communication skills
TechTarget, Inc. is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. TechTarget strictly prohibits and does not tolerate discrimination against employees, applicants, or any other covered persons because of race, color, sex (including pregnancy), age, national origin or ancestry, ethnicity, religion, creed, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, training, promotion, discipline, compensation, benefits, and termination of employment. TechTarget complies with the Americans with Disabilities Act (ADA), as amended by the ADA Amendments Act, and all applicable state or local law.
