Senior Data Engineer

Job Type

Full-time

Description

Who we are

Brightly, a Siemens company, is the global leader in intelligent asset management solutions. Brightly enables organizations to transform the performance of their assets with a sophisticated cloud-based platform that leverages more than 20 years of data to deliver predictive insights that help users through the key phases of the entire asset lifecycle. More than 12,000 clients of every size worldwide depend on Brightly’s complete suite of intuitive software – including CMMS, EAM, Strategic Asset Management, IoT Remote Monitoring, Sustainability and Community Engagement. Paired with award-winning training, support and consulting services, Brightly helps light the way to a bright future with smarter assets and sustainable.

About The Job

We are seeking experienced data engineers to help us with rapid expansion our Data Cloud, constructing new data pipelines and buildout of the Snowflake cloud data warehouse structures for various stakeholders and analytics applications, using most modern techniques and technologies. Our modern solution features standardized data ingestion pipelines that support low latency of data updates from the sources and enable variety of analytics applications, automation and instrumentation for production support as well as agile yet robust DataOps/DevOps development lifecycle processes. This is an excellent opportunity for a data engineer that is passionate about designing, implementing and operating scalable, and efficient solutions to flow data from production systems into a data lake and data warehouse, building data structures for information delivery to consumers. These may range across new predictive models, advanced analytics, operations monitoring and automation, as well as more traditional operational reporting.

What You’ll Be Doing

• Build new data ingestion pipeline into our data cloud, while helping guide the decisions about the future of our data infrastructure
• Be the key contributor in the assigned domains for the data pipelines and new data lake and cloud data warehouse structures being created for analytics and reporting or AI/ML applications
• Contribute to the development of the data models, data dictionaries and catalog references in the application domains of the primary responsibility
• Maintain and monitor our data pipeline processes and data cloud zones to ensure timely, quality and accurate data
• Steward our data cloud, through the definition of standards and best practices around data usage, including metatdata cataloging and organization
• Contribute to our team's thought leadership for data cloud and operational processes lifecycle and tooling
  
  

Requirements

What you need

• BS in an Engineering or Science discipline, or equivalent experience
• 5+ years of software/data engineering experience using Java, Scala, and/or Python, with at least 2 years experience in a data focused role
• Experience in data integration (ETL/ELT) development using multiple languages (e.g., Java, Scala, Python, PySpark, SparkSQL)
• Experience building and maintaining data pipelines supporting a variety of integration patterns (batch, replication/CDC, event streaming) and data lake/warehouse in production environments
• Experience with AWS-based data services technologies (e.g., Kinesis, Glue, RDS, Athena, Snowflake, etc.)
• Experience of working in the larger initiatives building and rationalizing large scale data environments with a large variety of data pipelines, possibly with internal and external partner integrations, would be a plus
• Willingness to experiment and learn new approaches and technology applications
• Knowledge and experience with various relational databases and SQL
• Knowledge of software engineering and agile development best practices
• Excellent written and verbal communication skills
  
  

The Brightly culture

Service. Ingenuity. Integrity. Together. These values are core to who we are and help us make the best decisions, manage change, and provide the foundations for our future. These guiding principles help us innovate, flourish and make a real impact in the businesses and communities we help to thrive. We are committed to the great experiences that nurture our employees and the people we serve while protecting the environments in which we live.

Together we are Brightly