We are looking for a savvy Data Engineer to join our growing team of development experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable with collaborating, communicating and supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Examples of Duties
Data Focused Essential Duties and Responsibilities:
Create and maintain optimal data pipeline architecture as it pertains to serving up date, data modeling and providing data sources in a data warehouse.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Collaborating and working with the SAHA 20+ Business units to identify, design, and implement internal process improvements: automating manual processes.
Experience supporting and working with cross-functional teams in a dynamic environment.
Optimize data delivery, re-design infrastructure for greater scalability, accessibility and customization.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google ‘big data’ big query’ and other Google Cloud Platform technologies.
Experience with Google Data Studio, Tableau and other analytics tools to build support analyst with a tool box that utilize the data pipeline to provide actionable insights into better customer service delivery, operational efficiency, and other key business performance metrics and strategic outcomes as defined in the agency strategic plan
Work with stakeholders and data stewards to assist with data-related technical issues and assist with the dashboarding, analytics display and reports.
Create data tools for analytics and business analyst team members that assist them in building and optimizing our outcomes to move into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems and to produce data with integrity.
Assist in the quality assurance and integrity of our data output when publishing to the public or presenting data to the board, internally and to external partners
Development/Programming Focused Essential Duties and Responsibilities:
Maintains and implements new functionality in applications written in Dot Net that make use of SQL Server, including stored procedures.
Develops Python framework for automated testing and quality assurance; builds Python engine for executing queries. Applies open source platforms to support Innovative development platforms.
Uses coding methods in specific programming languages to initiate or enhance program execution and functionality
Assists development staff with troubleshooting coding problems by supporting queues, developing new APIs (Application Programming Interfaces) and mobile applications.
Keeps abreast of current, new and relevant methods of programming and development frameworks.
Assesses new and existing software and cloud platforms; identifies potential areas where existing software, and other cloud platforms can bring new applications and new methods of reporting data to support data driven decisions and meet key performance indicators
Keeps security “Top of Mind” as it pertains to software development and data engineers.
Maintains data security and information confidentiality in accordance with Data sharing agreements, legal requirements and IT professional confidentiality.
Assist with the protection of database confidentiality and integrity through access system and user levels of access.
Applies cyber security awareness and development best practices in all existing and new code.
Keeps abreast of new development technologies, cloud platforms and new development frameworks as it pertains to current Innovative technologies.
Strong project management and organizational skills
Performs other duties as assigned.
This position requires the incumbent to exhibit the following behavioral skills:
Leadership: Provides direction to people and/or projects by clearly and effectively setting the course of action for the department, staff, and tasks; manages the planning, execution, and achievement of department goals by providing regular communication to staff and stakeholders.
Commitment: Sets high standards of performance; pursues aggressive goals and works hard/smart to achieve them; strives for results and success; conveys a sense of urgency and brings issues to closure; persists despite obstacles and opposition.
Customer Service: Meets/exceeds the expectations and requirements of internal and external customers; identifies, understands monitors, and measures the needs of both internal and external customers; talks and acts with customers in mind; and recognizes working colleagues as customers.
Effective Communication: Ensures important information is passed to those who need to know; conveys necessary information clearly and effectively orally or in writing; demonstrates attention to, and conveys an understanding of, the comments and questions of others; and listens effectively. Demonstrates the ability to develop audiovisual presentations to both internal and external audiences.
Responsiveness and Accountability: Demonstrates a high level of conscientiousness; holds oneself personally responsible for one's own work; does a fair share of work.
Teamwork: Balances team and individual responsibilities; exhibits objectivity and openness to others' views; gives and welcomes feedback; Contributes to building a positive team spirit; puts success of team above own interests; supports everyone's efforts to succeed; attends, supports, and participates in all team-building exercises and events.
Continuous Improvement and Innovation: Seeks the continuous improvement of technological business processes and services; explores out-of-the-box methods and is open to experimenting with new ideas; uses data, knowledge, and strategic decision-making to generate new and innovative solutions
Bachelor's degree in Computer Science, Information Technology or applied mathematics. Progressive experience in the field with related certifications will be considered.
5 (+) years of progressive experience in the field
Must have the ability to learn and use cloud applications such as Google GSuite applications to include but not limited to: Google Chrome Browser, Gmail, Drive, Calendar, Docs, Sheets and Slides. Understanding document sharing and collaboration in the cloud. Experience and proficiency with Microsoft Office 365, cloud accessible applications to include but not limited to: One drive, Outlook, Word, Excel, and Powerpoint or MAC or PC desktop equivalent is acceptable.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Using Python and C# have working knowledge in building and optimizing ‘big data’ data pipelines, architectures and data sets.
Using SQL, Tableau or other BI tool, must demonstrate experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Using BI tools, demonstrate strong analytical skills related to working with datasets.
Working knowledge and experience supporting processes using ETL and ELT standards and practices in support of data transformation, data structures, metadata, dependency and workload management.
Experience with data modeling to manipulate, process and extract value from datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Demonstrate understanding of software life cycle development with emphasis on project management phases, techniques, and use of project management tools is required.
Working knowledge of Data Governance policies and procedures to include the use of Data Dictionary and Data Cataloging concepts for Data Documentation.
Successful completion of a criminal history background check, education and work history verification and drug screening test.
Qualified candidates will have 5+ years of experience in a Data Engineer role and have attained a Graduate degree in Computer/Data.
Ability to learn cloud technologies such as LucidChart for workflow diagrams, flowcharting and chart drawing. Experience with Vizio or equivalent is acceptable. Basic understanding of Virtual Private Network (VPN) access to connect to internal business systems.
Science, Statistics, Informatics, Information Systems or another quantitative field.
Experience with big data tools: BigQuery, Cloud DataProc, Cloud Pub/Sub, Cloud DataLab, Cloud DataPrep, and Cloud Composer.
Experience with relational SQL and NoSQL databases: MS SQL, MySQL, PostgreSQL.
Experience with data pipeline and workflow management tools: Google Cloud Data Fusion, Informatica, Stitch Data, Airflow, etc.
Experience with Google Cloud Platform services and tools.
Experience with stream-processing systems: Google DataFlow, Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C#, Scala, other programming languages are acceptable.
Experience developing APIs as required to interface between all SAHA applications as needed.
Must be adept at finding data warehouse solutions.
Some understanding of the server relationship as it pertains to development
License and Certifications:
Texas Class “C” driver’s license at the time of placement and be insurable by the Housing Authority’s liability and fleet insurance carrier.
Must have the ability to earn certifications as required by assigned tasks.
To perform this job successfully, the employee should have:
Strong Development and computer skills in Google API, Google Cloud Platforms such as Big Query, App Engine and Data Store.
Must know how to build and maintain database systems using MS SQL, MySQL.
Must be fluent in programming languages such as SQL, Python, C#.
Must be fluent in using ETL (Extract, Transfer, Load) tools.
Must have the ability to learn other computer software programs, development frameworks and use open source as needed and required by assigned tasks and projects.
Knowledge of Cloud Platforms as it relates to Systems and Network infrastructures.
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
To perform this job successfully, the employee is frequently required to remain in a stationary position. Daily movements include sitting; standing; operating computers and other office equipment; moving about the office; attending onsite and offsite meetings. The employee must be able to communicate via email and verbally via telephone. The employee must occasionally transport up to 10 pounds.
The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
The noise level in the work environment is usually moderate
High level of interaction with external/internal clients
May be required to work at different properties or sites for interim periods to support business needs
Subject to environmental elements when conducting visits to various sites or participating in outside events.
In compliance with the Americans with Disabilities Act, the San Antonio Housing Authority will make reasonable accommodations to the known disability of a qualified applicant or employee to enable people with disabilities to enjoy equal employment opportunities, if it would not impose an “undue hardship” on the operation of the employer’s business.
As a public agency, SAHA is committed to maintaining the highest of ethical standards. Applicants selected for employment are expected to perform work responsibilities with the highest degree of integrity, professionalism and honesty, to merit the respect of our co-workers, clients, partners, vendors and the general public. Applicants selected for employment are also expected to serve the public with dedication, concern, courtesy and responsiveness.
The above information on this description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications required of employees assigned to this job.
This position specification is not an employment agreement or contract. Management has the exclusive right to alter this position specification at any time, without notice.