Data Engineer (Intermediate OR Senior)
Senior
CI/CD
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Data Warehousing
Databricks
DevOps
Devops Tools
ETL
Microsoft Fabric
Power BI
Reporting and Analytics
Snowflake
SQL
Job Description
Data Engineer (Intermediate or Senior) role at the Teacher Retirement System of Texas in Austin, Texas (onsite).
Responsibilities
- Design, develop, and optimize data pipelines, data modeling, and platform management to support reliable data system integration.
- Maintain the data warehouse; generate complex reports and conduct in-depth data analysis.
- Implement and manage ETL processes and perform data lake management.
- Create and maintain data platforms and basic-to-advanced data models to support structured data storage and accessibility.
- Develop and maintain data warehouses, and enhance efficiency through optimization and strategic maintenance.
- Manage data catalogs to keep a well-organized, easily accessible repository of data resources.
- Implement CI/CD pipelines, with intermediate proficiency for the intermediate level and advanced DevOps practices for the senior level.
- Administer and maintain data permissions to ensure proper access control and data security.
- Perform administrative support and basic system administration duties to help manage and maintain data systems.
- Develop data-driven applications that support business needs.
- Support and lead larger data analysis initiatives and provide insights to business stakeholders.
- Generate and automate reports using reporting tools; support more advanced reporting tasks as required.
- Build dashboards providing visibility into key performance, risk, and control indicators across agency divisions and departments.
- Collaborate with stakeholders to gather requirements and contribute to defining project scope and objectives.
- Contribute to Agile execution, including scrum activities; intermediate-level contributions and senior-level leadership of scrum activities are included.
- Act as a trusted technical advisor to Investment teams and support the evolution of Investment data platforms by shaping how critical investment data is integrated, secured, and delivered at scale.
- Design, architect, enhance, and optimize data platforms and pipelines; improve system performance and reliability and make systems easier to manage.
- Perform related work as assigned.
Requirements
- Bachelor's degree from an accredited college or university in one of the listed fields: computer information systems, computer science, data management, information systems, information science, mathematics, or a closely related field.
- High school diploma or equivalent with additional full-time experience in data pipeline builds and implementation may be substituted on an equivalent year-for-year basis.
- Three (3) to Five (5) years of full-time directly related, progressively responsible experience in data pipeline builds and implementation, including:
- ETL tool usage to create ETL scripts
- Power BI or an equivalent modern data visualization package, or related experience
- Experience may be concurrent.
- Master's or doctoral degree in a closely related field may be substituted on an equivalent year-for-year basis.
Technologies
- ETL tools
- CI/CD pipelines
- Power BI
- Data lake
- Data warehouses
- Data catalogs
- DevOps practices
- Microsoft Fabric
- Databricks
- Snowflake
- Spark
- SQL
- Python
- Cloud platforms
- Data encryption (REST, SOAP, XML, JSON)
- Web services (SSL, SSH, SFTP, Certificates)
- Reporting tools
Preferred Qualifications (Data Engineer)
- Experience with data architecture and modeling.
- Experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms.
- Experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates).
Preferred Qualifications (Data Engineer Senior)
- Advanced experience with data architecture and modeling.
- Advanced experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms.
- Advanced experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates).
Knowledge, Skills, and Abilities
- Strong knowledge of business intelligence tools, databases, SQL, and object-oriented programming languages to support data analysis and predictive analytics.
- Database modeling and data warehousing principles.
- System development life cycle concepts.
- Knowledge or advanced knowledge of data platforms and platform management; ETL concepts and building pipelines.
- Knowledge or advanced knowledge of data architecture and modeling.
- Knowledge or advanced knowledge of Microsoft Fabric, Databricks, Snowflake, Spark, and cloud platforms.
- Knowledge or advanced knowledge of data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates).
- Proficient to advanced proficiency in Python and SQL.
- Ability to use technical and statistical analysis skills to deliver clear, concise, visually appealing management metrics and reports for decision-making.
- Writing report queries with an understanding of relational databases.
- Business process analysis and problem solving.
- Ability to complete detailed work with a high degree of accuracy.
- Planning, organizing, and prioritizing work assignments for a high-volume workload in a fast-paced and changing environment.
- Comfort working in a Windows environment using Microsoft Office word processing, spreadsheets, and other business software.
- Effective written and verbal communication, including explaining complex information clearly and writing clear policies, procedures, and training or other materials.
- Team collaboration skills to influence a diverse group of stakeholders.
- Ability to operate effectively in a fast-paced environment with competing and shifting priorities.
- Commitment to continually learn new concepts and tools and pursue ongoing professional development.
- Ability to establish and maintain harmonious working relationships with coworkers, agency staff, and external contacts.
- Work effectively in a professional team environment.
- Participation in Scrum activities with an advanced understanding of Agile.
Military Occupational Specialty (MOS) Codes
- Veterans, Reservists, or Guardsmen with experience mapped to the Military Occupational Specialty (see: https://www.trs.texas.gov/files/trs-military-crosswalk.xlsx) along with the minimum qualifications listed above may meet the minimum requirements and are encouraged to apply.
- Contact Talent Acquisition at [email protected] with questions or for additional information.
Location: Austin, TX, United States (onsite)
Salary range: USD 98,214 - 149,898 per year
Minimum experience: 3 years
Education: Bachelor's degree