Staff Data Engineer - Data Platform
Big Data
Bigdata
Bigquery
Change Data Capture
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Dataops
Dbt
Distributed Sql
ETL
Informatica
Snowflake
Spark
SQL
Stream Processing
Streaming Data
Job Description
Trend Micro is hiring a Staff Data Engineer (Data Platform) in Austin, Texas to design and build the Vision One Data Platform. The role supports a modern data foundation across ingestion, CDC and replication, governance, semantic discovery, and governed self-service dbt transformation for Vision One OLTP databases.
Responsibilities
- Design and build the Vision One Data Platform, covering data ingestion, replication, transformation, governance, discovery, and serving capabilities.
- Build scalable data pipelines and change-data-capture (CDC) architectures using technologies such as Datastream and similar streaming and replication tools.
- Enable self-service dbt across Vision One OLTP data sources, giving product teams governed capabilities to transform, model, test, document, and expose data without requiring the central data platform team to build every pipeline.
- Establish patterns for safely extracting and replicating data from OLTP and distributed SQL databases into analytical and downstream systems.
- Design architectures for distributed SQL technologies such as YugabyteDB, CockroachDB, or similar platforms.
- Work with technologies including Databricks and modern analytical processing engines to support large-scale data processing and analytics.
- Build a comprehensive data catalog and metadata foundation so teams and AI agents can understand what data exists, its origin, its meaning, and how to use it.
- Develop semantic data discovery capabilities that help engineers, analysts, applications, and AI agents find relevant data based on business meaning rather than only database or schema names.
- Establish data governance standards across ownership, lineage, schemas, quality, access control, retention, and lifecycle management.
- Develop reusable data platform primitives and APIs that product teams can use as self-service capabilities.
- Build automated mechanisms for data quality, schema evolution, lineage, observability, and freshness monitoring.
- Design for evolving product schemas, ensuring the platform supports continuous change without excessive duplication or operational overhead.
- Partner with security and platform engineering teams to implement fine-grained data access controls across databases, schemas, tables, and data products.
- Help establish the source-of-truth architecture for Vision One data while minimizing unnecessary duplication.
- Provide technical leadership and architectural guidance to data engineering and product engineering teams.
- Drive engineering standards for reliability, scalability, performance, cost efficiency, and operational excellence.
Requirements
- 8+ years of experience in data engineering, distributed systems, backend engineering, or a related field.
- Strong experience designing and building large-scale data platforms and data pipelines.
- Deep understanding of OLTP and OLAP architectures and the tradeoffs between them.
- Hands-on experience with CDC, data replication, and streaming architectures.
- Strong SQL expertise and experience working with relational databases at scale.
- Experience with distributed SQL databases such as YugabyteDB, CockroachDB, Spanner, or similar technologies.
- Experience building data transformation workflows using dbt or similar data modeling frameworks.
- Experience with modern analytical/data platforms such as Databricks, Spark, Trino, Snowflake, BigQuery, or equivalent.
- Strong understanding of data governance concepts including metadata, lineage, data quality, ownership, access control, and data catalogs.
- Experience designing systems that support self-service data consumption and transformation.
- Strong software engineering fundamentals, including API design, testing, CI/CD, observability, and production operations.
- Ability to work across organizational boundaries and influence architecture and engineering standards without relying solely on formal authority.
Technologies
- dbt
- Datastream
- YugabyteDB
- CockroachDB
- Databricks
- Spark
- Trino
- Snowflake
- BigQuery
- Spanner
- CDC
- Kafka
- Debezium
- OLTP
- OLAP
Preferred Qualifications
- Experience building a company-wide or platform-level Data Platform rather than individual product pipelines.
- Experience with Datastream, Debezium, Kafka, or similar CDC and streaming technologies.
- Experience with YugabyteDB or CockroachDB in production environments.
- Experience operating Databricks or similar distributed data-processing platforms.
- Experience designing data catalogs, semantic layers, knowledge graphs, or ontology-driven data discovery.
- Experience building platforms that expose data to AI or agentic applications.
- Experience with data mesh, data products, or domain-oriented data architectures.
- Experience implementing fine-grained authorization for data platforms.
- Experience managing large-scale telemetry, security, observability, or other high-volume data.
- Experience balancing data quality, query performance, platform reliability, and infrastructure cost.
Engineering Leadership
- As a Staff Engineer, operate beyond a single team by shaping architecture, establishing technical standards, mentoring engineers, driving cross-team adoption, and resolving ambiguous problems across multiple products and systems.
- Be able to work deeply in implementation while also thinking long-term about architecture for a large-scale, multi-product security data platform.
What Success Looks Like
- Vision One data is discoverable through a shared semantic layer without requiring teams to understand every underlying database and schema.
- Product teams can use dbt as a governed self-service capability across their OLTP data.
- Data lineage, ownership, quality, and access policies are built into the platform rather than handled manually.
- Data moves reliably from distributed OLTP systems into analytical and downstream systems through standardized CDC and streaming patterns.
- Product teams can consume platform capabilities without repeatedly building their own ingestion, transformation, governance, and discovery infrastructure.
- The platform provides a trusted source of truth while minimizing unnecessary copies of data.
- The data foundation supports traditional analytics and applications, plus AI and agentic experiences across Vision One.
Benefits
- Comprehensive medical, dental and vision insurance
- Life insurance
- Short & Long Term Disability
- Pre-partum, maternity, parental and medical leave
- Mental Health Wellness Program
- Adoption Assistance
- Wellness Incentive
- Pet Insurance
- 401(k) with company match
- Paid Time Off
- 14 Annual Holidays
- Tuition Assistance
- Employee Resource Groups
Company Offerings
- Benefit options for you and your family through TrendAI.
- Competitive compensation with bonus opportunity tied to company performance.
- Support for skill growth through ongoing learning and broad technological opportunities.
- Work-life balance supported by team activities.
- A culture focused on equity, inclusion, and collaboration.