Senior Data Engineer
Job Description
Persistent is seeking a Senior Data Engineer to design, build, and operate enterprise-scale real-time data platforms and streaming solutions. The role centers on resilient, low-latency, event-driven distributed architectures and shared ownership of production operations.
Responsibilities
- Design, build, and operate real-time data platforms, streaming architectures, and distributed systems within complex enterprise environments.
- Bring at least 8 years of hands-on experience running real-time streaming solutions in production at scale, with accountability for reliability, performance, observability, recovery, and operational stability.
- Apply strong software engineering capability with fluency in Java, including writing production-grade code and leading technical implementation for business-critical systems.
- Demonstrate technical credibility across streaming and event-driven systems, including partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
- Lead engineering teams by mentoring developers and driving delivery while maintaining high standards for design, coding, testing, and operational support.
- Work with modern streaming and data technologies such as Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming, or equivalent platforms, applying judgment to select appropriate patterns for each problem.
- Support control, governance, and risk management expectations for production data platforms, especially where resilience, auditability, and data correctness are business critical.
- Lead architecture, design, development, and operational stewardship for real-time streaming and data platform capabilities, staying hands-on in key technical decisions and implementation when appropriate.
- Write, review, and guide high-quality production code for critical platform components, raising standards for maintainability, resilience, and performance.
- Own the design and production operation of resilient, low-latency streaming solutions processing critical financial events, with strong guarantees for correctness, recoverability, observability, scalability, and control.
- Run streaming platforms at scale, including responsibility for production health, capacity, reliability, incident response, recovery, and continuous service improvement.
- Partner with business, product, architecture, and control stakeholders to shape roadmaps, resolve complex engineering problems, and align platform delivery with business and regulatory requirements.
- Drive platform modernization across streaming, event processing, and data movement, balancing hands-on technical contribution with leadership across delivery priorities and dependencies.
- Establish engineering disciplines spanning testing, code review, release management, observability, incident response, capacity planning, and production readiness for real-time workloads.
Requirements
- 8+ years of experience in designing, building, and operating enterprise-scale real-time data platforms and streaming solutions.
- Deep expertise in Java, Spring Boot, Kafka, and distributed event-driven architectures.
- At least 8 years of hands-on experience running real-time streaming solutions in production at scale, accountable for reliability, performance, observability, recovery, and operational stability.
- Strong software engineering capability with fluency in Java, including a track record of production-grade code and leading technical implementation for business-critical systems.
- Proven technical credibility in streaming and event-driven systems, including partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
- Experience leading engineering teams, mentoring developers, and driving delivery with strong standards across design, coding, testing, and operational support.
- Experience working with modern streaming and data technologies such as Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming, or equivalent platforms, with judgment to choose the right patterns.
- Strong understanding of control, governance, and risk management expectations for production data platforms, particularly where resilience, auditability, and data correctness are business critical.
Technologies
- Java
- Spring Boot
- Kafka
- Pulsar
- Kinesis
- Flink
- Spark Structured Streaming
Benefits
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Work Environment
- Hybrid work support and flexible hours to fit diverse lifestyles.
- Accessibility-friendly office setup, including ergonomic setups and assistive technologies to support employees with physical disabilities.
- People with disabilities can inform the company of specific requirements during the application process or at any time during employment.
Similar Jobs
S