Streaming Data Engineer
Job Description
Bright Vision Technologies seeks a Streaming Data Engineer (100% remote in the U.S.) to architect, deploy, and run large-scale Kafka and Confluent environments for mission-critical, event-driven workloads.
Responsibilities
- Design, deploy, and operate large-scale Apache Kafka and Confluent Platform for mission-critical event-driven workloads
- Own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement
- Partner with application teams to deliver a streaming platform that is reliable, performant, and developer-friendly
- Collaborate with cross-functional partners across product, design, engineering, operations, and business to turn ambiguous requirements into well-engineered solutions
- Improve engineering effectiveness through code reviews, design reviews, and mentorship of more junior engineers
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline
- 5+ years of experience operating Apache Kafka or Confluent Platform in production
- Deep, hands-on understanding of Kafka internals including partitions, replication, ISRs, and consumer groups
- Strong Kafka security experience using SASL, mTLS, ACLs, and RBAC
- Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB
- Experience implementing HA/DR strategies for Kafka
- Strong scripting skills in Python, Bash, or Go
- Hands-on experience with infrastructure-as-code such as Terraform and Ansible
- Working knowledge of observability tooling for Kafka
- Excellent troubleshooting, communication, and documentation skills
Preferred Qualifications
- Confluent Certified Administrator or Developer credentials
- Experience operating Kafka on Kubernetes (Strimzi, Confluent Operator)
- Exposure to managed Kafka services such as AWS MSK or Azure Event Hubs Kafka API
- Familiarity with stream processing frameworks including Flink or Spark Streaming
- Experience with data governance and lineage for streaming data
Technologies
- Apache Kafka, Confluent Platform
- Kafka Connect, Schema Registry, Kafka Streams, ksqlDB
- SASL, mTLS, ACLs, RBAC
- Python, Bash, Go
- Terraform, Ansible
- Kafka
Compensation
- USD 78,000 - 105,000 per year
Visa Sponsorship
- U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply
- Unable to sponsor new H-1B visa petitions for this position
How to Apply
For immediate consideration, send your resume to [email protected].