Data Engineer
Job Description
What we offer On-site in Norristown, PA with a salary range of USD 120,000 to 160,000 per year. Benefits include 401(k), dental, health, and vision insurance, plus paid time off. This role focuses on real-time data streams from a fleet of robots to enable low-latency monitoring, debugging, and ML model training.
Overview
We are seeking an experienced Data Engineer to design, build, and maintain complex real-time data streams generated by a mix of mobile and static robots. The role centers on handling video, telemetry, and sensor data to support real-time observation, rapid debugging, and machine learning workflows.
Responsibilities
- Architect and optimize high-throughput, low-latency data pipelines using Azure cloud services and on-prem solutions, optimized for streaming and time-series data.
- Manage and process data from robot telemetry such as position, velocity, and battery life.
- Develop efficient ingestion, storage, and retrieval workflows for high-resolution video and Lidar point cloud data.
- Enable rapid data access for research and development teams.
- Collaborate with software engineers to define data formats and communication protocols for robot-to-cloud transmission.
- Implement mechanisms to handle intermittent connectivity and ensure data completeness.
Requirements
- Minimum of 3 years of hands-on data engineering experience, with a significant focus on real-time or streaming data.
- Experience with data storage services, including cloud-based options such as Azure Data Lake and self-hosted solutions.
- Expert-level proficiency in Python and data query languages.
- Experience with streaming data processing frameworks.
- Experience with time-series databases.
- Education: Bachelor’s degree.
- Data Engineer in Robotics, IoT or Autonomous Systems Domain: 5 years (Required)
Technologies
- Python
- Azure Data Lake
- Kubernetes
Benefits
- 401(k)
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance
Schedule
Monday to Friday, weekends as needed
Salary
USD 120,000 - 160,000 per year
Location
On-site in Norristown, PA
Job Type
Full-time
Application questions
Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Yes Or No