Full Stack Data Engineer

Pivotal is seeking a Full Stack Data Engineer to develop internal applications that help engineering teams explore, interpret, and act on flight data. The work spans backend services, web front ends, dashboards and AI-assisted tooling, self-serve analysis, and packaging tools for engineers to run locally.

What You’ll Do

• Build and maintain internal web applications engineers use to work with flight data, including flight record browsers, query interfaces, and analysis tools over the data warehouse.
• Develop Python services and HTTP APIs that query AWS Athena and Amazon S3, delivering results at interactive speed with pagination and caching for large result sets.
• Create interfaces that allow engineers to explore large telemetry datasets without writing SQL, including sortable tables, filters, and time-series plots.
• Build agent-based tooling that helps engineers ask questions in plain language and trace symptoms to root causes without hand-writing queries, returning not only the answer but also the underlying data and derivation so results can be verified.
• Convert recurring one-off analyses from firmware, GNC, battery, and maintenance teams into supported, self-serve tools.
• Generate an internal field guide and data catalog from the warehouse itself, keeping documentation aligned to actual table contents, and maintain the metadata in machine-readable form for correct interpretation by tooling and agents.
• Create review and triage views for fleet health alerts, including acknowledgment, history, and trend views, alongside existing dashboards and Slack notifications.
• Package and distribute analysis tooling so it runs on an engineer laptop, including Windows, without requiring guided environment setup.
• Take work through deployment with tests, code review, CI/CD, and monitoring to identify failures.
• Partner with engineering teams to define what they need, and document what is shipped for ongoing support.

Required Qualifications

• 2+ years of professional experience building and shipping web applications, with capability from backend through front end.
• Bachelor’s degree in Computer Science or a related technical discipline, or equivalent practical experience.
• Proficiency in Python, and comfort writing SQL against a real database.
• Experience with a modern JavaScript or TypeScript front-end framework (React, Vue, or similar).
• Experience building and consuming HTTP APIs, including authentication, pagination, and error handling.
• Comfort with Git-based workflows, code review, and CI/CD.
• Ability to work with non-software engineers to clarify requirements and ship the solution, since many requirements come from conversation rather than a fixed specification.

Technologies

• Python, SQL, JavaScript, TypeScript
• React, Vue
• HTTP APIs
• AWS Athena, Amazon S3
• Git-based workflows, CI/CD
• Windows, Slack notifications

Preferred Qualifications

• AWS experience, particularly S3, Athena, Lambda, or API Gateway.
• Experience working with large or time-series datasets and knowledge of keeping a UI responsive over millions of rows.
• Charting and data visualization libraries, including Grafana dashboard development.
• Docker, and infrastructure as code with Terraform.
• Experience building with LLM APIs or agent frameworks, including tool use, retrieval over structured data, and evaluating output trust.
• Experience building internal tools where users are colleagues rather than external customers.

Additional Familiarity

• Aerospace, automotive, or robotics telemetry, including flight or vehicle test data.
• Packaging desktop or command-line tooling for non-developer users, including on Windows.
• Authentication and access control for internal applications (SSO, IAM, scoped credentials).
• Regulated or safety-critical environments with traceability and data retention requirements.
• Natural-language or conversational interfaces over structured, time-series, or diagnostic data.
• Interest in RC planes, quadcopters, or aviation.

Benefits

• Comprehensive benefits package, including medical, dental, vision, and 401k plans.

Role Location and Eligibility

• Location: Palo Alto, CA (onsite)
• Employment eligibility: Applicants must be eligible for employment in the United States and willing to work onsite at the HQ office in Palo Alto, CA.

AI in the Hiring Process

• Pivotal may use artificial intelligence tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals.
• AI tools assist the recruitment team but do not replace human judgment.
• Final hiring decisions are made by humans.