Structured Outputs Developer Jobs

1 job found

1d ago

Senior Software Engineer

AikiTech, Inc. Scottsdale, AZ

Scottsdale, AZ

1d ago

Full time Senior Ai Guardrails APIs

Apply Now

Job Description

Senior Software Engineer role at AikiTech building and operating LLM-powered applications and production systems for public agencies.

Responsibilities

Build and operate LLM-powered applications on public-cloud platforms, including government-approved environments
Own prompt design, model evaluation, retrieval, guardrails, and production observability
Evaluate additional commercial or open-weight models as appropriate
Design scalable, secure backend services and data pipelines using Python
Develop versioned evaluation and regression-testing frameworks to measure accuracy, latency, and failure modes before releases reach customers
Work on real-time and near-real-time audio pipelines, including telephony integrations, streaming transcription, call metadata, and latency-sensitive flows
Extend the core GenAI platform with configurable capabilities and integrations aligned to individual agencies’ workflows and data environments
Design and operate infrastructure in AWS GovCloud and Microsoft Azure Government, including identity and access management, networking, encryption, secrets management, deployment automation, infrastructure as code, logging, and monitoring
Embed security and privacy across the development lifecycle using least-privilege access, encryption, audit logging, data-retention controls, vulnerability management, testing, and documented change control
Own engineering controls and supporting evidence for SOC 2 work and CJIS-alignment assessments, including remediation of technical findings
Lead design and code reviews, mentor less-experienced engineers, and produce clear technical documentation for engineers, auditors, customers, and agency stakeholders

Requirements

6+ years of professional software engineering experience with significant ownership of production systems or major production components
Strong Python skills and experience building production backend services, APIs, and data-processing systems
Hands-on experience building LLM API-based applications, including retrieval, embeddings, evaluation, structured outputs, and/or model observability
Production experience with AWS, Microsoft Azure, or another major public-cloud platform, including several of: identity and access management, networking, containers or serverless, infrastructure as code, monitoring, and CI/CD
Experience designing for security, reliability, and maintainability, not only getting prototypes working
Strong debugging and problem-solving skills across application, infrastructure, and integration layers
Ability to communicate clearly with engineers, nontechnical stakeholders, customers, and external assessors
Bachelor’s degree in Computer Science (or higher) required

Technologies

Python
LLM APIs
Retrieval
Embeddings
Structured outputs
AWS
Microsoft Azure
AWS GovCloud
Microsoft Azure Government
Identity and access management
Networking
Containers
Serverless computing
Infrastructure as code
Monitoring
CI/CD
Encryption
Secrets management
Audit logging
SOC 2
CJIS
CIJIS-aligned security program

Benefits

Competitive salary based on experience and qualifications
Participation in AikiTech’s stock compensation plan
Comprehensive health benefits
Paid time off
Access to a 401(k) plan
401(k)
Dental insurance
Health insurance
Vision insurance

Preferred Experience

Building production software for, or alongside, government agencies or public-sector vendors
Supporting customer deployments involving security reviews, technical integrations, or regulated data
Public-safety technology experience such as 911 systems, PSAP operations, CAD, NG911, emergency communications, or telephony
Experience in SOC 2, CJIS-aligned, FedRAMP, StateRAMP, or similarly regulated environments, including implementing engineering controls and responding to assessment findings
AWS GovCloud, Microsoft Azure Government, or other government-cloud environments
Real-time audio processing, VoIP or SIP, streaming transcription, or event-driven architectures
FERPA, COPPA, student-data privacy, or education technology experience
Firsthand professional experience in public safety, emergency communications, or military environments

Work Authorization and Personnel Requirements

Applicants must be legally authorized to work in the United States at the time of hire
AikiTech is unable to provide or assume employment-visa sponsorship for this position

Location

On-site in Scottsdale, Arizona, where the engineering team and integration environment are based
Work closely with people building, deploying, and supporting the platform to support critical technology for public agencies outside traditional coastal technology hubs

View full job page →

Get Structured Outputs Developer Jobs alerts

New Structured Outputs Developer Jobs, daily.