DeveloperJobs.io
← Back to all jobs

Job Description

Pattern’s generative content platform creates AI-generated titles, bullets, A+ modules, and imagery, and it requires evaluation systems that can keep quality on track as the model and content engine change. In this senior role, you will own core evaluation infrastructure and drive model-side improvements by turning real-world brand feedback into structured learning signals. This full-time position is hybrid in Lehi, Utah.

What you will do

  • Build and maintain the datasets, rubrics, and automated judges used to evaluate the impact of changes to the content engine.
  • Convert brand rejection reasons into structured, labeled training data that supports the next round of model improvements.
  • Identify approaches to quantify qualitative improvements in generated content.
  • Help decide and defend approval thresholds for generated content in partnership with data science and brand teams.
  • Design quality gates to catch problematic outputs before they reach brand review, reducing rework cycles across the pipeline.

What you bring

  • Strong code and system design experience in any language or stack.
  • 3+ years owning production software services end to end.
  • Formal statistics or machine learning training, or a defensible equivalent depth developed on the job.
  • Experience engineering systems with non-deterministic outputs, where correctness must be measured rather than assumed.
  • Nice to have: fine-tuning experience (LoRA/PEFT), hands-on LLM or generative media production work, evaluation-system ownership, multimodal evaluation, e-commerce domain knowledge, human-labeling operations, or A/B testing infrastructure.

Benefits

  • Unlimited PTO
  • Paid Holidays
  • Onsite Fitness Center
  • Company Paid Life Insurance
  • Casual Dress Code
  • Competitive Pay
  • Health, Vision, and Dental Insurance
  • 401(k) match: Pattern matches 100% of the first 3% in eligible compensation deferred and 50% of the next 2% in eligible compensation deferred.

Growth and impact

Pattern emphasizes internal mobility and professional development. This role sits at the intersection of software engineering and data science on one of Pattern’s most visible AI systems, building deep expertise in evaluation design, fine-tuning, and production ML. The experience is intended to support paths toward senior IC or technical leadership across Pattern’s broader AI and generative content initiatives.

First 30, 60, 90 days

  • 30 Days: Complete onboarding, get up to speed on the generative content pipeline and existing evaluation datasets and rubrics, and make initial contributions to an existing regression suite.
  • 60 Days: Own a defined slice of the evaluation system end to end (such as judges and thresholds for a specific content type), and begin converting brand rejection reasons into labeled training data.
  • 90 Days: Independently drive a fine-tuning or retrieval experiment from hypothesis to validated result, with at least one quality gate live in production catching issues before brand review.

How you work

  • Game Changers: look at problems with an open mind, share new ideas, reassess plans with realistic timelines, make productive and innovative contributions, and actively improve processes and outcomes.
  • Data Fanatics: understand problems through data, draw unbiased conclusions that lead to actionable solutions, and track solution impact with data.
  • Partner Obsessed: explain project status clearly, rely on constructive feedback, listen to partner expectations, deliver results that exceed them, prioritize partner needs, and create a personable partner experience.
  • Team of Doers: uplift team members, recognize specific contributions, take initiative to help, actively support improvements, and hold yourself accountable to the team and partners.

Hiring process

  • Initial phone interview with Pattern’s talent acquisition team
  • Video technical interview
  • Onsite interview with hiring manager and a panel of department leaders
  • Professional reference checks
  • Executive review
  • Offer

How to stand out

  • Discuss professional accomplishments with specific data to quantify examples.
  • Share insights on how you would add value to the team.
  • Emphasize how you align with being partner obsessed at Pattern.
  • Include experience from side projects related to data and analytics.

Experience: 3+ years. Location: Lehi, UT (hybrid). Type: Full-time.

Similar Jobs