Data Architecture

Data Architecture Developer Jobs

1,249 jobs found

Today

Sr Machine Learning Engineer- Delivery Marketplace

Uber Sunnyvale, CA

Sunnyvale, CA

Today

$202k - $224k/yr Full time Backend Developer Ai Ml Artificial Intelligence

Apply Now

Job Description

Bring your machine learning expertise to Uber’s Delivery Marketplace team and help shape the next generation of dispatch intelligence. This onsite role in Sunnyvale, CA focuses on designing, building, and productionizing advanced ML models and matching algorithms that support better ETA, pickup optimization, and trip reliability.

You’ll lead technical strategy and roadmap ownership, taking models and optimization systems from concept through large-scale deployment. You’ll also develop transformer-based models that generate embeddings and natural language profiles used across Marketplace use cases.

What you’ll do

Own technical strategy and execution across multiple quarters, including platform-level architecture decisions, executive communication and alignment, technical mentorship, and cross-team technical influence
Build novel online marketplace products that combine machine learning for prediction and forecasting with optimization to improve both business efficiency and user experience
Drive end-to-end design, development, and productionization of ML solutions for large-scale distributed systems serving billions of trips
Develop transformer-based models using pre-training and fine-tuning to produce embeddings and natural language profiles that power Marketplace applications

What you’ll need

Ph.D., M.S., or Bachelor in Computer Science, Mathematics with a focus on Machine Learning, or an equivalent technical background with exceptional demonstrated impact
3+ years experience leading development and deployment of ML models in large-scale production environments at top-tier ML companies (example scale: 1M+ predictions/sec or 100M+ users), with a track record of delivering business impact over multiple quarters
Proficiency in Python, Scala, Java, or Go
Proficiency with large-scale data systems (such as Spark or Ray), real-time processing (such as Flink), and microservices architectures
Experience in developing, training, productionizing, and monitoring ML solutions at scale, from offline pipelines to online serving and MLOps
Deep understanding of modern ML algorithms

Tools you may work with

Python, Scala, Java, Go, Spark, Ray, Flink, microservices architectures, machine learning and deep learning, causal modeling, reinforcement learning, transformer-based models, embeddings, natural language profiles, and MLOps.

Preferred qualifications

Experience developing and deploying ML models for large-scale business problems
Track record translating complex business problems into technical solutions and driving cross-functional projects
Excellent communication skills to lead initiatives across multiple product areas
Proficiency in deep learning, causal machine learning, or reinforcement learning
Proficiency with large embedding and language models

Compensation and benefits

Salary range: USD 202,000 - 224,000 per year (base). Eligible to participate in Uber’s bonus program, and may be offered an equity award and other types of compensation.

Full-time employees are eligible to participate in a 401(k) plan
Eligible for various benefits

Office location and work expectations

Offices remain key to collaboration and Uber’s culture. Unless approved for full remote work, employees must spend at least 50% of their time in-office.

View full job page →

Today

Data and Machine Learning Engineer

Cognizant Mason, OH

Mason, OH

Today

$130k - $150k/yr Full time Ai/ml Data Engineering Automation Azure

Apply Now

Job Description

Build scalable data platforms and production-grade machine learning capabilities in a Microsoft Azure environment as part of Cognizant’s Data Engineering team.

Responsibilities

Design, develop, and maintain scalable data ingestion, transformation, and ETL/ELT pipelines
Build and optimize Azure-based data platforms using Databricks, Synapse Analytics, Data Lake, and related cloud technologies
Deploy, operationalize, and support machine learning solutions using CI/CD pipelines and MLOps practices
Monitor, troubleshoot, and optimize data and machine learning workloads for performance, reliability, and scalability
Collaborate with engineering and data science teams to turn business and technical requirements into production-ready solutions

Requirements

Proven experience as a Data Engineer, Machine Learning Engineer, or Cloud Platform Engineer
Strong hands-on experience with Microsoft Azure data engineering and analytics services
Proficiency in Python, SQL, and/or Scala
Experience developing, supporting, and optimizing production-grade data pipelines
Hands-on experience with Apache Spark, Databricks, or comparable distributed data processing frameworks
Familiarity with CI/CD, DevOps, and MLOps practices
Ability to independently design, develop, troubleshoot, and deliver technical solutions
Strong communication and collaboration skills, including experience working across cross-functional teams

Technologies

Microsoft Azure, Databricks, Synapse Analytics, Data Lake
CI/CD, MLOps, Python, SQL, Scala
Apache Spark, Azure Data Factory, MLflow
Docker, Kubernetes, Azure Kubernetes Service (AKS)
Delta Lake, Parquet
Infrastructure as code, orchestration frameworks, cloud monitoring tools
SAP Change Data Capture (CDC)

Standout skills (optional)

Experience with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake
Knowledge of MLflow, Docker, Kubernetes, or Azure Kubernetes Service (AKS)
Experience with Delta Lake, Parquet, and modern cloud data architectures
Familiarity with infrastructure as code, orchestration frameworks, and cloud monitoring tools
Exposure to enterprise data integrations, including SAP Change Data Capture (CDC)
Experience working in Agile development environments

Benefits

Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
Long-term/Short-term Disability
Paid Parental Leave
Employee Stock Purchase Plan

Work model

Onsite role in Mason, OH
5 days a week in a client or Cognizant office in Mason, Ohio

Salary and compensation

Annual salary: $130,000 - $150,000 (depending on experience and qualifications)
Eligible for Cognizant’s discretionary annual incentive program (based on performance and subject to plan terms)
Applications accepted until November 08, 2026

View full job page →

Today

Senior Data Engineer

PharmaLink, LLC Largo, FL

Largo, FL

Today

Full time Backend Developer Senior Ai/ml Data Engineering

Apply Now

Job Description

PharmaLink, LLC is building and evolving an enterprise data, analytics, and AI platform, and the Senior Data Engineer will be central to that effort. This onsite role in Largo, FL focuses on designing and operating solutions across the modern Databricks ecosystem, from lakehouse architecture and ETL/ELT to analytics, dashboards, and AI enablement.

What you’ll do

Design, build, and operate enterprise data solutions on Databricks.
Develop scalable ETL/ELT pipelines using Python, PySpark, Spark SQL, and Delta Lake.
Create curated data models and reusable data products for analytics, applications, and AI.
Implement Unity Catalog capabilities including security, lineage, access controls, and data governance.
Build and optimize Databricks SQL Warehouses and AI/BI Dashboards.
Develop data and AI applications using Databricks Apps.
Design and implement solutions using Databricks Lakebase.
Enable AI/ML and Generative AI use cases using Databricks capabilities.
Build automated processes for data quality, reconciliation, anomaly detection, and monitoring.
Integrate data from databases, SaaS platforms, APIs, files, and other enterprise systems.
Optimize Spark workloads, SQL queries, pipelines, performance, and platform cost.
Establish engineering standards covering Git, CI/CD, testing, monitoring, and production deployment.
Troubleshoot complex production and data issues and perform root-cause analysis.
Partner with Data Governance, BI, application, and business teams to deliver trusted data products.

Required experience

8+ years of experience in data engineering, data platforms, or related engineering roles.
4+ years of hands-on Databricks experience in production environments.
Advanced SQL, Python, PySpark, and Apache Spark skills.
Strong experience with Delta Lake and Unity Catalog.
Strong ETL/ELT, data modeling, and enterprise data architecture experience.
Experience with Databricks SQL and AI/BI Dashboards.
Familiarity with Databricks capabilities across AI/ML, Generative AI, Databricks Apps, and Lakebase.
Strong relational database and data-engineering fundamentals.
Experience with Git, CI/CD, automated testing, monitoring, and production support.
Experience working with cloud-based enterprise data platforms.
Maintain a positive attitude in a high-performance team environment.
Must pass a background check and random drug screenings.
Must be adaptable and flexible when working with a diverse workforce.

Technologies

Databricks
Python
PySpark
Spark SQL
Delta Lake
Unity Catalog
Databricks SQL
AI/BI Dashboards
Databricks Apps
Lakebase
AI/ML
Generative AI
Git
CI/CD
Apache Spark

Preferred qualifications

Databricks on Microsoft Azure.
Azure Data Factory.
Microsoft SQL Server.
Fivetran or similar CDC/ELT technologies.
Power BI.
Databricks Workflows.
MLflow and AI/model lifecycle capabilities.
API and application development experience.
Azure DevOps or GitHub-based CI/CD.
Databricks professional certification.
Experience in healthcare, life sciences, or another regulated industry.

Location and schedule

Largo, FL (onsite)

Physical requirements

Requires light physical activity performing non-strenuous daily activities of an administrative nature (sustained phone, headset, and keyboard use) and periods of prolonged sitting.

View full job page →

Today

Senior AWS Python Developer / PySpark Data Engineer

System One Lafayette, TN · Columbia, SC

Lafayette, TN · Columbia, SC

Today

Full time Backend Developer Python Analytics

Apply Now

Job Description

System One is hiring a Senior Python and PySpark Data Engineer to support hands-on AWS big data and data processing initiatives. This hybrid role spans Lafayette, LA, Knoxville, TN, Columbia, SC, and Birmingham, AL, where you will build scalable data pipelines and strengthen production performance across large datasets.

The work centers on scalable Python and Spark-based processing on AWS, with a strong emphasis on SQL and operational reliability. You will partner with technical and business teams while contributing CI/CD automation and troubleshooting across application and data processing workflows.

What you’ll do

Develop scalable Python applications and data processing solutions
Integrate APIs to connect services and data sources
Write and optimize complex SQL queries, including data transformations
Process large datasets using Spark and AWS services
Troubleshoot application and data processing performance issues
Contribute to CI/CD automation
Work closely with technical and business teams across the organization

What you bring

8+ years of hands-on Python development, including data-intensive and big data applications
Strong Python fundamentals with experience building scalable, production-grade applications
5+ years working with Apache Spark / PySpark, including troubleshooting and optimizing Spark jobs
5+ years hands-on AWS experience, including Amazon EMR, AWS Lambda, EventBridge, Step Functions, Redshift, S3, and Glue
Advanced SQL experience, including complex queries, data transformations, joins, and recursive CTEs
Experience developing and consuming REST APIs and integrating with external services and data sources
A strong background working with large datasets, including manipulation, transformation, analysis, and processing
Experience with big data technologies such as Hadoop, EMR, Spark, and Hive
4+ years of experience with AI-related technologies or applications
Hands-on CI/CD and infrastructure automation experience using GitLab and Terraform
Strong debugging, performance tuning, analytical, and problem-solving skills
Ability to collaborate effectively across development teams and in a matrixed organization
A Bachelor’s degree in Computer Science, Information Systems, or a related field

Technologies

Python, PySpark, Apache Spark
SQL
Amazon EMR, AWS Lambda, Amazon EventBridge, AWS Step Functions
Amazon Redshift, Amazon S3, AWS Glue
Hadoop, Hive
REST APIs
GitLab, Terraform, CI/CD, AWS services

Type: Direct Hire
Work model: Hybrid
Minimum experience: 4 years
Location: Lafayette, LA · Knoxville, TN · Columbia, SC · Birmingham, AL

View full job page →

Today

Data Engineer

Agile Defense Honolulu, HI

Honolulu, HI

Today

$135k - $165k/yr Full time Big Data Data Data Analysis

Apply Now

Job Description

Agile Defense is hiring a Data Engineer to build and maintain secure data pipelines, ETL/ELT workflows, and analytics-ready datasets supporting mission needs.

Responsibilities

Develop and maintain secure data pipelines, ETL/ELT workflows, and analytics-ready datasets.
Partner with data scientists, engineers, and mission stakeholders to process structured and unstructured data.
Implement data processing using platforms including Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable technologies.

Requirements

Bachelor’s degree in computer science, data science, engineering, information systems, mathematics, or a related technical field.
Consideration of equivalent combinations of education, technical certification, and relevant professional experience.
3+ years of relevant experience in data engineering, software development, data analytics, or enterprise-platform experience.
Python experience and familiarity with SQL, including data validation, data modeling, and data-quality practices.
Familiarity with Spark, PySpark, Databricks, or comparable technologies.
Experience supporting ETL/ELT pipelines and data transformations.
Understanding of version control, testing, documentation, and Agile development.
Ability to collaborate with technical and nontechnical stakeholders.
Active US government security clearance.

Technologies

Python
SQL
Spark
PySpark
Databricks
Palantir Foundry
Maven Smart Systems

Preferred Skills

Experience with Palantir Foundry, Maven Smart Systems, or War Data Platform.
Exposure to Docker, CI/CD, MLflow, APIs, or Terraform.
Familiarity with AWS or Azure.
Familiarity with DoD data environments and classified networks.
Prior Combatant Command support.
Strong Python and SQL skills, with familiarity in JavaScript/TypeScript.

Working Conditions

Must be able to work onsite in a SCIF.

Clearance

Requires U.S. citizenship.
Must possess an active Secret security clearance (minimum).
Some roles may require higher-level clearances, including TS/SCI, and candidates must be able to obtain and maintain them based on project assignment.

Location: Honolulu, HI (onsite)
Salary: USD 135,000 - 165,000 per year

View full job page →

Today

AI Data Engineer

PowerPlan, Inc Atlanta, GA

Atlanta, GA

Today

Full time Artificial Intelligence Data Data Analysis

Apply Now

Job Description

PowerPlan’s Applied AI team is building the governed data foundation behind AI solutions used across finance, sales, professional services, and product.

Responsibilities

In the first 30 days, learn how the company runs through its data.
By end of first quarter: deliver an owner-checked first catalog of critical data.
By month 12: keep the catalog current enough that business and technology leaders can plan AI work from it.
From your first 30 days, help establish team standards for data, connections, and code review.
Define how AI tools connect to business systems, including read-only by default, keeping changes within what the job requires, and ensuring review by IT and security.
In your first quarter: pair with an AI engineer on a first build and own the data.
By six months: lead the data on the first larger build into pilot.
By month 12: deliver the data behind at least two larger AI solutions that are in weekly use and run by the business.
In your first quarter: agree on the first shared data sets.
By six months: publish the first shared data set.
By month 12: have at least two shared, governed data sets in use by more than one team or AI solution.
Within 12 months: retire hand-built recurring reports by defining the numbers once, enabling an AI tool to draft commentary, answer questions, and flag items needing human attention.

Requirements

2 to 4 years of professional experience as a data engineer, analytics engineer, or similar role focused on coding to clean and model data, or a master’s degree in a related field with at least 1 year of experience.
Experience turning messy real data from a business system, spreadsheet, or documents into data people or an AI tool used, including explaining what broke and how it was fixed.
Ability to trace a metric back through producing systems and processes, and understand definitions from the people who own them; experience where a business owner’s explanation changed what you built.
Agentic coding tools are your default workflow, including Claude Code, Codex, Cursor, or OpenCode, with skills to plan work, direct the tool, and verify outputs (team builds with Claude Code; tools are provided).
Strong Python and SQL skills, including reading and modifying code written by others.
End-to-end API data extraction experience, including authentication, secrets, paging, and error handling.
Comfort working in Git, treating data access and documentation as part of the build, and writing notes a business owner can follow.
Bachelor’s degree in computer science, data science, statistics, mathematics, information systems, or a closely related quantitative field; a business analytics or other quantitative business degree qualifies if it included substantial programming coursework.
Ability to work from Atlanta in the office at least 3 days per week and authorization to work in the United States (no visa sponsorship, now or in the future).

Technologies

Python
SQL
Git
Claude Code
Codex
Cursor
OpenCode

Even Better If

You’ve built an MCP server, an agent skill, or a connector someone else used.
Experience with a modern data platform, retrieval over documents (RAG), or data quality checks.
Experience with CRM, finance, or project data, ideally in or alongside finance, professional services, sales operations, or support.
Applied continuous improvement methods such as Lean, Six Sigma, or value stream mapping.
You hold a master’s degree in a related field such as computer science, information systems, data science, or business analytics.

Hybrid Work / Onsite Requirements

This is a hybrid role combining onsite work from the corporate office and work from home.
Flexible working arrangements may be accommodated when sensible, but there are times when onsite work is required.
Onsite needs may include scheduled office days, team meetings, client meetings, or special events.

View full job page →

Today

Data Engineer

Benchmark South Bend, IN

South Bend, IN

Today

$70k - $140k/yr Full time Python 3d Design Tools Apache Airflow

Apply Now

Job Description

Benchmark is seeking an experienced Data Engineer to own and evolve its data platform and build reliable end-to-end data pipelines.

Responsibilities

Own the architecture and development of data pipelines
Build ETL workflows for both structured and unstructured data
Develop web scrapers, data integrations, and automated collection systems
Create data models, validation processes, and monitoring for reliability and quality
Build internal tools and APIs to make data usable for product and engineering needs
Contribute to customer-facing features when needed
Use AI tools and models to improve engineering and data workflows
Help scale technology and engineering practices as the company grows

Requirements

Substantial professional experience in data engineering or software engineering, including ownership of production data systems (5+ years preferred)
Strong Python and SQL skills, including pandas, NumPy, or similar libraries
Experience designing and owning production ETL/ELT pipelines
Experience with Dagster, Airflow, Prefect, or a similar orchestration platform
Experience with Snowflake, BigQuery, Redshift, Databricks, or a similar data warehouse
Strong knowledge of data modeling, transformation, validation, and quality controls
Experience building reliable web scrapers or automated data-collection systems
Fluency with AI coding tools, plus experience working with LLM or machine-learning APIs
Comfort operating with high autonomy and ambiguity in a fast-paced startup

Technologies

Python, SQL
pandas, NumPy
Dagster, Airflow, Prefect
Snowflake, BigQuery, Redshift, Databricks
AI coding tools, LLM, machine-learning APIs

Benefits

401(k)
Dental insurance
Health insurance
Paid time off
Vision insurance

Nice to have

TypeScript or JavaScript experience
Backend experience with NestJS, Express, FastAPI, Django, or similar frameworks
Frontend experience with React, Next.js, or similar technologies
Experience building retrieval-augmented generation systems
Experience deploying AI agents or other LLM-powered applications in production
Experience with AWS or another major cloud platform
Experience with Terraform, Docker, CI/CD, or infrastructure as code
Experience processing PDFs, spreadsheets, contracts, or other semi-structured documents
Experience with Pinecone, Weaviate, pgvector, or another vector database
Experience working at an early-stage startup or on a small engineering team

Location and working style

Full-time hybrid role based in South Bend, Indiana
Preference for candidates who can work with the team in person regularly
May consider an exceptional candidate outside the area
Works directly with the CTO and broader team while maintaining autonomy to own major technical initiatives