Azure Data Lake

Azure Data Lake Developer Jobs

4 jobs found

Today

Senior Data Engineer

Brooksource New York, NY 🇺🇸 Remote

New York, NY

Today

$65 - $85/hr Full time Senior Analytics API

Apply Now

Job Description

Brooksource invites applications for a Senior Data Engineer tasked with designing, building, and maintaining scalable data pipelines and architectures that empower advanced analytics and business intelligence through big data technologies, cloud platforms, and robust data modeling.

Responsibilities

Design, develop, and optimize large scale ETL pipelines using Informatica, Talend, Apache Spark, and Apache Hive
Construct and sustain data architectures on cloud platforms such as AWS, Azure Data Lake, and other public cloud environments
Collaborate with cross functional teams to capture requirements and translate them into scalable data solutions
Create data models employing dimensional modeling techniques for data warehousing and analytics
Oversee data integration processes involving linked data, RESTful APIs, and other external sources
Ensure data quality, security, and compliance throughout the data lifecycle
Facilitate the deployment of machine learning models through integrated data pipelines
Utilize SQL, Python, Java, Bash scripting, and Shell scripting to automate and enhance processes
Participate in Agile development cycles through sprint planning, reviews, and continuous improvement efforts
Document data workflows and architecture diagrams to promote transparency and knowledge sharing

Requirements

Proven experience as a Data Engineer or similar role focusing on big data systems and cloud-based architectures
Extensive knowledge of AWS services (S3, Redshift, Glue), Azure Data Lake, the Hadoop ecosystem, and other public cloud offerings
Strong proficiency with SQL databases including Microsoft SQL Server, Oracle, and cloud-based options
Hands-on ETL/ELT development experience using Informatica or Talend
Demonstrated expertise in data modeling, including dimensional modeling for enterprise data warehouses
Skilled in Python, Java, VBA, Bash scripting, and Shell scripting for automation tasks
Familiarity with business intelligence tools such as Looker or equivalent platforms for reporting and analysis
Understanding of RESTful API integration for linked data access
Knowledge of analysis skills related to database design, query management, model training, and analytics methodologies
Experience delivering value in Agile environments with iterative development

Technologies

Informatica
Talend
Apache Spark
Apache Hive
AWS
Azure Data Lake
Hadoop
S3
Redshift
Glue
Microsoft SQL Server
Oracle
SQL
Python
Java
VBA
Bash scripting
Shell Scripting
Looker
RESTful API

Compensation

Hourly rate: USD 65.00 - 85.00 per hour

Work Location

New York, NY, with remote work option

View full job page →

1d ago

Staff Engineer II - Senior Data Engineer

Western Alliance Bank Phoenix, AZ

Phoenix, AZ

1d ago

Full time Senior Analytics Azure Data Factory

Apply Now

Job Description

What we offer

Western Alliance Bank provides a stable, growth-focused environment where data leadership and security matter. In this role, you will design, build, and deploy key components of the enterprise data platform with a strong emphasis on safety, security, compliance, and reliability. You will lead a centralized data engineering team and partner with data stewards, analysts, engineers, enterprise architects, and business stakeholders to turn data into actionable insights.

Competitive salaries
Ownership stake in the company
Medical and dental insurance
Time off
Great 401k matching program
Tuition assistance program
Employee volunteer program
Wellness program

Location: Phoenix, AZ (onsite)

Responsibilities

Design, develop, and deploy data engineering solutions using Azure Data Factory, Synapse Analytics, and Azure DevOps to support regulatory reporting and the LFI strategy.
Create scalable data engineering solution designs that can be handed off to teams for execution, emphasizing component reuse to maximize efficiency.
Build ETL and data pipeline capabilities that account for data creation, transformation, storage, archiving, analysis, and sharing across Western Alliance Bank and partner systems.
Implement CI/CD pipelines in Azure DevOps for all data solutions in line with technical standards.
Apply Test Driven Development to all designed, built, and deployed data solutions.
Lead the implementation of outcomes from Data Governance and Enterprise Architecture initiatives.
Drive the migration of multidimensional cubes to tabular models to optimize analytics performance.
Use Power BI to design, deploy, and visualize tabular models, enabling actionable BI insights.
Perform data exploration and profiling using tools such as Excel and Informatica.
Participate actively in data architecture decision making.
Provide technical mentorship to team members and other data professionals.
Collaborate with product owners and business stakeholders to understand requirements and operational processes.
Embed quality and compliance by design in all data solutions.
Review Azure Data Factory pipelines, Synapse artifacts, and other engineering scripts to ensure high-quality deliverables.

Requirements

Bachelor’s degree in engineering or a related field; Master’s or MBA preferred.
7+ years in data engineering with ETL concepts, enterprise data warehouse capabilities, and related tooling; strong preference for Azure Data Factory, Azure Synapse Analytics, and/or Databricks.
2+ years designing, implementing, and supporting cloud data solutions, with Azure Data Lake, Azure Data Factory, Azure Data Services, Azure Synapse, Azure Logic Apps, and Azure DevOps experience preferred.
Advanced experience with at least one RDBMS and a query language such as T-SQL, PL/SQL, or Spark SQL.
Advanced skills in conceptual, logical, and physical data design.
Azure certifications such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, or Azure DevOps Engineer preferred.
Familiarity with data science and analytics tools like SAS, Tableau, and Power BI.
Experience with multi-cloud data management and transformation platforms or tools such as Databricks or Snowflake.
Experience in Agile, SAFe, or Scrum environments preferred.
Experience integrating with data quality, data catalog, and data lineage tools preferred.
Previous leadership experience preferred.
Intermediate to advanced knowledge of general Financial Services or Banking is preferred.
Strong knowledge of regulatory and legal compliance obligations, rules, and industry standards.
Proven ability to lead cross-functional teams and manage multiple projects, including pipeline development and Azure DevOps usage across concurrent efforts.
Strategic thinking with the ability to align projects with organizational goals, lead diverse teams, and mitigate project-level risks; governance patterns tied to intake, technical reviews, and architectural compliance.
Excellent spoken and written communication skills.
May require up to 25% travel.

Technologies

Azure Data Factory
Azure Synapse Analytics
Azure DevOps
Azure Data Lake
Azure Logic Apps
Power BI
Excel
Informatica
Databricks
Snowflake
SAS
Tableau
Azure Data Services
T-SQL
PL/SQL
Spark SQL

View full job page →

2d ago

Data Engineer

Asylon Norristown, PA

Norristown, PA

2d ago

$120k - $160k/yr Full time Python Azure Data Lake Azure Data Lake Storage

Apply Now

Job Description

Asylon is seeking an experienced Data Engineer to shape the data backbone for its robotics ecosystem. This onsite role in Norristown, PA focuses on architecting, building, and maintaining real-time data streams from a fleet of robots, handling video, telemetry, and sensor data with low-latency processing to support live monitoring and machine learning model training.

Responsibilities

Architect and optimize high-throughput, low-latency data pipelines across Azure cloud and on‑prem environments, tailored for streaming and time-series workloads.
Collect and process data generated from robot telemetry, including position, velocity, and battery status.
Build solutions for ingesting, storing, and retrieving high-resolution video and LiDAR point cloud data efficiently.
Enable rapid data access for research and development teams.
Collaborate with software engineers to define data formats and communication protocols for robot-to-cloud transmission.
Implement strategies to manage intermittent connectivity and ensure data completeness.

Requirements

Minimum of 3 years of hands-on experience in a Data Engineering role, with a significant focus on real-time or streaming data.
Experience with data storage services, including cloud-based options (such as Azure Data Lake) and self-hosted solutions.
Expert-level proficiency in Python and data query languages.
Experience with streaming data processing frameworks.
Experience with time-series databases.

Experience

Data Engineer in Robotics, IoT or Autonomous Systems Domain: 5 years (Required)

Technologies

Azure
Azure Data Lake
Python
Kubernetes

Benefits

401(k)
Dental insurance
Health insurance
Paid time off
Vision insurance

Job Details

Job Type: Full-time
Salary: USD 120,000 - 160,000 per year
Schedule: Monday to Friday; weekends as needed
Location: Norristown, PA (onsite)

Education

Bachelor’s degree

Application Question

Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Yes Or No

View full job page →

7d ago

BI & Analytics Analyst/Data Engineer

JSSA Rockville, MD

Rockville, MD

7d ago

Full time Analyst Analytics Azure Data Lake

Apply Now

Job Description

JSSA, based in Rockville, Maryland, is seeking a hybrid BI and Analytics Analyst/Data Engineer. The role spans end-to-end analytics, from SQL Server data warehouse design to self-service Power BI reporting, and requires collaboration with stakeholders and data engineers to turn raw data into reliable, actionable insights. The position is hybrid and requires a bachelor’s degree with at least five years of relevant experience.

Responsibilities

Collaborates with IT business partners and operational leaders to design analyses that identify opportunities to improve care, assess adherence to clinical best practices, and quantify outcomes.
Supports ensuring data repositories deliver consistent, reusable data by partnering with staff to establish, implement, and guide standards and best practices.
Promotes best-practice knowledge enabling self-service analytics by business stakeholders rather than IT‑owned development.
Owns self-service reporting datasets, including DAX measures, data models, and row‑level security.
Translates business requirements into clear analytical deliverables, manages stakeholder expectations, and iterates based on feedback.
Monitors report usage and data quality, proactively identifying and resolving issues.
Documents data definitions, metric logic, and report lineage to foster a data-literate culture within the agency.
Utilizes technical tools to query, manipulate, and summarize data from multiple sources.
Assists in designing, developing, maintaining, and updating databases to meet department and organizational needs.
Designs and builds star schema data warehouse objects in SQL Server, including fact and dimension tables and aggregation layers.
Writes and maintains T-SQL stored procedures, ETL pipelines, and staging-to-data warehouse data loads.
Develops and owns source-to-target mapping documentation for new data domains.
Integrates data from source systems.
Contributes to data quality, pipeline reliability, and warehouse performance optimization.
Supports the adoption of self-service analytics by building clean, well-documented datasets.
Documents current data architecture, defines logical and physical data structures, and establishes the agency data blueprint.
Manages and supports the data warehouse solution (Wherescape RED), SQL Server, and related tools.
Defines operational monitoring and alerting to ensure end-to-end delivery of trusted, quality data from source systems to consumption.
Establishes best-practice standards and processes for data automation, orchestration, and transformation.
Identifies, designs, implements, and manages a master data management solution for client and employee subjects, collaborating with stakeholders to define data quality standards and operational data quality processes.

Requirements

Bachelor’s degree required; Master’s degree highly preferred.
5–7+ years of experience in a BI, analytics, or data engineering role.
Strong proficiency in SQL Server and T-SQL, including stored procedures, window functions, and query optimization.
Hands-on experience building and maintaining Power BI reports and semantic models (DAX, Power Query).
Hands-on experience with Wherescape OLAP solution; experience with Azure Analysis Services, Azure Data Lake, and Azure Synapse Analytics.
Experience integrating or working with EHR data (reports, APIs, or data exports).
Familiarity with star schema and dimensional modeling concepts (Kimball methodology a plus).
Python experience for data wrangling, automation, or pipeline scripting.
Experience with Microsoft Master Data Services (MDS), including defining entities and business rules.
Experience with Microsoft Data Quality Services (DQS) and SQL Server Integration Services (SSIS).
Comfortable working across the full analytics stack from raw data to end-user reports.
Strong communication skills and ability to explain data concepts clearly to non-technical stakeholders.
Advanced skills with Microsoft Office Suite (Power BI) and SQL, plus experience with EMR systems (hospice, home care, and/or mental health) is desirable.

Technologies

SQL Server
T-SQL
Power BI
DAX
Power Query
Wherescape RED
Azure Analysis Service
Azure Data Lake
Azure Synapse Analytics
Microsoft Master Data Services (MDS)
Microsoft Data Quality Services (DQS)
SQL Server Integration Services (SSIS)

Benefits

Competitive salary
Benefits package
Healthy work-life balance
Collaborative team environment
Opportunities for personal growth and professional development

View full job page →

Azure Data Lake Developer Jobs

Senior Data Engineer

Staff Engineer II - Senior Data Engineer

Data Engineer

BI & Analytics Analyst/Data Engineer

Get Azure Data Lake Developer Jobs alerts