DeveloperJobs.io
← Back to all jobs
DenkenSolutions Inc

Data Engineer Hadoop, HIVE & Python

DenkenSolutions Inc
Birmingham, AL $58 - $58/hr Full time Posted 1d ago
Python Analytics Big Data Bigdata Business Analytics Business Intelligence Data Analytics Data Architecture Data Engineer Data Integration Data Lake Data Pipeline Data Platform Data Processing Database Databases Databricks ETL Hadoop Hive Informatica Reporting and Analytics Spark SQL
Apply Now

Job Description

DenkenSolutions Inc is seeking a Data Engineer to design, develop, and support data engineering and analytics solutions using both on-premises tools and cloud services. This onsite role in Birmingham, AL offers a competitive rate of USD 58 per hour and the opportunity to work with a robust data tech stack centered on Hadoop, Hive, and Python within a collaborative, solutions-focused environment.

Responsibilities

  • Design, develop, and maintain data engineering and analytics solutions using Hadoop, Hive, and Python.
  • Build end-to-end data pipelines and analytics capabilities across on-premises tools and cloud services.
  • Create functional and technical designs for data engineering and analytics projects.
  • Model data across diverse schemas and integrate data from multiple sources.
  • Implement data quality tooling to ensure data reliability.
  • Develop and support big data solutions with Hadoop, Hive, and Spark.
  • Develop and support AI and ML models using R and Python.
  • Collaborate with on-premises tools such as MSBI (SSIS/SSAS), Informatica, Oracle GoldenGate, SQL, Oracle, and SQL Server.
  • Leverage Microsoft cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse, Azure Key Vault, and Power BI.
  • Apply containerization techniques with Docker and OpenShift.
  • Follow Agile practices and DevOps CI/CD processes.
  • Design and develop data sourcing, enrichment, and delivery solutions using APIs and web services.

Requirements

  • Experience with batch and real-time (streaming) data processing frameworks.
  • Experience with data modelling, data access patterns, schemas, and data storage techniques.
  • Experience with data quality tooling.
  • Ability to create functional and technical designs for data engineering and analytics solutions.
  • Experience implementing data models across diverse schemas and integrating multiple data source types.
  • Hands-on development with big data technologies such as Hadoop, Hive, and Spark.
  • Hands-on with statistical models and AI/ML solutions using R and/or Python.
  • 5+ years of hands-on experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions using on-premises tools such as MSBI (SSIS/SSAS), Informatica, Oracle GoldenGate, SQL, Oracle, and SQL Server.
  • 3+ years of hands-on experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions using Microsoft cloud-based tools such as Azure Data Lake, Azure Data Factory, Azure Databricks, Python, Azure Synapse, Azure Key Vault, and Power BI.
  • Experience with containerization methodologies Docker, OpenShift, etc.
  • Experience with Agile as well as DevOps, CI/CD methodologies.
  • Hands-on experience designing and developing solutions involving data sourcing, enrichment and delivery using APIs & Web Services.

Technologies

  • Hadoop
  • Hive
  • Spark
  • R
  • Python
  • MSBI (SSIS/SSAS)
  • Informatica
  • Oracle GoldenGate
  • SQL
  • Oracle
  • SQL Server
  • Azure Data Lake
  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse
  • Azure Key Vault
  • Power BI
  • Docker
  • OpenShift
  • APIs and Web Services

Similar Jobs