Data Engineer - Machine Learning
Job Description
The Data Engineer - Machine Learning role at Prismatik focuses on building scalable data pipelines and database solutions that enable advanced analytics and AI. This position supports end-to-end data ingestion, modeling, quality and reliability improvements, and the delivery of reporting and analytics outputs.
Key Responsibilities
- Design, develop, implement, and optimize data pipelines and database solutions, including stored procedures, views, functions, and data transformation processes, using Python and other open-source tools.
- Design and implement scalable data ingestion, integration, and transformation solutions to consolidate data from multiple internal and external sources into data warehouse environments.
- Work with stakeholders to assess data requirements and convert business needs into data models, technical specifications, integration requirements, and sustainable solutions.
- Define and implement data models, business metrics, and calculations to ensure data consistency, accuracy, traceability, and usability for reporting and analytics solutions.
- Investigate and resolve complex data engineering and performance issues through root-cause analysis, then develop solutions that improve data quality, reliability, scalability, and system performance.
- Review current data engineering processes, tools, and solutions, and recommend improvements and best practices to strengthen automation, scalability, maintainability, data quality, and operational efficiency.
- Provide technical expertise for competitive intelligence and departmental initiatives by evaluating data requirements and capabilities, then recommending data solutions aligned to business objectives and strategy.
- Lead or contribute technical expertise to data engineering projects and cross-functional initiatives, coordinating technical requirements, identifying dependencies and risks, and supporting implementation of data solutions.
- Design and develop data solutions for reports, dashboards, analytics, and business applications, ensuring underlying data structures and processes meet business, performance, and quality requirements.
- Create and maintain data engineering documentation, standards, and technical procedures, including data models, pipeline architecture, database objects, data definitions, business rules, and operational processes.
- Serve as a technical resource to peers and stakeholders by providing guidance on data engineering practices, reviewing technical solutions, and sharing knowledge and best practices.
- Perform other related duties and projects as directed by management based on business needs.
Required Qualifications
- Bachelor’s degree in Data Analytics, Data Analysis, Computer Science, or a related field.
- Minimum 8 years of progressive experience in data engineering, data warehousing, or a related technical field.
- Experience with cloud-based data platforms and services, including Amazon Web Services (AWS).
- Experience with Python and other open-source programs.
Technologies
- Python
- Amazon Web Services (AWS)
Location
Irvine, CA (Onsite)
Compensation
USD 120,000 - 160,000 per year
Similar Jobs
C