Data Engineer

Robotics Technologies is hiring a Data Engineer to help design and run scalable data pipelines and data processing solutions across multiple sources and cloud platforms. Based in San Jose, CA with an onsite setup, this role focuses on building reliable data foundations for business intelligence and analytics.

What you’ll do

• Design, develop, and maintain scalable pipelines to extract, transform, and load data from multiple sources
• Create ETL/ELT workflows using Python, SQL, PySpark, and Azure Data Factory
• Build and optimize data processing solutions with Apache Spark and Databricks
• Work with structured and unstructured data from relational databases, APIs, flat files, and cloud storage
• Develop data integration solutions that support BI and analytics requirements
• Write complex SQL including queries, stored procedures, views, and functions for large dataset transformations
• Implement data validation, cleansing, transformation, and quality checks to support data accuracy
• Use Azure Data Lake Storage and cloud platforms to store and manage large volumes of data
• Create and maintain data warehouses, data marts, and dimensional data models
• Integrate enterprise data using REST APIs and database connectors
• Monitor pipelines, troubleshoot failures, and address performance and processing issues
• Implement incremental loading, partitioning, and optimization techniques to improve pipeline performance
• Support data loading and warehouse management in Snowflake, including transformation and query optimization
• Apply data security, access controls, and governance practices
• Use Git and Azure DevOps to manage source control, CI/CD, and deployment
• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements
• Participate in Agile/Scrum ceremonies, technical discussions, code reviews, and production support

What you bring

• Bachelor’s degree in Computer Science, Information Technology, or a related field
• Experience in data engineering, ETL development, and data pipeline implementation
• Strong programming knowledge in Python, SQL, and PySpark
• Experience working with cloud platforms and data warehousing technologies
• Understanding of data modeling, database concepts, and data integration
• Strong skills in analytics, problem-solving, debugging, and communication

Tools and technologies you’ll work with

Python, SQL, PySpark, Apache Spark, Azure Data Factory, Databricks, Azure Data Lake, AWS, Snowflake, ETL/ELT, SQL Server, Power BI, Git, Hadoop, Informatica, SSIS, Amazon S3, Azure Synapse Analytics, PostgreSQL, MySQL, Oracle, Star Schema, Snowflake Schema, Dimensional Modeling, Azure DevOps, CI/CD, Jenkins, Agile, Scrum, SDLC, REST APIs, Azure Data Lake Storage