Data Engineer
Job Description
Join INFOSYS NOVA HOLDINGS LLC in Charlotte, NC as a Data Engineer with onsite work and a salary range of USD 90,000 - 135,000 per year. This role focuses on building and enhancing data engineering capabilities through hands-on development in Python and PySpark, translating business logic into reliable transformation pipelines and standalone scripts.
What you’ll do
- Design, develop, and implement new features within an existing framework using Python and PySpark.
- Create efficient PySpark scripts to execute data transformations based on defined business logic.
- Use Object-Oriented Programming concepts to tackle complex problems and build robust, reusable solutions.
- Collaborate with team members to understand requirements and align solutions with business objectives.
- Translate business requirements into technical implementations and data transformation processes.
- Test, debug, and troubleshoot code to ensure outputs are accurate and dependable.
- Identify and resolve complex software and data-related issues.
- Develop standalone scripts and applications to support data processing needs.
- Follow coding best practices and contribute to ongoing improvements for the existing framework.
- Document programming tasks, processes, and procedures to enable future troubleshooting and maintenance.
- Communicate clearly with team members about requirements, technical challenges, and solutions.
- Work independently with minimal supervision while still contributing effectively to the team.
What you bring
- Strong hands-on experience with Python.
- Strong hands-on experience with PySpark and data transformations.
- Solid understanding of Object-Oriented Programming concepts.
- Experience developing standalone scripts based on defined business logic.
- Strong problem-solving and troubleshooting skills.
- Ability to understand complex requirements and translate them into effective technical solutions.
- Experience working with data engineering frameworks and large-scale data processing.
- Excellent written and verbal communication skills.
- Ability to work independently with minimal supervision.
Technologies
- Python
- PySpark
- Object-Oriented Programming
- AWS
Preferred skills
- AWS / cloud technologies
- Large-scale data processing
- Data transformation and ETL
- Software development best practices
- Framework development and enhancement
- Automated testing and debugging
- Data engineering tools and technologies