Databricks Developer
Job Description
CGI Group, Inc. is hiring a Databricks Developer to design, build, and maintain scalable data applications on the Databricks platform, with specialized focus on Databricks Apps development. The preferred location is Houston, TX, with a remote option for the ideal candidate.
Location and Salary
- Location: Houston, TX (remote)
- Compensation: USD 88,200 - 173,500 per yearly
CGI is required in some jurisdictions to include a reasonable estimate of the compensation range for this role. A reasonable estimate of the current range for this role in the U.S. is $88,200.00 to $173,500.00.
Core Responsibilities
- Develop Databricks Apps: Design and build custom web-based applications using the Databricks Apps framework, enabling business stakeholders to interact with data and analytics dashboards in real time.
- Data engineering: Build and optimize data pipelines using Apache Spark, Databricks SQL, and Delta Lake for large-scale dataset processing, transformation, and management.
- Architecture and design: Partner with data architects and business analysts to deliver robust, scalable solutions aligned with performance and reliability needs.
- Code quality and testing: Produce clean, well-documented code, implement unit and integration tests, and maintain code repositories using Git best practices.
- Performance optimization: Diagnose and resolve bottlenecks in data workflows and applications by optimizing queries and cluster configuration.
- Collaboration: Work with cross-functional teams, including data scientists, analytics engineers, and business stakeholders, to convert requirements into technical solutions.
- Documentation and knowledge sharing: Create technical documentation, contribute to internal knowledge bases, mentor junior developers, and share best practices.
- Deployment and maintenance: Manage deployment pipelines, monitor application health, and troubleshoot production issues in a timely manner.
Required Qualifications
- Experience: 5+ years of professional experience in data engineering or software development with the Databricks platform.
- Databricks Apps: Demonstrated experience developing and deploying Databricks Apps (or similar custom applications on Databricks).
- Python: Strong proficiency in Python for Databricks development.
- Cloud: Experience with cloud platforms (AWS) in a data engineering context.
- Delivery practices: Familiarity with CI/CD pipelines and DevOps practices.
- ML workflows: Knowledge of machine learning workflows and MLflow integration.
- Visualization: Experience with data visualization tools (Tableau, Power BI, or Databricks SQL dashboards).
- Methods: Familiarity with agile development methodologies.
- Training: Databricks certification or completion of advanced Databricks training.
Technologies
- Databricks
- Databricks Apps framework
- Apache Spark
- Databricks SQL
- Delta Lake
- Git
- Python
- AWS
- CI/CD pipelines
- DevOps
- MLflow
- Tableau
- Power BI
- Databricks SQL dashboards
Benefits
- Competitive compensation including a profit participation program
- Comprehensive medical, dental, and vision benefits
- Basic life and accidental death and dismemberment insurance
- Matching contributions through a 401(k) plan and a CGI share purchase plan
- Flexibility and paid accrued vacation leave ranging from 10 to 20 days per year
- 10 paid holidays per year
- At least 80 consecutive hours of paid sick/safe leave (except where applicable state/local law requires more)
- Paid parental leave ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws
- Bereavement leave ranging from 1 to 7 days per year based on relationship
- Paid jury duty leave up to time summoned
- Learning opportunities and tuition assistance
- Wellness and well-being programs
Additional Information
- CGI benefits are offered to eligible professionals on their first day of employment.
- Benefits listed above may change based on the specific terms and conditions of the contract being supported.