We are seeking an experienced and strategic Lead Data Engineer to join our ITSM Applied AI and Analytics team. This individual will lead the development and evolution of our enterprise-facing data store built on Azure Databricks, driving architectural decisions, mentoring team members, and ensuring scalable, high-quality data solutions across the organization.
Key Responsibilities:
Lead the design, development, and optimization of ETL/ELT pipelines using Databricks, Apache Spark, Unity Catalog, and Delta Lake.
Architect data workflows following Medallion Architecture (Bronze, Silver, Gold layers).
Guide the integration of external APIs and systems, including ServiceNow and Kafka for real-time data streaming.
Establish and enforce best practices in CI/CD, GitHub workflows, and code quality.
Manage compute appropriately to ensure cost control.
Collaborate with stakeholders to define data strategy, governance, and platform enhancements.
Provide technical leadership and mentorship to data engineers and analysts.
Conduct code reviews and ensure adherence to engineering standards.
Communicate effectively with technical and non-technical stakeholders.
You will report to an Associate Director, Data Engineering.
Use your skills to make an impact
Required Qualifications:
5+ years of experience in data engineering, with at least 2 years in a lead or senior role.
Deep expertise in Databricks, Apache Spark, Unity Catalog, and Delta Lake.
Strong understanding of Medallion Architecture and scalable data design.
Strong proficiency in Python for data engineering tasks (APIs, Spark data frames, OAuth, etc.).
Familiarity with Databricks Materialized views.
Experience with Kafka for real-time data ingestion and processing.
Proficiency in GitHub, CI/CD pipelines, and DevOps practices.
Experience building and integrating REST APIs.
Excellent communication, leadership, and documentation skills.
Preferred Qualifications:
Databricks certifications (e.g., Data Engineer Professional).
Familiarity with ServiceNow data structures and integration.
Experience with enterprise analytics platforms like Power BI or Power Apps.
Background in enterprise environments with data governance and compliance requirements.
Background in enterprise data architecture and governance.
Additional Information
Candidates will be asked to present a GitHub-hosted project as part of the interview process.
Work at Home Guidance
To ensure Home or Hybrid Home/Office associates’ ability to work effectively, the self-provided internet service of Home or Hybrid Home/Office associates must meet the following criteria:
At minimum, a download speed of 25 Mbps and an upload speed of 10 Mbps is recommended; wireless, wired cable or DSL connection is suggested
Satellite, cellular and microwave connection can be used only if approved by leadership
Associates who live and work from Home in the state of California, Illinois, Montana, or South Dakota will be provided a bi-weekly payment for their internet expense.
Humana will provide Home or Hybrid Home/Office associates with telephone equipment appropriate to meet the business requirements for their position/job.
Work from a dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information
Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required.
Scheduled Weekly Hours
40
Pay Range
The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc.$142,300 - $195,700 per year
This job is eligible for a bonus incentive plan. This incentive opportunity is based upon company and/or individual performance.
Description of Benefits
Humana, Inc. and its affiliated subsidiaries (collectively, “Humana”) offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities.Application Deadline: 04-24-2026
