Databricks Integration Lead
Databricks Integration Lead
L7
- Own end-to-end integration architecture across Databricks, 5 Veeva CRM orgs, Vault CRM, and connected systems
- Catalog and analyze all 46 integration points; consolidate, retire, or standardize rather than lift-and-shift
- Define standards: medallion architecture, Delta Lake, Unity Catalog governance, workflow orchestration, CI/CD
- Design coexistence patterns while Veeva CRM and Vault CRM run in parallel
- Define Veeva-to-Vault data mapping (accounts, HCP/HCO, calls, samples, consents, territories)
- Review designs, notebooks, and pipelines; act as technical escalation point for the team
- Establish validation/reconciliation frameworks and support GxP, privacy, and audit requirements
- Own technical cutover plan, rollback strategy, and monitoring/operational support modelRequired Qualifications
- 10+ years in data integration/architecture; 5+ years deep, hands-on Databricks in enterprise production
- Expert in PySpark/Spark SQL, Delta Lake, Workflows/Jobs, Delta Live Tables, Auto Loader, Unity Catalog, performance and cost tuning
- Delivered large multi-source integration programs (dozens of interfaces)
- Hands-on Veeva CRM data model and integration experience; Vault CRM knowledge strongly preferred
- Life sciences / pharma commercial experience (HCP/HCO data, call activity, samples, consent, MDM)
- Strong REST/SOAP API, bulk load, and file/event-based integration skills
- Proven technical leadership of engineering teams, including distributed/offshore teams
- Familiarity with GxP validation and regulated-environment deliveryPreferred Qualifications
- Databricks certifications (Data Engineer Professional, Solution Architect, or equivalent)
- Prior Veeva CRM to Vault CRM or other CRM-to-CRM migration experience
- Experience with Veeva Network, OpenData, or multi-org integration rationalization
- DevOps for Databricks (Terraform, Azure DevOps, GitHub Actions); AWS, Azure, or GCP
Level
ManagerL7
Location
Chattanooga, TN
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today
To get sharper similar jobs, create your profile using the link below.