Databricks Engineer
virtual vocationsNew York, NY
Databricks Engineer
L5
Building and optimizing production pipelines on the Databricks Lakehouse, the full-time Databricks Engineer will work remotely, collaborating with customers and Databricks' field teams while managing data ingestion, transformation, and deployment processes.
Key responsibilities:
Build and maintain batch and streaming ETL pipelines using PySpark, SQL, and Delta Lake on Databricks
Implement Medallion architecture layers and manage data resources on AWS, Azure, or GCP
Troubleshoot pipeline failures and data quality issues, including in productionRequired qualifications 8+ years in data engineering/architecture or analytics platform development
Demonstrated ownership of end-to-end architecture for at least two enterprise-scale data platforms
Deep experience migrating legacy data warehouses or ETL estates to a modern cloud platform
Strong proficiency in Python and SQL; working knowledge of Apache Spark
Experience with data modeling across dimensional, normalized, and Lakehouse patterns
Apply now (opens in a new tab)
Level
SeniorL5
Location
New York, NY
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today
To get sharper similar jobs, create your profile using the link below.