Skip to main content

AWS Lead Data Engineer

L6

exavaluNewark, NJyesterday
Key Responsibilities: Lead the design and implementation of data ingestion, transformation and processing solutions using AWS native services including S3, Glue, EMR, Redshift and Athena. Define appropriate engineering patterns for batch and large-scale data processing using Python and PySpark. Guide implementation of modern lake/lakehouse patterns, including S3 and Apache Iceberg, where applicable. Provide technical direction across design, development, testing, deployment and production support. Conduct design and code reviews for Python/PySpark and AWS data-engineering components. Establish development standards, reusable patterns and engineering best practices. Ensure appropriate data validation and reconciliation are incorporated into pipelines. Troubleshoot performance and scalability issues across data pipelines and processing workloads. Provide day-to-day technical guidance to Data Engineers. Break functional/data requirements into engineering tasks and coordinate delivery. Communicate technical risks, dependencies and design decisions to stakeholders. Mentor engineers and build the team's AWS/Python/PySpark engineering capability.
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

LeadL6

Location

Newark, NJ

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

yesterday

To get sharper similar jobs, create your profile using the link below.

Create profile