Lead Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate
Bengaluru · Senior
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
What we know about this role
HIGH
Our tracked job listings for Deloitte show strong recent activity.
First 72 hours
Window passed - posted 15d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
16 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
We are seeking a Sr Data Engineer I to support the reliability, scalability, and performance of Disney’s Ad Technology big data platforms and pipelines. This role focuses on hands-on development and operations for Databricks, Spark, Flink, and Airflow (MWAA) environments, ensuring that production data workflows are resilient, cost-efficient, and performant at scale.
You will be responsible for building, optimizing, and supporting data pipelines, while contributing to automation, monitoring, and incident response. This role will work closely with platform, BI, and analytics teams to ensure data is delivered accurately and on time. As a Sr Data
Engineer I, you’ll also mentor junior engineers, contribute to runbooks, and help evolve best practices under the guidance of a Lead Engineer and Manager.
Responsibilities:
Pipeline Development & Operations:
Design, maintain, and optimize Spark and Flink pipelines running in Databricks and Airflow.
Ensure reliability and availability of data workflows in production.
Debug and resolve issues in notebooks, jobs, and orchestration workflows.
Performance Optimization:
Tune Spark jobs, clusters, and data pipelines for performance and cost efficiency.
Analyze logs, queries, and workloads to identify bottlenecks and implement improvements.
Monitoring & Observability:
Build and maintain dashboards, alerts, and metrics with Datadog, CloudWatch, or Prometheus.
Proactively monitor pipeline health and escalate issues as needed.
Incident Response & RCA:
Participate in incident response for pipeline issues, helping diagnose and resolve outages.
Contribute to RCA and preventative actions to improve long-term stability.
Collaboration & Knowledge Sharing:
Partner with data engineering, BI, and platform teams to support delivery and operations.
Document best practices, contribute to runbooks, and mentor junior engineers. Basic Qualifications:
- 4+ years of experience in data engineering or big data platform operations.
- Hands-on experience with Databricks, Spark, Flink, or Airflow (MWAA) in production.
- Strong SQL skills and experience with ETL/ELT pipeline development.
- Familiarity with AWS services (S3, Glue, Athena, EMR, EKS) for pipeline management.
- Working knowledge of observability tools (Datadog, CloudWatch, Prometheus).
- Proficiency in Python, Scala, or Java for pipeline development and automation.
- Familiarity with infrastructure-as-code (Terraform or similar).
- Strong collaboration and problem-solving skills, with experience in distributed teams. Preferred Qualifications:
- Experience with incident response and RCA in production data environments.
- Familiarity with CI/CD pipelines (GitLab, Jenkins, or GitHub Actions).
- Exposure to data governance, access control, and cost optimization practices.
- Certifications such as Databricks Data Engineer Associate or AWS Solutions Architect – Associate. Required Education:
- Bachelor’s degree in Computer Science, Engineering, or related technical field (or equivalent experience).
Tools to land this role
PremiumYour match score, skill map and tracker stay free.
Ground Reality
PremiumSpot the dealbreakers in this 399-word post before you apply
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
Insider Path
PremiumFind someone who can refer you here
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Data Engineer roles in Bengaluru
See all
Keep browsing