Senior Azure Databricks Developer
Pune · Senior
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
What we know about this role
LOW
Our tracked job listings for NewVision Software show limited recent activity.
First 72 hours
Window passed - posted 42d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
16 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
Role: Senior Azure Databricks Developer
Role Summary:
Senior Databricks Engineer with strong expertise in developing, optimizing, and maintaining data engineering solutions on the Databricks platform. The candidate should have deep experience with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and Spark performance optimization. This role is focused on Spark-native data engineering rather than ETL tool development.
Must Have Skills:
- Strong hands-on experience with Databricks notebooks, Jobs, Workflows, Repos, and Unity Catalog
- Strong expertise in PySpark and Spark SQL
- Experience building scalable Spark-based data pipelines
- Strong understanding of Spark DataFrames, joins, aggregations, window functions, and distributed processing
- Experience with Delta Lake (MERGE, OPTIMIZE, ZORDER, VACUUM, Change Data Feed)
- Hands-on experience in Spark job performance tuning
- Experience optimizing partitions, shuffles, caching, memory usage, and cluster utilization
- Experience developing batch and incremental data processing pipelines
- Strong programming skills in Python, PySpark, and SQL
- Experience working on Azure Databricks, AWS Databricks, or GCP Databricks
- Experience with Git, CI/CD, code reviews, testing, and production deployments
- Implement event-driven data flows and real-time data ingestion using Apache Kafka.
- Develop and integrate REST APIs for both data extraction and downstream data serving.
- Monitor, tune, and optimize PySpark workloads for maximum performance and cost efficiency.
- Communicate effectively with cross-functional stakeholders to gather requirements and translate them into scalable technical solutions.
- Mentor junior developers, guide architectural decisions, and prepare to take on team lead responsibilities in the future. as nice to have.
Good to Have Skills:
- Experience with Lakehouse and Medallion architecture
- Knowledge of Data Modeling and Data Governance
Nice to Have Skills:
- Experience with Delta Live Tables (DLT)
- Experience mentoring teams or leading technical discussions
- Experience with Photon and Databricks Asset Bundles
- Experience with Cluster Policies and Workspace Administration
- Design, build, and maintain robust batch and streaming data pipelines using Databricks and PySpark.
- Extract complex data from a variety of upstream sources (databases, internal/external APIs, flat files) and process it into the data lake.
- Architect and optimize Delta Tables, utilizing the Medallion architecture (Bronze, Silver, Gold layers) for structured data governance.
Soft skills:
- Must have strong written and verbal communication skills, excellent articulation skills, and experience working with client teams.
- The candidate should have actively participated in and contributed to sprint planning and solution design.
Tools to land this role
PremiumYour match score, skill map and tracker stay free.
Ground Reality
PremiumSpot the dealbreakers in this 366-word post before you apply
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
Insider Path
PremiumFind someone who can refer you here
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Data Engineer roles in Pune
See all
Keep browsing