ASAI job platform logo
  1. Home
  2. /Jobs
  3. /Data Engineer Jobs in Hyderabad
  4. /DataBricks - Lead Programmer Analyst
BI
bilvantis

DataBricks - Lead Programmer Analyst

Hyderabad · Senior

Older listing - lower visibility likelyVerified listingPosted 65d ago

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreFree · sign in
86Overall
64Skills
97Experience

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

Always free · no credit card · 1 tap with Google

What we know about this role

Hiring pulse

LOW

Our tracked job listings for bilvantis show limited recent activity.

Apply window

First 72 hours

Window passed - posted 65d ago

Early applicants get seen before the pile builds.

Not a repost

The first time we've seen this listing - it hasn't been closed and reopened.

Skills required

20 listed
CI/CDApache SparkMachine LearningJob Scheduling (Batch Processing)Access ControlsDatabricksPysparkScala (Programming Language)+12 more
CI/CDApache SparkMachine LearningJob Scheduling (Batch Processing)Access Controls

You almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.

Job description

Job Description: DataBricks - Lead Programmer Analyst

We are looking for a highly self-motivated individual with DataBricks development as a Lead Programmer Analyst:

Required Skills & Qualifications:

    • Experience should have 5 to 7 Years of Data Engineering.
    • Expert-level Apache Spark skills using PySpark (Scala a plus).
    • Strong proficiency in SQL for data transformation and performance tuning.
    • Solid experience with Delta Lake and the Lakehouse/medallion architecture.
    • Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its data services.
    • Experience with workflow orchestration (Databricks Workflows, Delta Live Tables, or Airflow).
    • Strong understanding of data modeling, data warehousing, and ETL/ELT design patterns.
    • Experience with Python for data engineering and automation.
    • Familiarity with CI/CD, Git, and DevOps practices for data.
    • Good understanding of data governance, security, and Unity Catalog.
    • Strong problem-solving and communication skills.
    • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Good To Have:

    • Databricks Certified Data Engineer Associate or Professional certification.
    • Experience with streaming technologies (Structured Streaming, Kafka, Event Hubs, Pub/Sub).
    • Exposure to machine learning workflows and MLflow.
    • Experience with Infrastructure-as-Code (Terraform) and cloud cost optimization.
    • Experience working in Agile delivery environments.
    • Experience in data warehouse design and maintenance
    • Experience in agile development processes using Jira and Confluence.
    • Experience in cross-functional teams.

Key Responsibilities:

    • Design, develop, and maintain scalable ETL/ELT data pipelines on the Databricks Lakehouse Platform.
    • Build and optimize Apache Spark (PySpark/Scala) jobs for batch and streaming data processing.
    • Implement and manage Delta Lake tables, including partitioning, schema evolution, and performance tuning (Z-ordering, caching, file compaction).
    • Develop and orchestrate workflows using Databricks Workflows, Delta Live Tables (DLT), and job scheduling tools such as Airflow.
    • Implement the medallion architecture (bronze, silver, gold layers) for reliable, governed data.
    • Integrate Databricks with cloud data services (AWS, Azure, or GCP) and source systems.
    • Apply data governance and security using Unity Catalog, access controls, and lineage.
    • Optimize cluster configuration, cost, and performance across workloads.
    • Collaborate with data analysts, data scientists, and business stakeholders to deliver trusted datasets.
    • Ensure data quality, testing, monitoring, and observability across pipelines.
    • Contribute to CI/CD practices for data engineering (version control, automated deployment).

Tools to land this role

Premium

Your match score, skill map and tracker stay free.

Ground Reality

Premium
Spot the dealbreakers in this 351-word post before you apply

Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.

Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.

Insider Path

Premium
Find someone who can refer you here

We help you find people there who worked or studied where you did, and draft your first message and follow-up.

Free · no signup

Get tomorrow's jobs before you have to search

Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

Join WhatsAppJoin Telegram

No spam. Just jobs and resources.

Why people use ASAI

Someone shared one job with you. ASAI keeps finding the rest.

  • Scored, not searched. Every role ranked against your actual profile.

  • Alerts as often as hourly. Reach new roles while the pile is still small.

  • Skill gaps, spelled out. See exactly which requirements you don't meet yet.

  • Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

More Data Engineer roles in Hyderabad

See all

Senior Data Engineer

ANanblicks · Hyderabad

Data Engineer

ANanblicks · Hyderabad

EH-1521- Data Engineer

SOSoftobiz · Hyderabad

Data Engineer

AMAmgen · Hyderabad

Keep browsing

All Data Engineer jobs in Hyderabad

Two ways in

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreFree · sign in
86Overall
64Skills
97Experience

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

Always free · no credit card · 1 tap with Google

Free · no signup

Get tomorrow's jobs before you have to search

Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

Join WhatsAppJoin Telegram

No spam. Just jobs and resources.

Why people use ASAI

Someone shared one job with you. ASAI keeps finding the rest.

  • Scored, not searched. Every role ranked against your actual profile.

  • Alerts as often as hourly. Reach new roles while the pile is still small.

  • Skill gaps, spelled out. See exactly which requirements you don't meet yet.

  • Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

ASAI job platform logo

A job platform finally, balanced in your favour.

Jobs by CityJobs by CompanyGuidesPricingHow We VerifyAboutPrivacy PolicyTerms of ServiceDaily jobs on WhatsApp

Built in India 🇮🇳

© 2026 ASAI. All rights reserved.