Job description

About Exponentia.ai

Exponentia.ai is a fast-growing AI-first technology services company, partnering with enterprises to shape and accelerate their journey to AI maturity. With a presence across the US, UK, UAE, India, and Singapore, we bring together deep domain knowledge, cloud-scale engineering, and cutting-edge artificial intelligence to help our clients transform into agile, insight-driven organizations.

We are proud partners with global technology leaders such as Databricks, Microsoft, AWS, and Qlik, and have been consistently recognized for innovation, delivery excellence, and trusted advisories.

Awards & Recognitions:

Innovation Partner of the Year – Databricks, 2024
Digital Impact Award, UK – 2024 (TMT Sector)
Rising Star – APJ Databricks Partner Awards 2023
Qlik’s Most Enabled Partner – APAC

With a team of 450+ AI engineers, data scientists, and consultants, we are on a mission to redefine how work is done, by combining human intelligence with AI agents to deliver exponential outcomes.

Learn more: www.exponentia.ai

About the Role:

We are seeking an experienced Senior Data Engineer with strong hands-on expertise in building and delivering Databricks-based data solutions. The ideal candidate will design and develop high-quality data pipelines, optimize Spark workloads, participate in architectural decision-making, and guide the team in delivering scalable, reliable, and cost-efficient data platforms.

Key Responsibilities

Databricks & Data Engineering

Design, develop, and optimize data pipelines using Databricks (SQL, Python, PySpark).
Work with Delta Lake, Lakehouse architecture, and Unity Catalog for governance and lineage.
Implement and manage Databricks workflows, cluster configurations, and job scheduling.
Troubleshoot and optimize Spark jobs for performance, reliability, and cost efficiency.
Integrate Databricks with cloud platforms (AWS/Azure/GCP), data lakes, and external systems.

Technical Ownership & Development

Own the end-to-end design and delivery of complex engineering and data solutions.
Build scalable ETL/ELT pipelines and collaborate with architects on solution design.
Review code, enforce best practices, and maintain high engineering standards.
Create reusable components, frameworks, and automation scripts.

Collaboration & Leadership

Mentor junior/mid-level engineers on Databricks, PySpark, and data engineering best practices.
Collaborate closely with product owners, architects, and cross-functional teams.
Participate in sprint planning, design reviews, and architectural discussions.

Quality, Testing & DevOps

Implement CI/CD pipelines for Databricks (Databricks Repos, GitHub/Azure DevOps/GitLab).
Ensure high-quality deliverables through unit testing, data validation, and automated checks.
Support production deployments, monitoring, and incident resolution.

Skills Required

Databricks Engineer, Apache spark, Pyspark, Python, Etl / Elt, Data Warehousing, Dela Lake, cloud, SQL, Delta Lake, Data Engineering, Power BI

Role

Ideal Candidate Profile

Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.
6+ years of engineering or data engineering experience.
Strong hands-on experience with Databricks, including PySpark, SQL, and Delta Lake.
Experience designing and optimizing ETL/ELT pipelines in a cloud environment.
Proficiency in Spark performance tuning, job optimization, and cluster management.
Experience with cloud platforms (Azure/AWS/GCP) and cloud-native data services.
Strong programming skills in Python, SQL, and knowledge of distributed computing concepts.
Experience with Git, CI/CD, data quality frameworks, and DevOps practices.
Excellent problem-solving, debugging, and communication skills.

Preferred Qualifications

Experience with Unity Catalog, Delta Live Tables, Feature Store, or MLflow.
Experience with orchestration tools (Airflow, ADF, Databricks Workflows).
Knowledge of streaming technologies (Kafka, Kinesis, EventHub).
Experience with containerization (Docker/Kubernetes) is a plus.
Cloud certifications or Databricks certification (Associate/Professional Data Engineer).

Why Join Exponentia.ai?

Innovate with Purpose: Opportunity to create pioneering AI solutions in partnership with leading cloud and data platforms
Shape the Practice: Build a marquee capability from the ground up with full ownership
Work with the Best: Collaborate with top-tier talent and learn from industry leaders in AI
Global Exposure: Be part of a high-growth firm operating across US, UK, UAE, India, and Singapore
Continuous Growth: Access to certifications, tech events, and partner-led innovation labs
Inclusive Culture: A supportive and diverse workplace that values learning, initiative, and ownership

Ready to build the future of AI with us?

Apply now and become a part of a next-gen tech company that’s setting benchmarks in enterprise AI solutions.

Education/Qualification

Btech, BE, MCA, BCA

Job Code

10921

Designation

Sr Data Engineer

Someone shared one job with you. ASAI keeps finding the rest.

Scored, not searched. Every role ranked against your actual profile.

Alerts as often as hourly. Reach new roles while the pile is still small.

Skill gaps, spelled out. See exactly which requirements you don't meet yet.

Verified jobs, only. Say no to ghost jobs. Your time deserves respect.