Shared job
Senior Data Engineer
Navi Mumbai · Staff/Principal
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
No credit card · 1 tap with Google
What we know about this role
HIGH
AU Small Finance Bank is actively reviewing profiles and moving candidates through the pipeline right now.
First 72 hours
Still inside it - posted 21h agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
25 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
Job Summary
We are seeking a highly skilled Senior Data Engineer with 7-10 years of experience in designing, developing, and managing enterprise-scale data platforms and data warehousing solutions. The ideal candidate will have extensive experience in building scalable ETL/ELT pipelines, architecting cloud-based data solutions on AWS, and leading teams in delivering reliable, secure, and high-performance data ecosystems.
The role requires strong expertise in Data Warehousing, Big Data technologies, AWS Data Services, Data Modeling, Performance Optimization, and People Management within a fast-paced banking and financial services environment.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
- Architect end-to-end ETL/ELT solutions for data ingestion, transformation, and consumption across enterprise systems.
- Build and optimize cloud-native data platforms using AWS services such as S3, EMR, Redshift, Glue, Athena, and Airflow.
- Define and implement enterprise data strategies, including data sourcing, data flow, storage, governance, and consumption frameworks.
- Collaborate with Data Analytics, Business Intelligence, Product, and Technology teams to understand and fulfill data requirements.
- Design and implement scalable data models supporting reporting, analytics, and business intelligence initiatives.
- Monitor, troubleshoot, and support production data pipelines to ensure high availability and reliability.
- Lead performance tuning initiatives for complex SQL queries, ETL jobs, and large-scale data processing workloads.
- Ensure data quality, validation, governance, security, and compliance standards are adhered to.
- Drive cloud cost optimization initiatives while maintaining performance and user experience.
- Present technical architecture, solutions, and recommendations to business and technology stakeholders.
- Mentor junior engineers and coordinate tasks across project teams.
- Prepare and maintain technical documentation, architecture diagrams, and operational runbooks.
Required Technical Skills
Data Engineering & Data Warehousing
- Enterprise Data Warehousing Concepts
- Data Lake & Data Lakehouse Architecture
- ETL/ELT Design and Development
- Data Integration and Data Migration
- Data Quality & Validation Frameworks
Programming & Big Data
- Python
- Scala
- Apache Spark (PySpark/Spark SQL)
- SQL Query Optimization
- Distributed Data Processing
AWS Data Stack
- Amazon S3
- Amazon EMR
- Amazon Redshift
- AWS Glue
- Amazon Athena
- Apache Airflow
- IAM & AWS Security Best Practices
Data Modeling & Architecture
- Dimensional Data Modeling
- Star Schema & Snowflake Schema
- Data Architecture Design
- Metadata Management
- Data Governance Frameworks
Scheduling & Orchestration
- Apache Airflow
- Enterprise Job Scheduling Frameworks
- Workflow Automation
Monitoring & Production Support
- Data Pipeline Monitoring
- Incident Management
- Root Cause Analysis
- SLA Management
Security
- Data Security Principles
- Data Encryption & Access Controls
- Regulatory and Compliance Awareness
Experience Requirements
- Minimum 7+ years of overall Data Engineering experience.
- Strong experience in Enterprise Data Warehousing (7+ years).
- Hands-on expertise in building scalable ETL pipelines using Spark, Scala, and Python (7+ years).
- Strong SQL development and performance tuning experience.
- Experience in Data Modeling, Data Architecture, and Data System Design.
- Extensive experience working with AWS Data Services including EMR, Redshift, S3, Athena, Glue, and Airflow.
- Experience supporting production environments and handling critical incidents.
- Exposure to banking, financial services, fintech, or large enterprise environments preferred.
Leadership & Soft Skills
- Experience leading and mentoring data engineering teams.
- Strong stakeholder management and communication skills.
- Ability to present complex technical solutions to leadership and cross-functional teams.
- Strong analytical and problem-solving capabilities.
- Excellent documentation and technical writing skills.
- Ability to manage multiple priorities and deliver under tight timelines.
Preferred Qualifications
- BE/B.Tech/M.Tech from reputed Tier-1 Institutes.
- AWS Certifications (Solutions Architect, Data Engineer, Developer Associate, etc.).
- Certifications in Spark, Big Data, or Cloud Technologies will be an added advantage.
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
Keep browsing