Senior Data Engineer
Pune · Senior
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
What we know about this role
LOW
Our tracked job listings for NewVision Software show limited recent activity.
First 72 hours
Window passed - posted 41d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
11 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
Senior Data Engineer with 5+ years of experience
Mandatory Skills:
-Extensive experience in developing ETL pipelines,
- Databricks
-scheduling using Azure Data Factory (ADF) and/or Apache Airflow,
- performance tuning using SQL.
- SQL, Python, Spark, PySpark, and Azure.
- Fabric experience preferred.
Key Responsibilities:
- ETL Pipeline Development:
- Design, develop, and maintain ETL pipelines to extract, transform, and load data from various sources into Azure data platforms.
- Optimize ETL processes for performance and scalability.
- Implement data quality and validation checks within ETL processes.
- Scheduling and Orchestration:
- Develop and manage data integration workflows using Azure Data Factory (ADF) and/or Apache Airflow.
- Schedule and monitor ETL jobs to ensure timely data processing and availability.
- Performance Tuning:
- Optimize SQL queries and data processing tasks for performance.
- Utilize notebooks for development and performance tuning of ETL processes.
- Data Integration and Management:
- Develop and maintain data models and schemas.
- Ensure data integrity, consistency, and security across data platforms.
- Collaborate with data engineers, solution architects, and other stakeholders to understand business requirements and translate them into technical solutions.
Qualifications:
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 5-6 years of experience as a Data Engineer in developing ETL pipelines and scheduling using ADF and/or Apache Airflow.
- Strong technical skills in SQL, Python, Spark, PySpark, and Azure.
- Proven experience in performance tuning and optimization of SQL and ETL processes.
- Strong understanding of Data Architecture and Data Modeling.
- Experience in healthcare and pharmaceutical industries is preferred.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Skills:
- Knowledge of big data technologies (Hadoop, Hive, Kafka).
- Familiarity with data visualization tools (Power BI, Tableau).
- Microsoft Fabric experience.
Tools to land this role
PremiumYour match score, skill map and tracker stay free.
Ground Reality
PremiumSpot the dealbreakers in this 273-word post before you apply
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
Insider Path
PremiumFind someone who can refer you here
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Data Engineer roles in Pune
See all
Keep browsing