Staff Big Data Engineer
Pune · Director
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
What we know about this role
LOW
Our tracked job listings for qualys show limited recent activity.
First 72 hours
Window passed - posted 67d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
7 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Staff Big Data Engineer
Job Description
We are seeking a Staff Big Data Engineer to define, design, and drive the evolution of the data platform and pipeline architecture powering Qualys' Enterprise TruRisk Platform. This role will be responsible for building and scaling distributed data systems that process billions of events and transactions daily while providing technical leadership across multiple engineering teams.
Responsibilities
● Define and drive the technical vision, architecture, and long-term strategy for the data platform and data pipeline ecosystem.
● Design, build, and maintain highly scalable, high-availability data processing systems using Apache Spark, Apache Kafka, and distributed data technologies.
● Lead architecture and design decisions across multiple engineering teams, ensuring solutions meet requirements for scalability, reliability, performance, security, and cost efficiency.
● Design and implement event-driven, streaming, and large-scale data processing architectures to support real-time and batch workloads.
● Troubleshoot, optimize, and resolve complex performance bottlenecks across data pipelines, distributed systems, and platform infrastructure.
● Partner with Product Management, Professional Services, and Sales Engineering teams to evaluate technical solutions, architecture trade-offs, and platform capabilities.
● Establish engineering standards, architectural guidelines, documentation practices, and operational best practices for the data platform.
● Research, evaluate, and recommend emerging technologies that improve platform scalability, performance, and operational efficiency.
● Mentor and guide engineers on distributed systems design, performance optimization, and big data technologies.
● Support architecture reviews, technical governance initiatives, and engineering excellence programs.
Required Qualifications
● Minimum 12 years of experience in software engineering, data engineering, distributed systems engineering, or big data platform development.
● Minimum 6 years of hands-on experience designing, developing, and optimizing Apache Spark-based data processing solutions.
● Minimum 6 years of experience building and operating large-scale data pipelines processing billions of events or transactions per day.
● Minimum 4 years of experience administering and operating Apache Kafka in production environments.
● Minimum 4 years of experience designing and implementing event-driven or streaming data architectures.
● Strong expertise in distributed data processing systems, data lake architectures, and large-scale platform design.
● Experience delivering highly available, scalable, and fault-tolerant distributed systems in production environments.
● Demonstrated experience leading architecture initiatives and influencing technical direction across multiple engineering teams.
● Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or a related technical discipline.
Preferred Qualifications
- Experience working with high-volume, multi-tenant enterprise platform environments.
- Proficiency in Scala, Java, or Python for data processing applications.
- Proven experience mentoring junior or mid-level engineering team members.
Tools to land this role
PremiumYour match score, skill map and tracker stay free.
Ground Reality
PremiumSpot the dealbreakers in this 424-word post before you apply
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
Insider Path
PremiumFind someone who can refer you here
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Data Engineer roles in Pune
See all
Keep browsing