Python Big Data Developer

We are seeking an experienced technology professional with strong expertise in Python scripting, automation engineering, ETL platforms, and large-scale data processing environments. The candidate will be responsible for leading automation initiatives, building scalable validation frameworks, supporting enterprise data platforms, and driving quality engineering practices across Banking and Financial Services applications.

The ideal candidate should possess strong hands-on experience in Python, Unix/Linux, SQL, Oracle, ETL technologies, and automation framework development. Experience working on Ab Initio, Big Data platforms, and high-volume transaction processing systems is strongly preferred.

The role requires close engagement with Business Users, Developers, SMEs, Product Owners, and Scrum Teams to ensure successful delivery of enterprise solutions.

Key Responsibilities

• Design, develop, and maintain enterprise-scale automation frameworks using Python.
• Develop robust Python scripts and reusable utilities for testing, validation, reconciliation, and operational automation.
• Lead testing and validation activities for ETL and data-intensive applications.
• Perform data analysis, reconciliation, and data quality validation across large-volume datasets.
• Support Ab Initio and Big Data processing ecosystems.
• Develop and optimize SQL queries for data validation and troubleshooting activities.
• Participate in requirement review sessions with Business Users, SMEs, and Development teams.
• Define and execute test strategies covering functional, integration, regression, and data validation testing.
• Drive defect management, root cause analysis, and production support activities.
• Collaborate with Scrum teams through all phases of Agile delivery.
• Utilize JIRA and Confluence for requirement tracking, documentation, reporting, and delivery management.
• Mentor junior team members and promote automation-first quality practices.
• Evaluate and adopt emerging technologies to improve efficiency and delivery quality.

Mandatory Skills

Python & Automation

• 4-8 Strong hands-on expertise in Python scripting and automation development.
• Experience designing and maintaining automation frameworks.
• Experience developing reusable automation utilities and validation tools.
• Strong debugging, troubleshooting, and analytical skills.

ETL & Data Engineering

• Strong ETL testing and validation experience.
• ETL Certification preferred and highly valued.
• Experience supporting enterprise data integration platforms.
• Exposure to large-volume data processing environments.

Database & Data Validation

• Strong SQL skills.
• Hands-on Oracle database experience.
• Experience in data reconciliation, data quality, and data validation activities.

Unix/Linux

• Strong Unix/Linux knowledge.
• Hands-on Shell Scripting experience.
• Experience working in batch-processing and distributed environments.

Agile & Stakeholder Management

• Strong understanding of Agile and Scrum methodologies.
• Ability to work directly with Business Users, SMEs, Developers, and Product Owners.
• Hands-on use of JIRA and Confluence.
• Strong communication and requirement-analysis skills.

Preferred / Good to Have Skills

Platforms

• Exposure to Enterprise Application Platforms (EAP)  & Ab Initio. .

Modern Data Technologies

• PySpark development and testing experience.
• Databricks exposure.
• Apache Iceberg knowledge and testing experience.
• Hadoop and Hive exposure.

Automation & DevOps

• UI Automation experience (Selenium or similar tools).

Domain Experience

• Banking and Financial Services experience strongly preferred.
• Experience supporting large-scale, high-volume transaction processing systems.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.