Advanced Cyber Sec Archt/Engr

Senior Data Engineer Job Description

The Role

The Senior Data Engineer is the one who designs and builds data foundations and end to end solutions for the Shell Business to maximize value from data. The role helps create a data-driven thinking within the organization, not just within IT teams, but also in the wider Business stakeholder community. A Senior Data engineer is expected to be a subject matter expert, who design & build data solutions and mentor junior engineers. They are also the key drivers to convert Vison and Data Strategy for IT solutions and deliver.

Key Characteristics

• Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions. 
• Deep data focus with expertise in technology domain
• A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff.
• Actively delivers the roll-out and embedding of Data Foundation initiatives in support of the key business programmers. 
• Coordinate the change management process, incident management and problem management process. Ensure traceability of requirements from Data needs and requirements, through testing and scope changes, to training and transition.
• Present reports and findings to key stakeholders and be the subject matter expert on Data Analysis & Design.
• Drive implementation efficiency and effectiveness across the pilots and future projects to minimize cost, increase speed of implementation and maximize value delivery.
• Contributes to community building initiatives like CoE, CoP.

Professional Qualifications & Skills

Educational Qualification

• University degree in any IT discipline
• Minimum 7 years of experience in the IT industry

Required Skills

• Technology champion in working with relational, Data warehouses databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Highly Experienced in building and optimizing complex queries. Good with data manipulation, processing and extracting value from large, disconnected datasets. 
• Champion with object-oriented/object function scripting languages: Python, SQL, Scala, Spark-SQL etc. Experienced with big data sets and big data technologies.
• Proven subject matter expertise working with cloud technologies like Azure/AWS
• Deep expertise with technologies such as Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift etc.
• Experience in working with NoSQL databases.
• Excellent communication and interpersonal skills
• A skilled communicator capable of speaking to both technical developers, architects, and stake holders.
• Very Good understanding in data foundation initiatives, like data modelling, data quality, data governance, data maturity assessments and data strategy in support of the key business stake holders.
• Self-motivated, innovative, and very good in taking up new initiatives and driving them to closure.
• Proven experience in working source control technologies (such as GITHUB, Azure DevOps), build and release pipelines.
• Experienced in working with AGILE, KANBAN methodologies and exposure to run team scrum meetings 

Nice to have Skills Cloud (Azure – AWS)

• Experience in working with scripting languages such as YAML, PowerShell, Terraform etc.
• Experience with big data tools: Hadoop, Spark, Kafka, etc
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Exposure to architecting/designing end to end solutions.
• Experience running a scrum team.
• Managing small teams.

Nice to have Skills SAP

• Experience working with S/4 HANA, BW4 HANA systems
• Experience working with BPC, Planning.
• Exposure to architecting/designing end to end solutions.
• Experience running a scrum team.
• Experience working with Lumira.
• Managing small teams.