Job description

Job Summary:

The Senior Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and observability of their critical data pipelines and deliverables. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. The candidate will be required to work on on-call shifts that will also include weekend shifts on rotation. We also support a healthy work-life-balance.

Responsibilities and Duties of the Role:

● Work and mentor all members of the Data Reliability Engineering team to manage production incidents, triage and root cause issues and ensure timely resolution via Tier 1 and Tier 2 support. Offer recommendations via RCAs to prevent future incidents to engineering partners.

● Assist in designing and developing a platform to support incident observability and automation. This team will be required to build high quality data models and products that monitor and reports on data pipeline health and data quality.

● Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure.

● Build out observability and intelligent monitoring of data pipelines and infrastructure to achieve early and automated anomaly detection and alerting. Present your research and insights to all levels of the company, clearly and concisely.

Required Education, Experience/Skills/Training:

● 5+ years experience working on mission critical data pipelines and ETL systems.

● 5+ years of hands-on experience with big data technology, systems and tools such as AWS, Hadoop, Hive, and Snowflake

● Detailed problem-solving approach, coupled with a strong sense of ownership and drive

● A passionate bias to action and passion for delivering high-quality data solutions

● Expertise with common Data Engineering languages such as Python, Scala, Java, SQL and a proven ability to learn new programming languages

● Experience with workflow orchestration tools such as Airflow

JOB DESCRIPTION:

●Deep understanding of end-to-end pipeline design and implementation.

●Attention to detail and quality with excellent problem solving and interpersonal skillsPreferred Qualifications

●Advanced degrees are a plus.

●Strong data visualizations skills to convey information and results clearly

●Ability to work independently and drive your own projects.

●Exceptional interpersonal and communication skills.

●Impactful presentation skills in front of a large and diverse audience.

●Experience with DevOps tools such as Docker, Kubernetes, Jenkins, etc.

●Innate curiosity about consumer behavior and technology

●Experience with event messaging frameworks like Apache Kafka

●A fan of movies and television is a strong plus.Experience with:Required Education

●Degree in Computer Science, Engineering, or related field.

Someone shared one job with you. ASAI keeps finding the rest.

Scored, not searched. Every role ranked against your actual profile.

Alerts as often as hourly. Reach new roles while the pile is still small.

Skill gaps, spelled out. See exactly which requirements you don't meet yet.

Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

Someone shared one job with you. ASAI keeps finding the rest.