Sr Data Engineer-AWS

Job Title: Senior Data Engineer Location: Remote Experience: 5–8 Years Employment Type: Full-Time About the Role Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You’ll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and scalable analytics. This role reports to the Head – Data Platform and AI Lead, offering a unique opportunity to be part of a cross-functional team shaping the future of data-driven innovation. Key Responsibilities Data Engineering & Pipeline Development Design and develop reliable, reusable ETL/ELT pipelines using AWS Glue, Python, and Spark. Process structured and semi-structured data (e.g., JSON, Parquet, CSV) efficiently for analytics and AI workloads. Build automation and orchestration workflows using Airflow or AWS Step Functions. Data Lake Architecture & Integration Implement AWS-native data lake/lakehouse architectures using S3, Redshift, Glue Catalog, and Lake Formation. Consolidate data from APIs, on-prem systems, and third-party sources into a centralized platform. Optimize data models and partitioning strategies for high-performance queries. Security, IAM & Governance Support Ensure secure data architecture practices across AWS components using encryption, access control, and policy enforcement. Implement and manage AWS IAM roles and policies to control data access across services and users. Collaborate with platform and security teams to maintain compliance and audit readiness (e.g., HIPAA, GxP). Apply best practices in data security, privacy, and identity management in cloud environments. DevOps & Observability Automate deployment of data infrastructure using CI/CD pipelines (GitHub Actions, Jenkins, or AWS CodePipeline). Create Docker-based containers and manage workloads using ECS or EKS. Monitor pipeline health, failures, and performance using CloudWatch and custom logs. Collaboration & Communication Partner with the Data Platform Lead and AI Lead to align engineering efforts with AI product goals. Engage with analysts, data scientists, and business teams to gather requirements and deliver data assets. Contribute to documentation, code reviews, and architectural discussions with clarity and confidence. Required Qualifications Bachelor’s degree in Computer Science, Engineering, or equivalent. 5–8 years of experience in data engineering, preferably in AWS cloud environments. Proficient in Python, SQL, and AWS services: Glue, Redshift, S3, IAM, Lake Formation. Experience managing IAM roles, security policies, and cloud-based data access controls. Hands-on experience with orchestration tools like Airflow or AWS Step Functions. Exposure to CI/CD practices and infrastructure automation. Strong interpersonal and communication skills—able to convey technical ideas clearly. Preferred Additional Skills Proficiency in Databricks, Unity Catalog, and Spark-based distributed data processing. Background in Pharma, Life Sciences, or other regulated environments (GxP, HIPAA). Experience with EMR, Snowflake, or hybrid-cloud data platforms. Experience with BI/reporting tools such as Power BI or QuickSight. Knowledge of integration tools (Boomi, Kafka) or real-time streaming frameworks. Ready to build data solutions that fuel AI innovation? Join Aptus Data Labs and play a key role in transforming raw data into enterprise intelligence.