Data Engineer-Data Platforms-AWS

IBM
IBM

Data Science

Remote

Posted on Oct 24, 2026
Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

In this role, you'll work in one of our IBM Consulting FutureNow Centers, where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities

Job Summary

We are seeking an experienced AWS Data Engineer to design, build, and support scalable, secure, and high-performance data platforms on AWS. The role requires strong hands-on experience with AWS services, distributed data processing frameworks, and SQL-driven analytics.

The ideal candidate will work closely with architects, application teams, and business stakeholders to deliver reliable enterprise-grade data solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines and data platforms on AWS

• Build and operate serverless and containerized workloads using AWS Lambda, EC2, and EKS

• Develop batch and large-scale data processing solutions using Apache Spark

• Implement data ingestion, transformation, and analytics using AWS Glue and Athena

• Write complex and high-performance SQL queries for analytics, reporting, and data validation

• Manage and optimize data storage solutions using AWS S3 and RDS

• Design and manage AWS infrastructure using Infrastructure as Code (IaC) with CloudFormation

• Apply AWS security best practices across IAM, VPC networking, data encryption, and access controls

• Develop clean, scalable, and maintainable code using Python and/or Scala

• Monitor, troubleshoot, and optimize performance, cost, and reliability of data workloads

• Collaborate with cross-functional teams to support analytics, reporting, and regulatory use cases

Mandatory Skills & Qualifications

• Strong hands-on experience with AWS services, including o S3, Lambda, EC2, EKS o AWS Glue, Athena o RDS o VPC, IAM o CloudFormation

• Strong SQL skills, including o Writing complex queries, joins, aggregations, and user defined functions o Performance tuning and query optimization

• Good knowledge of AWS Security, including IAM policies, VPC security, encryption, and least-privilege access

• Hands-on programming experience with Python and/or Scala

• Strong experience with Apache Spark for large-scale data processing

• Good communication skills to explain technical concepts to non-technical stakeholders

• Solid understanding of data engineering concepts such as ETL/ELT, data modeling, and distributed systems

Good to Have / Preferred Skills

• Experience with DBT for data transformations

• Hands-on exposure to Snowflake

• Experience working with Databricks

• Familiarity with modern data lake / Lakehouse architectures

• Experience working in enterprise or regulated environments

Nice-to-Have Competencies

• Strong analytical and problem-solving skills

• Ability to work independently and in distributed teams

Required education
Bachelor's Degree
Preferred education
Master's Degree
Required technical and professional expertise

• Exposure to AWS Toolset: Experience working with AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis to design, build, and operate batch and real-time data pipelines.

• Data Pipeline Development: Exposure to developing batch and real-time data pipelines for Data Warehouse and Datalake, utilizing AWS Kinesis and Managed Streaming for Apache Kafka.

• Data Layer Creation: Experience working with AWS RedShift, Aurora, and DynamoDB to create data layers and migrate data using AWS DMS.

• Open Source Technologies: Exposure to utilizing open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform to support data engineering solutions.

• Data Service Management: Experience scheduling and managing data services on the AWS Platform, ensuring efficient operation of data engineering solutions.

Preferred technical and professional experience

• Proficiency with AWS Databrew: Experience working with AWS Glue Databrew to support data engineering solutions, including data preparation and data quality tasks.

• Knowledge of Lambda Functions: Exposure to using Lambda functions with Python to support data engineering solutions, including data processing and data transformation tasks.

• Familiarity with RedShift Spectrum: Experience working with RedShift Spectrum to support data engineering solutions, including data warehousing and data analytics tasks.

Years of Experience:
5 - 10

ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience. For additional information about location requirements, please discuss with the recruiter following submission of your application.

See more open positions at IBM