Data Engineer

ID98943

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

Why join us

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

About the role

We are looking for a Senior Data Platform Engineer to migrate and modernize data-platform infrastructure and workloads on AWS.

The mandatory requirements are production experience with Snowflake, AWS, and Kafka/Confluent, 3+ years in data-platform engineering, Python, Bash, and SQL, and strong English communication skills.

What you will do

• Help migrate infrastructure and data-platform workloads from client infrastructure to new infrastructure;

• Help move the data-platform infrastructure and workloads to AWS, including required connectivity, deployment, and operational prerequisites;

• Enable secure, governed accessibility of data to data-platform consumers and downstream systems;

• Modernize the data-platform architecture, tooling, orchestration, storage, and operational practices to align with standards;

• Support Snowflake, Confluent/Kafka, AWS, and data-platform infrastructure migration and operations across stage and production;

• Participate in production troubleshooting, incident response, documentation, runbook creation, and cross-team migration coordination;

• Use Terraform/IaC, GitLab, monitoring and documented processes to deliver repeatable and auditable changes;

Must haves

• 3+ years of experience in production data-platform engineering, with a platform/DevOps-leaning background and strong data experience;

• Strong Python, Bash, and SQL skills;

• Production experience with both Snowflake and Confluent/Kafka, with a focus on DevOps and operations. Deep experience in one and working knowledge of the other is fine: Deep Snowflake and AWS, with working Kafka knowledge (topics, connectors, schemas), OR Deep Kafka/Confluent and AWS, with working Snowflake knowledge;

• Experience operating or migrating production systems across development, stage, and production environments;

• Strong troubleshooting, incident-response, testing, documentation, and cross-team communication skills;

• Experience with least-privilege access, change control, secrets handling, and secure operational practices;

• Strong cross-functional communication skills;

• Upper-intermediate English level;

Nice to haves

• Apache Spark and Hadoop/Hive/HQL, including modernizing or migrating legacy workloads;

• Snowpark, dbt alternatives, AWS Glue, Monte Carlo, or other data-quality and catalog tools;

• Migrating legacy Airflow, Hadoop or Hive workloads to cloud-native or managed platforms;

• Experience working across a company migration or acquisition and aligning systems to a new organization's standards;

• Familiarity with Snowflake-to-Iceberg or Snowflake-to-data-lake migration patterns;

Perks and benefits

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps;

• Competitive compensation: We match your skills and contributions with USD-based compensation and budgets for education, fitness, and team activities;

• A selection of exciting projects: Work with Fortune 500 enterprises and leading product brands using modern solutions;

• Flextime: Flexible schedule with remote and office options for work-life balance;

Meet Our Recruitment Process

Asynchronous stage – An automated, self-paced track that helps us move faster and give you quicker feedback:

• Short online form to confirm basic requirements

• 30–60 minute skills assessment

• 5-minute introduction video

Synchronous stage – Live interviews

• Technical interview with our engineering team (scheduled at your convenience)

• Final interview with your future teammates

If it’s a match—you’ll get an offer!