Back

Senior Software Engineer- Streaming Pipelines

• Remote - Americas
• Engineering & Data

Apply Now

About the role

Looking for a Senior Software Streaming Pipelines Engineer to join our team reimagining how merchant data flows through modern streaming architectures. This isn’t your typical ETL role – you’ll be crafting solutions that challenge conventional approaches to data processing at global scale.

What makes this exciting?

• We’ve developed a declarative pipeline framework using Apache Beam, Google Cloud Dataflow, and ClickHouse that transforms how data engineers build streaming systems. Imagine YAML-driven pipelines that eliminate boilerplate code, real-time stream processing across multiple regions, and an architecture that makes complex data transformations feel effortless.
• You’ll work across multiple languages – Kotlin, Ruby, Python, and Rust – choosing the right tool for each challenge, alongside dbt for elegant data modelling and our custom framework that turns pipeline development into a configuration exercise rather than a coding marathon.
• The puzzle? Replacing entrenched batch systems with streaming-first architecture while merchants never notice the transition.
• You’ll tackle fascinating problems: How do you handle late-arriving data in distributed streams? What’s the most elegant approach to backfill terabytes while maintaining real-time processing? How do you architect lightning-fast real-time modelling that seamlessly combines data from multiple tables?
• We embrace AI and LLMs to accelerate repetitive tasks, freeing you to focus on the creative problem-solving that makes this work truly rewarding.

If you love turning “impossible” requirements into beautiful solutions, this is your playground.

About Shopify

Opportunity is not evenly distributed. Shopify puts independence within reach for anyone with a dream to start a business. We propel entrepreneurs and enterprises to scale the heights of their potential. Since 2006, we’ve grown to over 8,300 employees and generated over $1 trillion in sales for millions of merchants in 175 countries.

This is life-defining work that directly impacts people’s lives as much as it transforms your own. This is putting the power of the few in the hands of the many, is a future with more voices rather than fewer, and is creating more choices instead of an elite option.

About you

Moving at our pace brings a lot of change, complexity, and ambiguity—and a little bit of chaos. Shopifolk thrive on that and are comfortable being uncomfortable. That means Shopify is not the right place for everyone.

Before you apply, consider if you can:

• Care deeply about what you do and about making commerce better for everyone
• Excel by seeking professional and personal hypergrowth
• Keep up with an unrelenting pace (the week, not the quarter)
• Be resilient and resourceful in face of ambiguity and thrive on (rather than endure) change
• Bring critical thought and opinion
• Put AI agents and tools to work on the tasks they're built for, and focus on the work only humans can do
• Embrace differences and disagreement to get shit done and move forward
• Work digital-first for your daily work

We may use AI-enabled tools to screen, select, and assess applications. All AI outputs are reviewed and validated by our recruitment team.

Shopifyhttps://www.shopify.com

We hire people, not resumes. If you think you’re right for the role, apply now.

Apply Now

Work with us in your early career

Dev Degree Program

A 3-4-year program that allows people to earn a computer science degree while working. It’s designed for those looking to break into computer science or transition into the tech field.

Learn more about our Dev Degree Program

Internship Program

Shopify offers 4-month paid Engineering internships that are open to students, recent graduates, and those early in their careers.

Learn more about our Internship Program

APM Program

Shopify’s 12-month Apprentice Product Manager program is designed to help you gain the skills needed to start a product management career.

Learn more about our APM Program

Design Apprentice Program

Shopify's 12-month Design Apprentice Program pairs early-career designers with senior mentors through two rotations. Built for new graduates, career switchers, and those early in their design careers.

Learn more about our Design Apprentice Program

• Terms of Service
• Privacy Policy

At Shopify, we're making commerce better for everyone, from independent entrepreneurs to global brands. We provide the scalability, reliability, and flexibility merchants need to build, grow, and evolve their businesses. Shopify powers commerce for brands like AllBirds, Gymshark, Staples, and more.

Our Professional Services Engineering team partners directly with these brands through paid engagements to build custom integrations, accelerate product features, and deliver partner solutions that standard approaches can't handle. We bridge the gap between enterprise merchant needs and what Shopify offers out of the box – building apps that connect Shopify systems with merchant systems, payment integrations, sales channels, and custom platform extensions.

This is where Senior Engineers come in, working closely with Plus and enterprise merchants, partners, Delivery Managers, Solution Architects, and Product teams to solve complex challenges. You'll be the primary technical point of contact on your projects, leading both the strategy and hands-on implementation.

What you'll do

• Partner with Plus and enterprise merchants to architect and deliver custom integrations through paid engagements
• Lead technical discovery, solution design, and hands-on implementation for backend systems
• Build apps that connect Shopify with merchant systems (ERPs, fulfillment, inventory, payments, sales channels)
• Collaborate with Product and Engineering teams across Shopify to accelerate backlog features and meet merchant launch timelines
• Develop payment integrations, sales channels, and custom platform extensions for partners
• Investigate and resolve production issues for apps your team owns
• Communicate directly with merchants and partners – set expectations, surface risks early, and land clear recommendations
• Write well-tested code using test-driven development or similar practices
• Share learnings from projects with the team to raise the bar for everyone
• Leverage AI tools (Cursor, Claude, π) to accelerate development and ramp up on unfamiliar codebases

What you can expect

• A hands-on technical role collaborating with high-impact collaborations with merchants and partners
• A fast-paced environment where requirements change frequently and ambiguity is the norm
• Autonomy to solve complex problems creatively, plus mentorship and opportunities to grow from each challenge
• Direct influence on merchant success and Shopify's product roadmap
• Projects typically lasting six months or less – you'll gain broad expertise across many Shopify domains rather than deep specialization in a single area
• A culture that values authenticity, openness, and diverse perspectives

Your skills and experience

We're interested in what you can do. If you're excited about the role, please apply even if your experience doesn't line up perfectly.

Experience can come from formal education, self-directed learning, or previous roles. No specific degree required (skills first).

Technical expertise

• Ruby on Rails: Strong backend development experience, including background jobs, webhooks, and API design
• React: Frontend experience for building admin interfaces and merchant-facing UIs
• Node.js: Familiarity with JavaScript/TypeScript backend services
• GraphQL and REST APIs: Proficiency with Shopify's Admin and Storefront APIs, webhooks, and rate-limit-aware patterns
• Relational databases: Experience with SQL, data modeling, and query optimization
• System integration patterns: Building reliable connections between Shopify and external systems (ERPs, fulfillment, payments)

Development workflow and tooling

• Git/GitHub flows, environments, CI/CD pipelines
• Test-driven development practices
• Proven use of AI tools (Cursor, VS Code/Copilot, Claude, π) to ship production work
• Comfort utilizing AI tools to ramp up on unfamiliar codebases and accelerate development

Communication and collaboration

• Strong communication skills with both technical and non-technical stakeholders
• Ability to translate ambiguous merchant requirements into clear technical solutions
• Comfortable as the primary technical contact for merchants and partners
• Clear written and verbal communication for client-facing engagements
• Thrives in collaborative environments with cross-functional teams (Engagement Managers, Delivery Managers, Solution Architects)

Bonus if you have

• Experience with Shopify app development (public or custom apps), especially react-router
• Familiarity with payment processing, payment app development, or PCI compliance
• Experience with ERP/OMS/PIM integrations
• Background in consultancy or agency work with enterprise merchants
• Experience building internal tools and automation
• Knowledge of Shopify Plus features (B2B, Scripts/Functions, Launchpad)

How you'll work

You'll work on projects typically lasting six months or less, from hands-on delivery to technical leadership on the engagement. You'll work in a dynamic environment where priorities shift frequently, requirements evolve, and creative problem-solving is essential.

This role requires both deep technical execution and the ability to think strategically about merchant outcomes. You'll be expected to learn new frameworks and codebases quickly – and AI tools are your accelerator, not a crutch.

*At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you’re ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a pair programming interview, using your own IDE.

This role may require on-call work. Ready to craft your next masterpiece in code? Join the team that’s making commerce better for everyone.*

The role's core focus is on building and managing Shopify's compliance programs for our advanced IT systems, it offers a unique opportunity to work in a flexible compliance environment where expertise, innovation, and unconventional approaches are highly valued.

In this role, you have the autonomy to discover, analyse, and solve security and compliance problems at scale. Resourcefulness is key - you’ll need to be able to quickly gather context on infrastructure, systems, software, and safeguards to help Shopify continue shipping and scaling while staying secure, trustworthy, and usable.

A ‘day in the life’ of this role may include any, or all, of the following:

• Writing and updating code that automates and supports audit and compliance programs.
• Meeting with SMEs from Production Engineering, Security Engineering, Product, Legal, and other areas to learn how Shopify works and ensure that the compliance programs accurately reflect what we do and how we do it.
• Engaging with external auditors to design and perform audits for programs such as SOC, SOX, PCI and others.
• Providing expert advice to Shopify teams with regard to security and compliance domains you manage

We want a dynamic technical expert capable of managing projects, solving complex problems, simplifying solutions, and inspiring and up-skilling the team.

This role is ideal for you if you are someone who enjoys being hands-on and building technical things to support your work. You must also be able to organize others as you build and manage complex security compliance programs for a fast paced engineering focused environment.

Qualifications:

• Proven experience performing assurance and advisory roles relating to Information Technology with particular emphasis on system implementations, technical security configurations, and cloud native environments
• Hands-on experience building data analytics, reporting solutions and task automation tooling
• Experience evaluating IT, security and application controls in the context of a compliance program for a company of similar size and complexity of Shopify
• Strong knowledge of industry risk and compliance frameworks such as NIST, ISO, SOX, SOC, and PCI-DSS
• Excellent analytical and problem-solving skills, with the ability to think strategically and identify innovative solutions to complex challenges
• Strong project management skills, with the ability to prioritize and manage multiple initiatives simultaneously using agile project management methodologies
• Exceptional communication and interpersonal skills, with the ability to effectively collaborate with stakeholders
• Self-motivated and adaptable, with a strong drive for continuous learning and professional growth

Responsibilities:

• Be a security expert responsible for owning and building compliance activities for standards such as: SOC, PCI, SOX and others
• Dive deep into new products or initiatives to surface and analyse the impact on security compliance engineering
• Leverage data and visualization tools to identify areas for improvement, track progress and inform trusted decisions
• Be a strong and credible influencer among cross functional engineering and business teams
• Actively seek out opportunities to develop and deploy automations that will increase team efficiency
• Anticipate changes in our trust and security posture as the technical footprint and company operations change, and help propose solutions to adapt to change
• Develop safeguards, systems and policies that meet compliance requirements while balancing the need to move fast and stay innovative

Step into the intersection of engineering and data science at Shopify as a Search Relevance Engineer. You'll be designing and implementing AI-powered search and discovery solutions that empower our merchants and revolutionize their experiences. In a role that thrives on change and mastery, you'll push the boundaries of what's possible, crafting tangible solutions that make a real difference in the daily lives of entrepreneurs.

Key Responsibilities:

• Collaborate with data scientists and engineers to productionize data products through load testing, metrics analysis, and experimentation.
• Design and implement features to enhance search and recommendation relevance, including semantic search, query understanding, and personalization.
• Build and maintain data pipelines for information retrieval systems.
• Tune queries that power search and discovery experiences.
• Develop tools for evaluation and relevance engineering, adhering to high-quality software engineering practices.
• Prioritize and communicate effectively with both technical and non-technical audiences.
• Mentor engineers and data scientists.

Qualifications:

• Mastery of relevance engineering, with experience in discovery and recommendation systems powered by Elasticsearch, Solr, Lucene, or vector databases.
• Extensive experience using Python, with a strong grasp of object-oriented programming (OOP) fundamentals.
• Ability to write efficient, optimized code with low latency requirements.
• Strong software development background, with proven problem-solving skills and technical system thinking.
• Experience in training, evaluating, testing, and deploying machine learning, natural language processing, or generative AI products at scale is a plus.
• Familiarity with statistical methods like regression, GLMs, or experiment design and analysis is welcome.
• Exposure to other languages such as Ruby, Rails, Rust, or Typescript is advantageous.
• This role may require on-call work.

*At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you’re ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a pair programming interview, using your own IDE.

This role may require on-call work. Ready to join a team of driven crafters building world-class search and discovery experiences? Join us and make commerce better for everyone.*

Machine Learning Infrastructure Engineers build and operate the end-to-end platform that powers AI—from data ingestion and training to large-scale, low-latency inference. They design high-performance, GPU-accelerated systems on Kubernetes, craft self-serve developer experiences, and ship the paved roads that let ML teams move fast, safely, and at global scale. Some companies separate ML Infra, ML Platform and ML Ops- at Shopify- we call this ML Infrastructure. We have an agile workforce who can flex their experience and solve problems across these three domains.

Responsibilities:

• Build and operate ML control planes, APIs, CLIs, SDKs, and self-serve golden paths
• Design and optimize multi-tenant GPU Kubernetes clusters, including autoscaling, scheduling, packing, and utilization
• Own model lifecycle: training orchestration/experiments, registries/versioning, CI/CD, canary/blue-green, and safe rollback
• Build real-time serving stacks (KServe/Seldon/TensorFlow Serving) and end-to-end pipelines for batch and streaming
• Design feature platforms and engineer storage/data movement for datasets, features, and artifacts tuned for cost/performance
• Implement observability and SLOs across pipelines, training, and inference; automate remediation and capacity planning
• Partner with ML, data, and product teams to unblock delivery and accelerate idea-to-impact

Qualifications:

• Proven platform/infrastructure engineering experience with a track record of shipping production systems and code
• Deep Kubernetes/containerization expertise for ML workloads (operators, Helm, service mesh/gRPC) and multi-tenant clusters
• Hands-on experience running GPU infrastructure at scale (NVIDIA ecosystem; scheduling/packing/optimization)
• Strong distributed systems and API/service design fundamentals; experience with high-scale inference
• Proficiency with infrastructure-as-code and automation (Terraform, Helm, GitOps) on major clouds (GCP/AWS/Azure)
• Observability expertise (Prometheus/Grafana) and SLO-driven operations for ML systems
• Proficient in Python/Go/Java; experience building developer tooling and self-service platforms

Nice to Haves:

• Model serving and lifecycle tooling: KServe/Seldon/TensorFlow Serving, Kubeflow, MLflow/W&B, model registries, DVC
• Feature store experience (Feast/Tecton) with online/offline parity and SLAs
• Data infrastructure familiarity (Kafka, Spark/Flink) and stateful stores (Redis/MySQL); CI/CD for online/batch inference
• Model performance optimization (batching, caching, quantization, distillation) and hardware-aware tuning
• Experience with experimentation/A/B testing platforms and online evaluation frameworks

At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you're ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a live pair programming session, come prepared with your own IDE.

This role may require on-call work

Every day, millions of people search for products across Shopify's ecosystem. That's not just queries—that's dreams, businesses, and livelihoods riding on whether someone finds the perfect vintage jacket or the exact drill bit they need. As a Machine Learning Engineer specializing in Search Recommendations, you'll be the one making that magic happen. With a search index unifying over a billion products, you're tackling one of the hardest search problems at unprecedented scale. We're building cutting-edge product search from the ground up using the latest LLM advances and vector matching technologies to create search experiences that truly understand what people are looking for.

Key Responsibilities:

• Design and implement AI-powered features to enhance search recommendations and personalization
• Collaborate with data scientists and engineers to productionize data products through rigorous experimentation and metrics analysis
• Build and maintain robust, scalable data pipelines for search and recommendation systems
• Develop comprehensive tools for evaluation and relevance engineering, following high-quality software engineering practices
• Mentor engineers and data scientists while fostering a culture of innovation and technical excellence

Qualifications:

• Expertise in relevance engineering and recommendation systems, with hands-on experience in Elasticsearch, Solr, or vector databases
• Strong proficiency in Python with solid object-oriented programming skills
• Proven ability to write optimized, low-latency code for high-performance systems
• Experience deploying machine learning, NLP, or generative AI products at scale (strong plus)
• Familiarity with statistical methods and exposure to Ruby, Rails, or Rust (advantageous)
• Track record of shipping ML solutions that real users depend on

Ready to make search more magical? Join the team that's making commerce better for everyone.

At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you're ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a live pair programming session, come prepared with your own IDE.
This role may require on-call work

Join Shopify's innovative team as we work on the development and implementation of state of the art HSTU models (Hierarchical Sequential Transduction Unit) to recommend the best growth drivers and action for merchants and buyers. You'll play a pivotal role in solving high-impact data problems that directly improve merchant success and consumer experience.

As a Machine Learning Engineering (MLE) lead or individual contributor, you'll be at the forefront of building AI solutions that anticipate both merchant needs and personalization for 100M+ shoppers.

Key Responsibilities:

• Develop and deploy Generative AI, natural language processing, and HSTU-based recommendation models at scale
• Design and implement scalable AI/ML system architectures supporting models
• Build sophisticated inference pipelines that process billions of events and deliver real-time recommendations
• Implement data pipelines for model training, fine-tuning, and evaluation across diverse data sources (merchant events, consumer interactions, payment sequences)
• Experiment with novel architectures
• Optimize for production through advanced techniques like negative sampling, ANN search, and distributed GPU training
• Collaborate cross-functionally with product teams, data scientists, and infrastructure engineers to deliver measurable business impact
• Communicate effectively with both technical and non-technical audiences, translating complex ML concepts into actionable insights

Qualifications:

• Mastery in recommendation systems, Gen AI or LLMs
• End-to-end experience in training, evaluating, testing, and deploying machine learning products at scale.
• Experience in building data pipelines and driving ETL design decisions using disparate data sources.
• Proficiency in Python, shell scripting, streaming and batch data pipelines, vector databases, DBT, BigQuery, BigTable, or equivalent, and orchestration tools.
• Experience with running machine learning in parallel environments (e.g., distributed clusters, GPU optimization).
• This role may require on-call work.

*At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you’re ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a pair programming interview, using your own IDE.

This role may require on-call work.*Ready to redefine e-commerce through AI innovation? Join the team that’s making commerce better for everyone.

Great advertising connects merchants with customers who genuinely need what they're selling. As a Machine Learning Engineer focused on Ads, you'll build the targeting and personalization technology that makes these meaningful connections happen at scale. You'll develop sophisticated machine learning models that help merchants reach the right audience at exactly the right moment, creating advertising experiences that drive real business growth while respecting the customer experience.

Key Responsibilities:

• Develop and optimize advanced machine learning models for ad targeting and personalization systems
• Analyze comprehensive ad performance data to identify optimization opportunities and maximize ad spend efficiency
• Collaborate closely with advertising teams to integrate ML solutions seamlessly into our ad platform
• Research and implement innovative algorithms and tools to enhance ad relevance and effectiveness
• Document technical insights and share best practices across engineering teams

Qualifications:

• Extensive experience building and deploying machine learning models for advertising systems at scale
• Strong proficiency in ML frameworks including TensorFlow or PyTorch, with expert-level Python programming skills
• Proven analytical skills for processing and extracting insights from large-scale datasets
• Demonstrated problem-solving abilities and innovative thinking in ad technology solutions
• Solid familiarity with ad platforms, A/B testing methodologies, and data-driven decision making processes
• Experience with statistical methods and performance optimization for ML systems

Ready to connect merchants with their perfect customers? Join the team that's making commerce better for everyone.

*At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you're ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a live pair programming session, come prepared with your own IDE.

This role may require on-call work*

Step into the future of AI with Shopify, where you'll be at the helm of cutting-edge machine learning innovation that transforms commerce and solves complex challenges. Leverage your expertise in Natural Language Processing (NLP), Large Language Models (LLMs), and AI solutions to design, develop, and deploy state-of-the-art machine learning models. Work on impactful projects that enhance our products and services, ensuring AI solutions are effective, ethical, and scalable.

Key Responsibilities:

• Design and implement machine learning models in NLP and LLMs to address business challenges and improve customer experiences.
• Collaborate with cross-functional teams to integrate AI solutions into products for seamless deployment.
• Conduct research and experimentation to explore new methodologies and technologies, staying at the forefront of advancements in AI.
• Optimize models for production environments, focusing on scalability, efficiency, and performance.
• Analyze complex datasets to derive actionable insights for product development and strategy.
• Contribute to the academic community through publications and patents, sharing innovations with the broader field.

Qualifications:

• Proven experience in developing and deploying machine learning models, particularly in NLP and LLMs (e.g., BERT, T5, GPT).
• Proficiency in programming languages such as Python, with experience in ML frameworks (e.g., TensorFlow, PyTorch).
• Strong understanding of AI, model optimization, and deployment strategies.
• Excellent analytical skills with the ability to communicate complex ideas effectively.
• Ph.D. or Master’s degree in Computer Science, Data Science, or a related field with a focus on machine learning and AI is preferred but not required.

*At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you’re ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a pair programming interview, using your own IDE.

This role may require on-call work. Ready to redefine the future of AI with innovative solutions? Join the team that’s making commerce better for everyone.*

Join Shopify's dynamic engineering team, where code is core and innovation drives commerce forward. As a Java Search Infrastructure Engineer, you'll build distributed systems that power search query serving across billions of products. Collaborate with platform engineers and SREs to create scalable, resilient search infrastructure that helps merchants succeed at the infinite game of entrepreneurship.

Key Responsibilities:

• Build high-throughput scatter-gather systems that coordinate queries across hundreds of shards and aggregate results efficiently.
• Own search APIs end-to-end—interface design, load balancing, circuit breaking, and graceful degradation.
• Optimize networking and JVM performance—connection pooling, request batching, GC tuning, and profiling for high-load scenarios.
• Design comprehensive observability through structured logging, metrics, and distributed tracing.
• Build A/B testing frameworks enabling data-driven experimentation at scale.
• Solve distributed systems challenges—consistency, availability, latency tail tolerance, and failure handling.

Qualifications:

• Proven expertise in Java for building production distributed systems at scale.
• Experience with search infrastructure, particularly scatter-gather patterns and distributed query execution.
• Networking expertise—HTTP/2, TCP tuning, connection management, protocol design.
• Experience with service frameworks—Thrift, gRPC, or similar RPC frameworks.
• Observability expertise—building logging pipelines, metrics infrastructure, distributed tracing.
• Load balancing and A/B testing experience—consistent hashing, adaptive routing, experiment design.
• Strong collaboration skills, working with cross-disciplinary teams including platform engineers and data scientists.

*At Shopify, we pride ourselves on moving quickly—not just in shipping, but in our hiring process as well. If you’re ready to apply, please be prepared to interview with us within the week. Our goal is to complete the entire interview loop within 30 days. You will be expected to complete a pair programming interview, using your own IDE.

This role may require on-call work. Ready to craft the world’s best product search and drive AI-powered commerce forward? Join us and make commerce better for everyone.*