Staff Software Engineer, Data Ingestion - Slack

Salesforce

Remote Actively hiring Posted this week
Virginia · Washington Dc Metro · Palo Alto, California · Seattle, Washington · Bellevue, Washington · Dallas, Texas Posted 5 days ago $197,300–$313,700 / year
View original post Log in to save

At a glance

AI generated

TL;DR

As a Staff Software Engineer on Slack’s Data Ingestion Team, you will drive the development of highly scalable and resilient streaming and batch pipelines for ingesting structured and unstructured datasets into our Lakehouse. You’ll design and implement solutions to enable production use cases while improving service reliability through AI-assisted tools. Additionally, you will automate dataset lifecycle management and mentor team members, ensuring high-quality technical standards are maintained across the organization. The role requires expertise in Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta, Spark, Airflow, EMR, S3, Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, and proficiency in languages like SQL, Python, Java/Scala, Go. With experience handling 180PB+ of storage and processing over a trillion records daily, you’ll tackle complex data engineering challenges at scale for Slack’s growing customer base.

Skills

Kafka Kafka Connect Flink Spark Streaming Iceberg Hudi Delta Spark Airflow EMR S3 Python Java Scala Go Kubernetes Docker AWS_ECS AWS_EKS Terraform Grafana CI/CD

What you'll do

  • Design and develop highly scalable streaming and batch pipelines for ingesting structured and unstructured datasets.
  • Implement Slack’s Lakehouse solutions to enable production use cases for customers.
  • Improve the reliability and performance of services/pipelines using AI-assisted tools.
  • Automate lifecycle management of datasets, including schema evolution and metadata handling.
  • Lead technical initiatives independently from design through implementation.
  • Mentor other engineers across the team and organization, acting as a role model.

What we're looking for

  • 7+ years of software/data engineering experience with streaming and lakehouse technologies
  • Hands-on experience building batch data pipelines using Spark, Airflow, EMR, S3 or equivalents
  • Proficiency in object-oriented and functional programming languages like SQL, Python, Java/Scala, Go
  • Skill in crafting robust distributed microservices using Kubernetes, Docker, AWS ECS/EKS, Terraform
  • Familiarity with AI-assisted software development tools such as Claude Code/Codex
  • Excellent communication skills for collaboration with cross-functional teams and non-technical stakeholders

Employer

About Salesforce

Salesforce is the world''s leading customer relationship management (CRM) platform, offering cloud-based software for sales, service, marketing, analytics, and application development. Industry: Enterprise Software & Cloud Computing

Salesforce currently has 81 open roles on FindRole.

Listed pay typically runs $157,050–$260,100 across 70 roles with salary data.

Most-posted roles

View all roles at Salesforce