Software Engineer II, Big Data, tvScientific

Remote

Quick summary

Work type: Remote
Location: San Francisco, CA
Salary: $123,696–$254,667 / yr
Posted: 15 days ago
Nearby: 99+ roles within 25 mi

Market check

Salary context

Above market

How this pay compares to similar roles

Similar $160k

This role $189k

$80k most similar roles pay here $273k

This role pays more than 74% of similar roles. Most pay $126,800–$193,000 — the shaded band above. At the midpoint, this role pays about $189k versus about $160k for comparable roles.

Based on 240 similar postings.

Employer

About Pinterest

Pinterest is a visual discovery and inspiration platform where people find ideas for home, style, recipes, and more. It serves hundreds of millions of users worldwide through its image and video pinboard product.

Pinterest currently has 41 open roles on FindRole.

Listed pay typically runs $177,185–$339,078 across 41 roles with salary data.

Most-posted roles

View all roles at Pinterest

At a glance

TL;DR · Software Engineer II, Big Data, tvScientific

Apply Now Log in to save

As a Senior Data Engineer at tvScientific, you will join a dynamic team responsible for building and maintaining the company’s data infrastructure on AWS. Your daily tasks will include designing and implementing robust data pipelines using Spark with Scala to support massive growth, optimizing storage in optimal engines and formats, and collaborating closely with cross-functional teams such as Data Science and Product to deliver scalable solutions. You will also design knowledge graphs and APIs for efficient data access and processing, ensuring high-quality data through automated checks while leveraging AWS services effectively. Ideal candidates have extensive experience in production data engineering, proficiency in Spark and Scala, and a strong background in SQL and cloud-based storage formats like Apache Iceberg or Delta. Experience in adtech and data governance practices is beneficial.

Skills

AWS Spark Scala SQL APIs Data Lakes Cloud Warehouses Data Quality Metadata Management Apache Iceberg Delta Kafka Hadoop CI/CD

What you'll do

Design and implement robust data infrastructure in AWS using Spark with Scala.
Evolve core data pipelines to efficiently scale for rapid company growth.
Store data in optimal engines and formats to meet performance needs and cost factors.
Collaborate with cross-functional teams to design data solutions that align with business goals.
Implement knowledge graphs, exposing their functionality via batch processing and APIs.
Optimize AWS resources while designing scalable data infrastructure solutions.
Ensure timely delivery of optimized data assets and APIs for efficient use by other teams.

What we're looking for

Production data engineering experience and proficiency in Spark with Scala.
Expertise in designing and implementing scalable data infrastructure on AWS.
Strong skills in SQL for data manipulation and extraction.
Experience in delivering APIs backed by complex datasets and collaborating cross-functionally.
Bachelor's degree in Computer Science or a related field required.
Familiarity with data lakes, cloud warehouses, and storage formats preferred.

Similar roles

Data Engineer

Booz Allen Hamilton

Atlanta, GA +1 3 days ago $77,500–$176,000

PySpark SQL Azure Databricks ETL ELT FHIR Scala Java AWS Azure GCP Spark Databricks Hadoop Hive EMR Kafka Redshift MySQL Snowflake Agile MongoDB Cassandra

Save

Data Engineer

Booz Allen Hamilton

Fayetteville, NC 77 days ago $77,500–$176,000

ETL ELT data pipelines batch processing streaming workflows data catalog API integration OAuth2 Python SQL CI/CD

Hybrid

Save

Data Engineer

Booz Allen Hamilton

Honolulu, HI 24 days ago $77,600–$176,000

Palantir Foundry Pipeline Builder TypeScript Python Git CI/CD Agile DevSecOps Data Modeling Ontology Mapping SharePoint Dataverse Maven Smart Systems Microsoft Power Platform

Save

Data Engineer

Booz Allen Hamilton

Bremerton, WA 45 days ago $77,600–$176,000

Python SQL Scala RDS Aurora DynamoDB Lambda EC2 SQS/SNS S3 IAM CloudFormation Step Functions Java UNIX/Linux Shell scripting Spark Databricks Hadoop Hive AWS EMR Kafka MongoDB Cassandra AWS Redshift MySQL Snowflake

Save

Data Engineer

Booz Allen Hamilton

Albuquerque, NM 32 days ago $61,900–$141,000

Python PostgreSQL AWS Docker Kubernetes Terraform CI/CD RESTful APIs PySpark CloudFormation CDK Data质量管理框架日志监控报警数据验证安全和访问控制

Save

Data Engineer

Booz Allen Hamilton

O'Fallon, IL 9 days ago $61,900–$141,000

Python Java C++ SQL Scala Spark Databricks Hadoop Hive AWS EMR Kafka UNIX Linux Shell scripting ETL ELT CI/CD

Save