Sr. Software Engineer - Big Data
San Francisco, CAFull-time$130–197K/yrPosted 2 days agoStill listed 1 day ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The Identity Engineering team maintains a graph processing engine connecting consumer and device identifiers. The engineer will help process its trillion-edge graph efficiently, modernize applications, and deliver product enhancements focused on scalability, performance, reliability, security, and quality. The work includes batch-processing architecture, REST APIs, and migrations to Spark and SingleStore.
Skills & qualifications
Skills
Qualifications
Full job description
LiveRamp is shaping the future of responsible data collaboration between the world’s leading brands, retailers, financial services providers, and healthcare innovators. As consumers embrace new AI-driven experiences, the LiveRamp data collaboration network exponentially expands the breadth and accuracy of the data on which marketing AI capabilities operate, powering deeper customer insight and measurable performance on a global scale. LiveRamp is headquartered in San Francisco, California, with offices worldwide. Learn more at LiveRamp.com.
We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible.
We handle product requests and enhancements, focusing on scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. Projects include architectural refreshes like POCs for batch data processing, developing new REST APIs, and migrating applications to Spark and SingleStore. These initiatives aim to improve processing speed, scalability, maintainability, and cost-effectiveness.
You will:
-
Lead complex problems, by breaking into their essential components, design and implement elegant solutions focussing on value delivered.
-
Deliver on the problems problems by collaborating with the team and cross functional teams
-
Modernize our applications to be modular, scalable by leveraging the latest stack
-
Collaborate closely with product managers, and other engineers to deliver high-quality software
-
Design with privacy and security-first principles and err on the side of shipping fast and iterating.
About you:
-
6+ years of professional software development experience, primarily focused on big data technologies.
-
3+ years of experience writing and optimizing large-scale batch processing using Spark/Hadoop or similar
-
3+ years of Java , SQL programming skills
-
2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies.
-
Experience with technologies like Docker, Terraform and/or Kubernetes
-
Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.
Preferred Qualifications:
-
Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam
-
Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle
-
Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIs
The approximate annual base compensation range is $130,000 to $196,500. The actual offer, reflecting the total compensation package and benefits, will be determined by a number of factors including the applicant's experience, knowledge, skills, and abilities, geography, as well as internal equity among our team.
We use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that the use of an ADS may create a barrier to your application or participation in the hiring process due to a disability or other protected characteristic, please let us know. We are committed to providing reasonable accommodations and ensuring an equitable hiring experience for all candidates. To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
- Senior Software Engineer, Data PlatformChime Financial, Inc · San Francisco, CA (Hybrid) · $187–259K/yrPosted 2w agoPosted 2w ago
Senior Software Engineer, Data PlatformHandshake · San Francisco, CA · $166–207K/yrPosted 3w agoPosted 3w ago
Software Engineer, RL DataCursor · San Francisco, CAPosted 1w agoPosted 1w ago
Senior Software Engineer,Ripple · San Francisco, CA (Hybrid) · $200–201K/yrPosted 1 day agoPosted 1 day ago
Senior Software EngineerCisco · San Francisco, CA (Hybrid) · $168–245K/yrPosted 1w agoPosted 1w ago
You've read the whole posting — now see how you match it.