Skip to main content
Insight Global logo

Manager of Data Engineering - Streaming & Consumer Data

Insight Global

New York, NYJobSeen todayIn the employer's feed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
New York, NY
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Insight Global is seeking a Manager or Director of Data Engineering to lead strategy, architecture, and operations for a data platform supporting a streaming and subscription business. The role oversees engineering teams and partners, collaborates across business and technical functions, and drives cloud-native modernization, governance, observability, reliability, performance, and self-service analytics. The ideal candidate brings technical leadership and data-platform expertise supporting customer growth, engagement, retention, and operational efficiency.

Skills & qualifications

RequiredNice to have

Skills

Data Engineering, requiredLeadership, requiredEvent Schema Design, requiredCustomer Data Platforms, requiredEvent-Driven Architecture, requiredStreaming Data, requiredObservability, requiredData Quality, requiredOperational Support, requiredMarTech Engineering, requiredCustomer Event Data, requiredIdentity Resolution, requiredData Pipelines, requiredApache Kafka, nice to haveApache Flink, requiredAWS Kinesis, requiredPub/Sub, requiredAppsFlyer, requiredMixpanel, requiredAmplitude, requiredCustomer Data Integration, requiredEntertainment Data, requiredData Governance, requiredPrivacy, requiredSecurity, requiredConsent Management, requiredCompliance, requiredPython, requiredJava, requiredScala, requiredSQL, requiredGoogle Analytics, nice to haveConviva, nice to haveMux, nice to haveYoubora, nice to haveTableau, nice to haveLooker, nice to havePower BI, nice to havePersonalization, nice to haveRecommendation Engines, nice to have

Qualifications

10+ Years Data Engineering, required5+ Years Leadership Experience, required

Full job description

Job Description

Insight Global is seeking a Manager or Director of Data Engineering to lead the strategy, architecture, and operational excellence of a modern data platform supporting a large scale streaming and subscription business. This individual will oversee Data Engineers, Analytics Engineers, and technical partners responsible for building scalable batch. On a day-to-day basis, they will partner closely with Product, Engineering, Marketing, Finance, Data Science, Privacy, and Security teams to define data roadmaps, establish governance standards, improve analytics instrumentation, and ensure data quality across the organization. They will drive modernization efforts by implementing cloud-native data solutions, improving observability and reliability, optimizing platform performance, and enhancing self-service analytics capabilities. The ideal candidate will bring a combination of strong technical leadership, data platform expertise, and experience building scalable data ecosystems that support customer growth, engagement, retention, and operational efficiency.

Skills and Requirements

  • 10+ years of experience in Data Engineering, including 5+ years of leadership experience managing Data Engineers, Technical Leads, Analytics Engineers, and third-party/partner teams.

  • Hands-on experience designing and managing event schemas and event definitions, including determining how customer behaviors and interactions are captured, structured, standardized, and made available across downstream platforms.

  • Deep understanding of Customer Data Platforms (CDPs) and their integration within the broader enterprise data ecosystem.

  • Deep understanding of event-driven architectures, streaming data technologies, observability, data quality, and operational support.

  • Strong experience with MarTech engineering and customer event data, including building the data foundations that support customer analytics, marketing activation, personalization, and audience segmentation.

  • Strong experience with identity resolution, including user identity, anonymous-to-known user stitching, customer identifiers, and determining how user attributes and customer profiles are structured across platforms.

  • Experience building and managing batch and real-time data pipelines supporting analytics, reporting, personalization, customer insights, marketing activation, and business intelligence initiatives.

  • Strong experience with event streaming technologies such as Apache Kafka, Apache Flink, AWS Kinesis, Pub/Sub, or comparable platforms, with Kafka experience strongly preferred.

  • Experience integrating event and customer data with platforms such as AppsFlyer, Mixpanel, Amplitude, or comparable product analytics and MarTech technologies.

  • Experience supporting entertainment, OTT, SVOD, AVOD, FAST, or subscription-based businesses, including data associated with playback events, content engagement, subscriber funnels, customer behavior, churn, and customer lifecycle.

  • Strong knowledge of data governance, privacy, security, consent management, and compliance best practices related to customer data collection, storage, activation, and retention.

  • Proficiency with Python, Java, Scala, SQL, or other data-focused programming languages. Plus

  • Experience working within a complex MarTech ecosystem spanning CDPs, product analytics, attribution, customer identity, marketing activation, and behavioral/event data.

  • Experience with product and behavioral analytics platforms including Amplitude, Mixpanel, AppsFlyer, Google Analytics, Conviva, Mux, or Youbora.

  • Experience with visualization and BI platforms such as Tableau, Looker, or Power BI.

  • Experience supporting personalization, recommendation engines, experimentation platforms, audience segmentation, marketing activation, or machine learning initiatives.

  • Experience with data catalogs, lineage tools, metadata management, consent management platforms, and privacy-focused data ecosystems.

  • Experience developing governance around event taxonomy, event naming conventions, event definitions, user attributes, customer identity, and schema evolution.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

How this job compares

Set against the 6,436 open Data Engineer jobs on Olive Jobs, counted November 19, 2026.

Pay
  • This postingNot listed
  • New York median$135–202K/yr355 salary ranges
  • US median$51–64/hr227 hourly ranges
Openings
Olive Jobs lists 407 open Data Engineer jobs in New York and 6,436 across the US. 9% of them nationwide are listed as remote or flexible.
Hiring the most in New York
Experience
This posting asks for at least 10 years of experience — more than three in four Data Engineer postings that state a minimum ask for (median 5 years, across 5,619 postings).
Education
2,453 of the 6,436 open Data Engineer jobs (38%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 19, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.