Principal Data Engineer
NEW YORK, NYJobSeen 5 days agoSeen in employer's feed 5 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near NEW YORK, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The Principal Data Engineer will architect enterprise data platforms and pipelines across business domains, with a focus on cloud infrastructure, AI/ML initiatives, and operational AI. The role provides technical leadership for data engineering standards and architecture, makes decisions on complex data challenges, and collaborates with infrastructure, security, product, and analytics teams. It also involves building AI agents and ensuring reliable, scalable data systems.
Skills & qualifications
Skills
Qualifications
Full job description
An AI-first global organization operating in a fast-paced environment requires a central data engineering engine, and this role serves that need by using Agile methodologies to architect highly scalable, secure, and reliable enterprise data platforms. As a Principal Data Engineer (IC5), you will drive substantial impact on the division's reputation and technical effectiveness, independently assessing complex scenarios to develop the methods, techniques, and evaluation criteria for obtaining mission-critical results. You will provide deep expertise in cloud data infrastructure and pipeline architecture across GTM, Product, CX, Finance, Legal, and People domains, making critical architectural decisions within broadly defined AI first best practices. Operating as a highly visible technical leader, you will facilitate collaboration across employees, clients, and senior executives to deliver scalable data solutions before the business even asks for them.Responsibilities * Formulate and execute the technical architecture strategy for global ETL/ELT pipelines, streaming frameworks (such as AWS Kafka), and infrastructure-as-code (Terraform) deployments to support enterprise-wide AI/ML initiatives. * Serve as the principal technical authority for the data engineering work group, establishing development standards, code review practices, and evaluation criteria to ensure high pipeline availability and data freshness. * Architect, deploy, and maintain autonomous AI agents (e.g., Finance Analyst, Data Analyst agents) utilizing LLMs like Claude and Gemini, integrating them directly into the modern data stack for automated insights. * Independently assess high-risk architectural challenges across GTM, Finance, Product, and other operational domains, making definitive decisions on data warehousing design, upstream schema drift mitigation, and data lake scalability. * Partner with IT, Security, and Product infrastructure teams on highly specialized governance and architecture matters, including data asset correlation, normalization of disparate source schemas, and the enforcement of global RBAC and PII data masking standards. * Implement automated data pipeline monitoring, alerting, and automated cleansing mechanisms at the ingestion tier to proactively isolate and fix broken fields or source schema drifts. * Partner with Analytics Engineering to ensure the stability, scalability, and optimal performance of underlying production-ready repositories feeding the enterprise semantic layer.Minimum Qualifications * 10+ years of experience in data engineering, cloud data architecture, or specialized infrastructure roles, with a proven track record of delivering technical leadership for engineering work groups. * Advanced proficiency in SQL and software engineering programming languages, specifically Python, for pipeline automation, data scripting, and AI agent orchestration frameworks. * Extensive experience designing, provisioning, and tuning production-grade cloud environments using Terraform to manage complex warehouse and networking configurations. * Proven experience independently architecting real-time streaming topologies, high-volume event data ingestions, and custom API-driven connector/adapter frameworks.Preferred Qualifications * Experience delivering data infrastructure iteratively within a fast-paced environment utilizing Agile management tools like Jira. * Strong hands-on expertise architecting, optimizing, and managing multi-cluster enterprise data warehouses specifically within Snowflake. * Background managing cross-functional technical data requirements and standardizing architectures across GTM, Finance, Product, CX, Legal, and People divisions. * Deep experience designing and scaling advanced data platform solutions optimized for machine learning training pipelines, Vector DBs, and operational AI consumption. * Experience creating organizational methods, techniques, and governance frame
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Principal Data EngineerOctus · NEW YORK, NYStaff Data EngineerCoalition · New York, NY · $157–233K/yrPosted 3w agoPosted 3w ago
Sr. Technical ArchitectSnowflake Inc. · NEW YORK, NYPrincipal Data & AI Platform Engineer, DataOpsTeladoc Health · PURCHASE, NY
Principal Data EngineerT-Mobile · NEW YORK, NY
You've read the whole posting — now see how you match it.