Insight Global logo

LATAM - Lead Data Engineer

Insight Global

San Francisco, CAJobSeen 1 day agoSeen in employer's feed 1 day ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
San Francisco, CA
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Sephora seeks engineers to build the next generation Retail and Omnichannel Analytics platform, combining hands‑on engineering, technical leadership, and architecture across the full analytics lifecycle, including source‑system integration, ingestion, transformation, governance, semantic modeling, reporting and AI‑enabled data products.

Skills & qualifications

RequiredNice to have

Skills

DatabricksAzurePythonSQLScalaSparkPySparkDelta LakeAzure Data FactoryAzure DevOpsGitCI/CD PipelinesRelease ManagementLakehouse ArchitectureMedallion ArchitectureETLELTData ModelingData GovernanceSecurityData QualityLineageObservabilityMonitoringPerformance OptimizationCommunicationLeadershipUnity CatalogLakeFlowDelta Live TablesDatabricks SQLDatabricks GenieDatabricks WorkflowsAI‑Assisted DevelopmentAI SDLCGenAI‑Enabled Engineering WorkflowsAI AgentsRetail AnalyticsOmnichannel AnalyticsREST APIs

Qualifications

7+ Years Data Engineering Experience

Full job description

Job Description

Job Summary: Sephora is looking for engineers to help build the next generation of its Retail and Omnichannel Analytics platform. These roles combine hands-on engineering, technical leadership, and architecture across the complete analytics lifecycle, including source-system integration, ingestion, transformation, governance, semantic modeling, reporting, self-service analytics, and AI-enabled data products.

The engineers will establish scalable Databricks standards and reusable frameworks, build modern Lakehouse solutions, and enable capabilities such as Databricks Genie. Strong candidates will have previously led Databricks platform modernization, analytics transformation, or enterprise data-platform initiatives and will be comfortable combining architectural leadership with hands-on delivery

Day-to-Day Responsibilities:

  • Design and build scalable ingestion, transformation, and data-product frameworks using Databricks and Azure technologies.
  • Establish and drive Databricks best practices for Bronze, Silver, and Gold architecture, governance, performance, data quality, and operational excellence.
  • Build batch, near real-time, and streaming pipelines using Databricks, Spark/PySpark, Delta Lake, and Azure Data Factory.
  • Deliver end-to-end Retail and Omnichannel Analytics data products, from source-system ingestion through reporting and AI-enabled solutions.
  • Develop trusted analytical datasets, dimensional and semantic models, and governed consumption layers.
  • Enable self-service analytics through Databricks Genie and reusable, business-ready data products.
  • Implement governance, security, data quality, lineage, monitoring, and observability practices.
  • Lead proofs of concept and evaluate emerging capabilities across the Databricks ecosystem.
  • Define AI SDLC, AI-assisted development, AI-agent, and engineering-automation patterns.
  • Partner with engineering, analytics, product, and business teams while mentoring engineers and promoting standards across multiple teams.

Skills and Requirements

Qualifications:

  • 7+ years of Data Engineering experience.

  • Strong hands-on Databricks experience within enterprise production environments.

  • Advanced expertise in Python, SQL, Scala, Spark/PySpark, and Delta Lake.

  • Strong experience with Azure Data Factory, Azure DevOps, Git, CI/CD pipelines, and release management.

  • Experience building Lakehouse architectures and implementing Medallion Architecture using Bronze, Silver, and Gold layers.

  • Strong experience designing ETL/ELT processes, data integrations, and scalable batch, near real-time, and streaming pipelines.

  • Experience creating analytical, dimensional, and semantic data models.

  • Experience delivering end-to-end analytics solutions, from source-system integration and ingestion through transformation, governance, semantic modeling, reporting, and AI-enabled solutions.

  • Strong understanding of data governance, security, data quality, lineage, observability, monitoring, and performance optimization.

  • Experience establishing reusable frameworks, platform standards, and engineering best practices adopted across multiple teams.

  • Ability to combine architecture and technical leadership with hands-on engineering delivery.

  • Strong communication skills with the ability to lead technical discussions and mentor engineers. Nice to Haves:

  • Experience with Unity Catalog, LakeFlow, Delta Live Tables, Databricks SQL, Databricks Genie, and Databricks Workflows.

  • Experience enabling self-service analytics and data democratization through semantic models and reusable, business-ready data products.

  • Experience implementing AI-assisted development, AI SDLC practices, GenAI-enabled engineering workflows, and AI agents.

  • Experience designing automation or engineering accelerators that improve developer productivity.

  • Experience leading Databricks platform modernization, analytics transformation initiatives, and technical proof-of-concepts.

  • Experience in Retail and Omnichannel Analytics, Merchandising, Inventory, Supply Chain, Store Operations, Customer Analytics, or Digital Commerce.

  • Experience integrating REST APIs and source systems into modern data platforms

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.