Insight Global logo

Lead Data Engineer - FF

Insight Global

San Francisco, CAJobSeen 1 day agoSeen in employer's feed 1 day ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
San Francisco, CA
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

The supplier will serve the Data Strategy and Operations function within UKS, establishing new data integration patterns into Data 360 from third-party vendors and managing ingestion from existing sources.

Skills & qualifications

RequiredNice to have

Skills

Data EngineeringETLInformatica CloudSalesforceAirflowMuleSoftSQLSnowflakePythonBatch Data PipelinesReal-Time Data PipelinesDbtAWSGCPDistributed/Event-Driven ArchitecturesData ModelingData WarehousingBig Data ProcessingData QualityMonitoringPipeline Orchestration FrameworksSalesforce FlowsApexCollaboration

Full job description

Job Description

The supplier will serve the Data Strategy and Operations function within UKS, establishing new data integration patterns into Data 360 from third-party vendors and managing ingestion from existing sources. Engineers will own pipeline monitoring, KPI tracking, and egress management to multiple downstream destinations.

Responsibilities: Manage all new data ingestions for team’s operational needs Build new data integrations for all new data sources and providers, including third-party data providers Manage new data egress patterns to send/share data outputs from Data 360 to multiple destinations Ingest new data via existing ingestion pipelines Monitor, maintain, and troubleshoot data pipelines Track and report statistics including data volume, number of data streams, and other ingestion KPIs

Near-Term Priorities (First 30 Days) Establish new data integration for data provider Ingest an additional dataset from Moody's (integration already established) Manage other third-party vendor data sources as assigned

Skills and Requirements

Strong experience in data engineering, ETL (preferably Informatica Cloud), and data architecture Experience working with Salesforce platforms and data models Hands-on experience with Airflow and MuleSoft Strong SQL skills with Snowflake and other relational databases Experience writing complex Python modules for custom ETL workflows Expertise in building batch and real-time data pipelines Experience with dbt for data transformation and modeling Familiarity with AWS/GCP and distributed/event-driven architectures Strong understanding of data modeling, data warehousing, and big data processing Experience with data quality, monitoring, and pipeline orchestration frameworks Ability to work closely with Product, Data Science, and Analytics teams Experience working on Salesforce Flows and Apex is a plus

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.