Senior Data Engineer

Patton Labs Inc.

Wixom, MIJobSeen todaySeen in employer's feed today

Wixom, MIJobNo compensation foundSeen todaySeen in employer's feed today

Evaluate my fit

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this. New roles like this one near Wixom, MI, by email.

Don't just apply. Show up ready.

Olive works from this exact posting.

Evaluate your fitSee where you stand — strengths, gaps, and what to fix first.
Tailor your résuméRewritten against this posting, every reworded bullet shown before and after.
Practice the interviewA voice mock interview built from this job description.

Evaluate your fitSee where you stand — strengths, gaps, and what to fix first.Get started →Tailor your résuméRewritten against this posting, every reworded bullet shown before and after.Get started →Practice the interviewA voice mock interview built from this job description.Get started →

At a glance

Compensation

No compensation found

Location

Wixom, MI

Work Authorization

Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Requirements

Credentials this posting asks for.

Master's degree

Job overview

The Senior Data Engineer designs and implements ETL frameworks and automated ingestion pipelines across multiple data platforms. The role includes database migrations to AWS Redshift and Databricks, Spark-based transformations, and implementation of Type-1 and Type-2 slowly changing dimensions. The position requires a master's degree and two years of experience, as well as relocation to varying client sites throughout the United States for projects.

Skills & qualifications

RequiredNice to have

Skills

ETL FrameworksData IngestionHivePostgreSQLAmazon RedshiftDatabricksAmazon S3Apache SparkAmazon AthenaPySparkScalaPythonSpark SQLStonebranchSnowflakeEclipseVs CodeJiraJenkinsTeradataDB2Git

Qualifications

Master's Degree2 Years ExperienceRelocation to Client Sites

Full job description

Design and implement scalable ETL frameworks to ingest, transform, and extract data from various source systems into Hive, PostgreSQL, and Redshift, generating business-driven extracts. Develop automated data ingestion pipelines for processing different file types (TXT, CSV) from AWS S3, dynamically loading them into Hive, PostgreSQL, Redshift, and Databricks based on project requirements. Lead database migration efforts, migrating SQL databases to AWS Redshift, leveraging Apache Spark for data transformation and AWS Athena for efficient querying of S3-stored data. Implement Type-1 and Type-2 Slowly Changing Dimensions (SCD) in ETL pipelines, ensuring historical data accuracy and compliance by handling overwrites (Type-1) and preserving versioned records (Type-2). Design and develop Spark-based ETL pipelines to migrate data from AWS Redshift to Databricks, applying complex transformations using PySpark/Scala and optimizing job performance. Work with AWS S3, Python, Scala, Spark, Spark SQL, AWS Athena, PostgreSQL, AWS Redshift, Databricks, Stonebranch, Snowflake, Eclipse, VS Code, Jira, Jenkins, Teradata, DB2, and GIT. Worksite: Relocation for short/long term projects to client sites at varying unanticipated locations throughout the US required. Master's degree plus 2 years of experience required.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.

Evaluate my fit