AWS Databricks Developer

Description

Position Overview

We are seeking a AWS Databricks Developer to build and maintain scalable data pipelines on AWS. This role will turn data from databases, APIs, and files into reliable datasets for analytics and business reporting.

Responsibilities:

• Develop batch and incremental ETL/ELT pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.

• Build and maintain Bronze, Silver, and Gold data layers using Medallion Architecture.

• Ingest and transform structured and semi-structured data from sources such as Oracle, SQL Server, REST APIs, and Amazon S3.

• Implement data quality checks, including schema validation, deduplication, reconciliation, and business rule enforcement.

• Optimize Spark jobs and Delta tables to improve processing time and control cloud resource use.

• Publish curated datasets to Amazon Redshift and support reporting in Power BI, Tableau, or Amazon QuickSight.

• Orchestrate, monitor, and troubleshoot production pipelines using Databricks Workflows, Apache Airflow, and AWS monitoring services.

• Collaborate with analysts, architects, QA, and DevOps teams on requirements, releases, and production support.

Qualifications

Required Qualifications:

• Master's Degree in technical domain required.

• 5+ years of overall technology experience.

• 3+ years of AWS engineering experience.

• Strong Python and SQL skills, with hands-on experience in PySpark, Databricks, and Delta Lake.

• Experience building data pipelines on AWS, particularly with Amazon S3, AWS Glue, and Amazon Redshift.

• Knowledge of incremental loading, dimensional data modeling, data quality practices, and Spark performance tuning.

• Experience with Git, CI/CD workflows, and Agile delivery.

Preferred Qualifications :

• Experience with Databricks Auto Loader, Unity Catalog, and AWS Glue Data Catalog.

• Experience supporting manufacturing, supply chain, quality, or operational analytics.

• Databricks Certified Data Engineer Associate and AWS Certified Data Engineer Associate certification.

Target salary range: $40,001 - $80,000. The estimate displayed represents the typical salary range for this position based on experience and other factors.

REQNUMBER: 2618048

SAIC is a premier technology integrator, solving our nation's most complex modernization and systems engineering challenges across the defense, space, federal civilian, and intelligence markets. Our robust portfolio of offerings includes high-end solutions in systems engineering and integration; enterprise IT, including cloud services; cyber; software; advanced analytics and simulation; and training. We are a team of 23,000 strong driven by mission, united purpose, and inspired by opportunity. Headquartered in Reston, Virginia, SAIC has annual revenues of approximately $6.5 billion. For more information, visit saic.com. For information on the benefits SAIC offers, see Working at SAIC. EOE AA M/F/Vet/Disability