Senior Data Engineer

Job Description

Job Description: Insight Global is seeking a Senior Consultant in Data Engineering for a top healthcare client. This individual will join a highly technical data engineering team working on advanced Microsoft Fabric and Azure initiatives, with a major focus on optimizing the current Fabric environment. They will work hands-on with Fabric, Azure Synapse, DevOps, Python, PySpark, Notebooks, SQL, and ETL/ELT, while designing and optimizing large-scale data warehouses and cloud data solutions. This is a senior-level individual contributor role where the candidate will be expected to ramp quickly, independently solve complex technical challenges, and bring strong technical confidence to the team. The team is working beyond basic Fabric implementation and is looking for someone who can speak to meaningful projects, use cases, and challenges they have personally worked through.

Day-to-Day:

• Work hands-on within Microsoft Fabric to optimize and advance the current data environment

• Design and implement large-scale data warehouses and cloud infrastructure

• Build and optimize ETL/ELT pipelines using Python, PySpark, and Notebooks

• Optimize database and data-platform performance

• Support Azure migrations and cloud-native data initiatives -Troubleshoot complex technical incidents and lead root-cause analysis

• Partner with stakeholders to translate business requirements into scalable technical solutions

• Support data governance, security, user access, permissions, and regulatory requirements

• Coordinate with the broader data engineering team to implement improvements and resolve issues

• Operate as a senior individual contributor who can ramp quickly and work independently

Skills and Requirements

Must-Haves:

• 10+ years of Data Engineering experience

• Microsoft Fabric hands-on experience or strong working knowledge, backed by a strong Azure background in DevOps and Synapse

• Strong Python and PySpark skills with experience using Notebooks

• Advanced SQL, ETL/ELT, data integration, and database optimization experience

• Experience designing and implementing large-scale data warehouses and cloud data architecture Plusses:

• Agentic AI experience within Microsoft Fabric

• Real-time data streaming experience

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].