REMOTE Databricks Data Engineer

Job Description

This person will be responsible to:

• Migrate their on prem data to the cloud, while their Admin Systems team builds an application that will consume and return data to that data lake.
• Design, develop, and implement end-to-end data solutions using Azure Databricks.
• Modify and maintain data pipelines.
• Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.
• Ensure data quality and integrity by implementing data validation and cleansing processes.
• Support data analysts in providing trend reports to employer health plan groups, looking at the claims dollars billed to evaluate, for example, where they are trending upwards in high cost claims/utilization.

Skills and Requirements

Mid to Senior-level data engineering experience in an Azure environment Strong SQL and python ability Databricks experience (3+ years of recent cloud-based experience) Strong interpersonal and articulate communication skills Health Plan Claims / Finance / Billing experience On prem to cloud migration experience Experience in other technologies related to their tech stack (Azure, PySpark, GitHub, PowerBI, Airflow) Databricks Certification

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].