Remote GCP Data Engineer

Job Description

Insight Global is seeking a GCP Data Engineer to support a large healthcare client. This individual will join the Network and Providers team, supporting a critical roster migration initiative involving the movement and transformation of data within Google Cloud Platform (GCP).

This role requires a hands-on engineer with strong experience across Python development, GCP data engineering, PySpark, ETL, APIs, and DevOps, along with exposure to modern AI/LLM technologies. The engineer will work with large datasets in BigQuery, develop and orchestrate ETL pipelines, build cloud-native Python applications and APIs, and support CI/CD and infrastructure automation.

Day-to-Day Responsibilities Design, develop, and maintain cloud-native data pipelines in GCP Move, process, and transform data within the GCP environment Develop ETL processes using PySpark, BigQuery, Dataproc, Dataflow, and Cloud Composer/Airflow Create and manage BigQuery tables and data workflows Build Python applications and services using Django, Flask, and/or FastAPI Develop and maintain REST APIs and microservices Support solutions leveraging AI/LLMs, RAG, LangChain, and OpenAI integrations Deploy and support workloads using Cloud Run, GKE, and Kubernetes Develop and support Cloud Functions Write efficient SQL and PySpark for large-scale data processing Support CI/CD pipelines and DevOps best practices Assist with infrastructure automation using Terraform Partner with engineering and business teams to support the roster migration and broader provider/network data initiatives

Skills and Requirements

-6+ years of experience as a Data Engineer or Software Engineer -Strong Python development experience ->Experience with Python frameworks such as Django, Flask, and/or FastAPI -Strong experience designing and developing cloud-native data pipelines in GCP -Hands-on experience with BigQuery, Dataproc, Cloud Composer/Airflow, and Dataflow -Strong PySpark and SQL skills -Experience building and supporting ETL/data engineering pipelines -Experience developing APIs and microservices -Experience supporting CI/CD pipelines ->Experience with Kubernetes/GKE and containerized environments

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].