Azure Databricks Engineer
New York, NY · HybridJobSeen todaySeen in employer's feed today
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near New York, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Requirements
Credentials this posting asks for.
Job overview
Insight Global seeks an Azure Databricks Engineer for an investment banking client in New York City. The role builds scalable data solutions, integrates data, and enables analytics across corporate technology functions. The engineer works across teams to deliver shared data platforms and pipelines, with a hybrid schedule requiring three days onsite in Manhattan.
Skills & qualifications
Skills
Qualifications
Full job description
Job Description
Insight Global is looking for an Azure Databricks Engineer to join one of their Investment Banking clients in New York City. The individual will operate across multiple lines of business within corporate technology including: Real Estate Strategy & Operations, Human Capital Group, Compliance, and Finance. This role focuses on building scalable data solutions, driving data integration, and enabling analytics across the firm. The ideal candidate brings strong data engineering experience with Azure and Databricks, and works effectively across teams to deliver shared data platforms and pipelines. This is a hybrid role requiring 3 days a week onsite in Manhattan.
Responsibilities include:
- Design, build, and maintain scalable data pipelines using Azure and Databricks
- Develop and optimize ETL and ELT workflows for structured and unstructured data
- Collaborate with business and technical teams across corporate functions to define data requirements and deliver solutions
- Implement data models and data architectures to support analytics and reporting use cases
- Integrate enterprise systems such as ServiceNow, Dataverse, and Workday into centralized data platforms
- Ensure data quality, governance, and security standards are met across all solutions
- Monitor and troubleshoot data workflows, ensuring reliability and performance
- Contribute to the evolution of enterprise data platforms and recommend improvements based on emerging technologies
Skills and Requirements
- 5+ years as a data engineer with focus on Azure cloud services
- Experience working in financial services or corporate enterprise environment
- Hands on experience with Databricks, including Spark and distributed data processing
- SQL experience
- Experience building data pipoelines using Azure Data Factory or similar tools
- Azure AQL Database experience
- Experience with Python or Scala
- Experience with C# and PowerShell for automation/integration tasks
- Experience with Azure DevOps and CI/CD pipelines
- Experience with Delta Lake and modern data lakehouse architectures
- Familiarity with data governance and data catalog tools
- Experience working in Agile or Scrum environments
- Microsoft or Databricks certifications
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].
How this job compares
Set against the 5,779 open Data Engineer jobs on Olive Jobs, counted November 3, 2026.
- Pay
- This postingNot listed
- New York median$150–212K/yr361 salary ranges
- US median$60–74/hr269 hourly ranges
- Openings
- Olive Jobs lists 473 open Data Engineer jobs in New York and 5,779 across the US. 9% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 5 years of experience; Data Engineer postings that state a minimum ask for 5 years at the median (5,017 postings).
- Education
- 2,220 of the 5,779 open Data Engineer jobs (38%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 3, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.
