AI & Machine Learning Engineering Consultant - Databricks - Senior - Consulting - Location OPEN

Location: Anywhere in Country

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

The opportunity

Our AI, Data & Engineering team helps apply cutting edge technology and techniques to bring solutions to our clients. As part of that, you'll sit side-by-side with clients and diverse teams from EY to create a well-rounded approach to advising and solving challenging problems, some of which have not been solved before. No two days will be the same, and with constant research and development, you'll find yourself building knowledge that can be applied across a wide range of projects now, and in the future. You'll need to have a passion for continuous learning, stay ahead of the trends, and influence new ways of working so you can position solutions in the most relevant and innovative way for our clients. You can expect heavy client interaction in a fast-paced environment and the opportunity to develop your own career path for your unique skills and ambitions.

EY is experiencing significant growth in consulting services centered on Databricks, a market-leading data and AI platform. We are seeking an accomplished leader who combines strong business acumen, consulting experience, and technical credibility to help clients realize value from this strategic platform. In this role, you will collaborate with clients and Databricks account, sector, and leadership teams to shape and deliver generative AI use cases, advanced data and AI solutions, and scalable platforms.

As a Senior AI Engineer, you will be at the forefront of revolutionizing how businesses leverage artificial intelligence. Your role will involve researching, building, and implementing scalable AI, machine learning, generative AI, and agentic systems on Databricks that learn, reason, and generate outputs tailored to diverse business environments. You will enhance data pipelines to ensure data integrity and optimize learning processes, all while collaborating with a talented team of data and analytics professionals. You will deliver AI solutions on Databricks, from data pipelines to agents in production.

Your key responsibilities

In this role, you will contribute significantly to the delivery of innovative AI solutions. You will work with a wide variety of clients to deliver modern AI engineering, machine learning, and generative AI technologies. Your teams will design and build scalable solutions that unify, enrich, and derive insights from varied data sources across a broad technology landscape. You will help our clients navigate the complex world of modern data science, analytics, and software engineering. We'll look to you to provide guidance and perform technical development tasks to ensure AI solutions are responsibly engineered, evaluated, deployed, and maintained to support the ongoing business needs of our clients.

You will be joining a dynamic and interdisciplinary team of scientists and engineers who love to tackle the most challenging computational problems for our clients. We love to think creatively, build applications efficiently, and collaborate in both the ideation of solutions and the pursuit of new opportunities. Many on our team have advanced academic degrees or equivalent experience in industry.

You will spend your time on key responsibilities that include:

• Researching and implementing scalable machine learning, generative AI, and agentic systems that meet business requirements

• Building data engineering pipelines, AI solutions (machine learning, generative AI, and agentic AI), and the pipelines that support AI solutions on Databricks

• Evaluating, monitoring, and optimizing learning processes on Databricks to improve high-performance models, with tools like MLflow evaluation and tracing

• Designing, building, and governing domain ontologies and semantic models that define business concepts, relationships, and rules for AI solutions, knowledge graphs, and enterprise data products

• This position may have travel requirements as needed to engage with external clients regularly

Skills and attributes for success

To excel in this role, you will need a blend of technical expertise and interpersonal skills. Your ability to navigate complex challenges and deliver impactful solutions will be essential.

This role will work to deliver tech at speed, innovate at scale and put humans at the center. Provide technical guidance and share knowledge with team members with diverse skills and backgrounds. Consistently deliver quality client services focusing on more complex, judgmental and/or specialized issues surrounding emerging technology. Demonstrate technical capabilities and professional knowledge. Learn about EY and its service lines and actively assess and present ways to apply knowledge and services.

• Translating AI strategy into a implementable Model Engineering activities that aligns with the client’s goals, mission and vision

• Working with teams of AI engineers, data engineers, and data scientists to deliver production-grade data engineering pipelines and AI solutions—including machine learning, generative AI, and agentic AI—for clients on Databricks

• Implementing product-centric AI solutions on Databricks, from discovery and roadmap definition through iterative delivery, adoption, and continuous improvement, with measurable business and user outcomes

• Working across design, build, deploy, and operate phases to deliver production-grade data and AI pipelines, including governed business ontologies and semantic models on Databricks, so solutions remain reliable, reusable, and aligned with client business processes

• Applying a product-centric development approach to data and AI solutions by defining user outcomes, prioritizing reusable capabilities, managing roadmaps and backlogs, incorporating user feedback, measuring adoption and business value, and continuously improving products after launch

• Staying abreast of AI technology trends and provide directional guidance and recommendations around AIOps, MLOps, and AgentOps tools and solutions on Databricks that fit their needs and integrate with their existing ecosystem

• Applying combined business and technical knowledge to develop and execute ModelOps target architecture on Databricks that enables implementation and monitoring of AI at scale, with tools like Unity Catalog and Model Serving

• Collaborating with Data Scientists, Data Engineers, Cloud Engineers, and Platform Engineers, DevOps to implement and sustain solutions in the Databricks platform

• Understanding clients’ overall data, AI and technology landscape and business priorities and success measures

• Strong team collaboration and experience working with a diverse team in a hybrid model (on site and remote)

• Working on large-scale client engagements. Fostering relationships with client personnel at appropriate levels. Consistently delivering quality client services. Driving high-quality work products within expected timeframes and on budget

• Collaborating, influencing and building consensus through constructive relationships and effective listening

• Solving problems by incorporating data into decision making

To qualify for the role, you must have:

1. A Bachelor’s degree required (4-year degree).

2. 3-6 years of full-time working experience in AI and/or Machine Learning

3. Databricks Certification with a minimum of 1 professional and 1 associate certification that includes a combination of Data Engineer Associate or Professional, Machine Learning Associate or Professional, Generative AI Engineer Associate, and/or Context Engineering Associate

4. Strong skills in Python, PySpark, and/or Scala

5. Ability to collaborate and communicate effectively with diverse, hybrid, and global teams.

6. Experience designing, building, and maintaining high-impact, high-value production AI/ML solutions on a major cloud platform using Databricks

7. At least two years of experience building and deploying production AI/ML solutions on Databricks, including experience with Agent Bricks, Model Serving, or Lakeflow Jobs.

8. Delivered models or agents to production on Databricks, with tracking, evaluation, and monitoring.

9. Proficient in foundation models, generative AI, and agentic AI frameworks (e.g., Retrieval Augmented Generation (RAG)) and experienced with ML packages like scikit-learn and PyTorch, using Databricks tools including Agent Bricks, AI Search, Foundation Model APIs, and Unity Gateway

10. Experience with natural language processing and deep learning

11. Extensive experience in DevOps tools (Git, Azure DevOps) and AI-driven SDLC for developing, deploying, and scaling analytical solutions on Databricks, for example with Databricks Git folders, Declarative Automation Bundles, and the Databricks CLI and SDKs

12. Experience with MLOps, LLMOps, and AgentOps and ML workflows on Databricks, including data ingestion, transformation, and evaluation, for example with MLflow, Models in Unity Catalog, and Model Serving

13. Experience with model retraining and feedback loop methodologies on Databricks, for example with Lakeflow Jobs and Databricks Feature Store

14. Experience evaluating and operating models and AI solutions on Databricks, including observability, monitoring, reporting, MLflow evaluation and tracing, and data quality monitoring.

15. Understanding of data structures, Responsible AI practices, and data modelling, and software engineering best practices

16. Strong foundation in mathematics, statistics, and operations research, with proficiency in data manipulation tools (SQL, Pandas, Spark) and deep learning techniques, using Databricks tools such as Databricks SQL and Delta Lake, using Databricks tools such as Databricks SQL and Delta Lake.

17. Excellent communication skills for conveying findings and recommendations, with willingness to travel as needed for client engagements.

Ideally, you’ll also have:

• Master's degree Computer Science, Mathematics, Physical Sciences, or another quantitative field

• Databricks Solution Architect Champion Badge preferred

• Experience in hybrid collaboration and emotional agility

• A track record of working with diverse teams to drive outcomes through complex problem-solving of working with diverse teams to drive outcomes through complex problem-solving

• Knowledge of sustainability practices in technology

• A deep understanding of and ability to teach concepts, tools, features, functions, and benefits of different approaches to apply them

• Experience fine-tuning Generative AI models on Databricks, including with AI Runtime (serverless GPU)

• Experience with image processing techniques and/or speech and audio processing and analysis

What we look for

We seek individuals who are not only technically proficient but also possess the qualities of a top performer. You should be innovative, adaptable, and purpose driven by a desire to make a significant impact in the field of artificial intelligence. Your ability to collaborate effectively and communicate with clarity will set you apart as a leader in our team.

What we offer you

At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers .

• The salary range for this job is:

• New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices – $128,400 to $192,500

• Bay Area California offices – $133,600 to $200,600

• All other offices locations in the US, including Sacramento – $106,900 to $176,500

• Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.

Are you ready to shape your future with confidence? Apply today.

• To make the most of your application experience, please limit yourself to two applications within a six-month period.

• EY accepts applications for this position on an on-going basis.

• For those living in California, please click here for additional information.

• At EY, our values set the foundation for how we work and the behaviors we expect of our people. Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

All in to shape the future with confidence.

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.

EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at [email protected] .