Machine Learning Operations (MLOps) with Vertex AI: Model Evaluation
Machine Learning Operations (MLOps) with Vertex AI: Model Evaluation
This course equips machine learning practitioners with the essential tools, techniques, and best practices for evaluating both generative and predictive AI models. Model evaluation is a critical discipline for ensuring that ML systems deliver reliable, accurate, and high-performing results in production.
Participants will gain a deep understanding of various evaluation metrics, methodologies, and their appropriate application across different model types and tasks. The course will emphasize the unique challenges posed by generative AI models and provide strategies for tackling them effectively. By leveraging Google Cloud's Vertex AI platform, participants will learn how to implement robust evaluation processes for model selection, optimization, and continuous monitoring.
Course Info
Objectives
- Understand the nuances of model evaluation in both predictive and generative AI, recognizing its crucial role within the MLOps lifecycle.
- Identify and apply appropriate evaluation metrics for different generative AI tasks.
- Efficiently evaluate generative AI with Vertex AI's diverse evaluation services, including both computation-based and model-based methods.
- Implement best practices for LLM evaluation, to ensure robust and reliable model deployment in production environments.
Prerequisites
- Proficiency with Python on topics covered in the Crash Course on Python offered by Google.
- Prior experience with foundational machine learning concepts and building machine learning solutions on Google Cloud as covered in the Machine Learning on Google Cloud courses
Available languages
English
What do I do when I finish this course?
After finishing this course, you can explore additional content in your learning path or browse the catalog.
What badges can I earn?
Upon finishing the required items in a course, you will earn a badge of completion. Badges can be viewed on your profile and shared with your social network.
Interested in taking this course with one of our authorized on-demand partners?
Explore Google Cloud content on Coursera and Pluralsight.
Prefer learning with an instructor?
View the public classroom schedule here.
Can I take this course for free?
When you enroll into most courses, you will be able to consume course materials like videos and documents for free. If a course consists of labs, you will need to purchase an individual subscription or credits to be able consume the labs. Labs can also be unlocked by any campaigns you participate in. All required activities in a course must be completed to be awarded the completion badge.