Friday, May 3, 2024

Model Garden Vertex Ai , Deploy Llama3 8b to Inference Point #machinelearning #datascience


In this video I will show you what we can do with the models we have in the model garden of Vertex Ai, Then Deploy a LLama3 8B to an Inference Endpoint in Vertex Ai and consume the Inference Endpoint using the python SDK Notebook: https://github.com/olonok69/LLM_Notebooks/blob/main/ml_Solutions/vertex_ai/Request_to_LLama3_deployed.ipynb

No comments:

Post a Comment