Retrieval-Augmented Generation (RAG)

Experience RAG in just a few minutes with free LLM model inference on NVIDIA GPU!
Follow the 1~5 steps below, then run this Colab.




Step 1. Go to the Try NVIDIA NIM APIs page, then choose Login at the top right to log in or register (corporate/school Email is recommended):




Step 2. On the home page, click on the Models tag to select one of the available models, or find the desired model through the Search bar (ex. mistralai/mistral-nemotron):




Step 3. Click on the View Code to view the details of the modeal




Step 4. Copy the API Key (or generate a new one) and keep it; we will use this API later to perform inference through the NVIDIA Cloud-based LLM:




Step 5. Open colab and make sure you select Runtime > Change runtime type > T4 GPU.






Step 5. Paste your API Key into the cell at the beginning of the notebook, and then run the cell to access the Model on NGC: