Introduction — LLMs on NRP

Teaching: 25 min · Exercises: 0 min · Total: 25 min

Overview

The National Research Platform (NRP) makes large language models available to the entire US-CMS community through a managed, OpenAI-compatible inference endpoint. You do not need to rent cloud credits, install model weights, or request a GPU — you just point any OpenAI-compatible tool at NRP's URL and authenticate with a personal token.

This lesson covers what is available, how to get access, and the different ways you can interact with the models.

What NRP Provides

NRP exposes two complementary AI/LLM resources:

1. Managed LLM Service

A rotating catalog of open-weights models hosted on NRP GPUs, reachable two ways:

• Programmatically, behind a single OpenAI-compatible REST endpoint:

`` https://ellm.nrp-nautilus.io/v1 ``

You authenticate with a bearer token (see Getting Access below). The endpoint speaks the OpenAI API, so any tool that supports a custom base_url works out of the box.

• In the browser, via Open WebUI, signed in with your NRP/CERN account — no API token needed. Useful for quick experiments and sharing demos with collaborators.

Currently available models (see live list):

Evaluating models are under active testing — configuration can change without notice; stick to the others for anything you need to be stable through the workshop.

Models occasionally restart or roll over to a new version — check what's currently up at the LLM status dashboard.

2. Bring-Your-Own GPU

For workloads requiring full model control — custom weights, fine-tuning, custom quantization, or private inference — you can request your own GPU pod in your namespace and run any inference server (vLLM, TGI, Ollama, etc.). This is covered in other NRP training sessions.

Getting Access

Step 1: NRP Account

You need an NRP account associated with your institutional credentials (CERN SSO works for CMS members). If you don't have one yet, follow Getting Started with NRP.

For this training, you should be a member of the us-cms namespace. Contact the training organizers if you have not been added.

Step 2: Get an API Token

Go to https://nrp.ai/llmtoken and click Get LLM token. A personal bearer token will be sent to your email or displayed on the page.

Whether you're on the NRP USCMS Analysis Facility or your own machine, export your own personal token and the endpoint URL yourself:

export OPENAI_API_BASE="https://ellm.nrp-nautilus.io/v1"
export OPENAI_API_KEY="<paste-your-token-here>"

Setting these from inside a notebook works a little differently — see the setup check at the start of Lesson 2.

Step 3: Verify Access

From a terminal (JupyterHub terminal or local machine with curl), send a real chat request — this actually exercises the model, not just the endpoint, so it's a more meaningful check than listing models:

curl -s -X POST "$OPENAI_API_BASE/chat/completions" \
     -H "Authorization: Bearer $OPENAI_API_KEY" \
     -H "Content-Type: application/json" \
     -d '{"model": "minimax-m2", "messages": [{"role": "user", "content": "Where is the CMS experiment located?"}]}'

You should get back a JSON response with a real answer buried in it (something about CERN, near Geneva, on the LHC).

For a cleaner look, pipe it through Python to pull out just the reply text:

curl -s -X POST "$OPENAI_API_BASE/chat/completions" \
     -H "Authorization: Bearer $OPENAI_API_KEY" \
     -H "Content-Type: application/json" \
     -d '{"model": "minimax-m2", "messages": [{"role": "user", "content": "Where is the CMS experiment located?"}]}' \
  | python3 -c 'import json, sys; print(json.load(sys.stdin)["choices"][0]["message"]["content"])'

You can also list the full model catalog:

curl -s -H "Authorization: Bearer $OPENAI_API_KEY" \
     "$OPENAI_API_BASE/models" \
  | python3 -m json.tool | head -20

Entry Points at a Glance

How to Get Help

• NRP support chat (Slack / Matrix): https://nrp.ai/contact/
• NRP documentation: https://nrp.ai/documentation/
• LLM-specific docs: https://nrp.ai/documentation/userdocs/ai/llm-managed/

Run the Notebooks

You can run the notebooks for this training either on the NRP US-CMS Analysis Hub or on your own machine locally — the Analysis Hub is recommended since the packages are already installed for you. You'll still need your own personal API token either way (see Getting Access above).