Llama 3.1 8B Instruct
meta-llama/Llama-3.1-8B-Instruct
A hosted text generation model - call it over an OpenAI-compatible API, no GPU to run.
price
$0.0833
/ 1M tokens
call it
# rerank documents by relevance; billed per document curl https://gigarouter.ai/v1/rerank \ -H "Authorization: Bearer $GR_KEY" \ -d '{"model":"meta-llama/Llama-3.1-8B-Instruct","query":"capital of France", "documents":["Paris is the capital of France.","Bananas are yellow."]}'
try it live
runs the real hosted model on a shared demo allowance · get your own key + $25 free →