Quick Start
Start using LLMs in just 2 steps with Lamini!
1. Authenticate
First, get <YOUR-LAMINI-API-KEY>
at https://app.lamini.ai/account. Need help? Check out API Auth.
2. Run inference
Next, run Lamini:
Install the Python SDK.
Run an LLM with a few lines of code.
Run an LLM with one CURL command.
curl --location "https://api.lamini.ai/v1/completions" \
--header "Authorization: Bearer $LAMINI_API_KEY" \
--header "Content-Type: application/json" \
--data '{
"model_name": "meta-llama/Meta-Llama-3.1-8B-Instruct",
"prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>\n\nHow are you?<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
}'
Expected Output
That's it! 🎉
Now you can try:
- Learn more about the prompt, model, and output type.
- Output multiple values in structured JSON.
- Batching your inference calls to get high throughput.
- Run applications like RAG (Retrieval Augmented Generation).