How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "adowu/astral-demo-2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "adowu/astral-demo-2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker
docker model run hf.co/adowu/astral-demo-2
Quick Links

astral-demo-2

Overview

astral-demo-2 is a streamlined language model designed for quick demonstrations and insights into NLP capabilities, focusing on text generation and analysis.

Features

  • Efficient Text Generation: Quickly produces text for a variety of applications.
  • Compact and Fast: Optimized for speed, making it ideal for demos and prototyping.
  • Prototype Development: Tests ideas in conversational AI and content generation.

Performance

Balances performance with accuracy, providing a practical demonstration of NLP technology in action.

  • Developed by: aww
  • Model type: Mistral
Downloads last month
6
Safetensors
Model size
7B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support