When to Use
Usechat() when you:
- Need a quick response without metrics
- Don’t need streaming
- Want the simplest possible API
Requirements
Before callingchat(), ensure:
- SDK is initialized:
await RunAnywhere.initialize() - Backend is registered:
await LlamaCpp.register() - Model is loaded:
await RunAnywhere.loadModel('model-id')