Skip to main content
The simplest way to generate text—returns just the response string.

When to Use

Use chat() when you:
  • Need a quick response without metrics
  • Don’t need streaming
  • Want the simplest possible API

Requirements

Before calling chat(), ensure:
  1. SDK is initialized: await RunAnywhere.initialize()
  2. Backend is registered: await LlamaCpp.register()
  3. Model is loaded: await RunAnywhere.loadModel('model-id')

Example with Error Handling

See Also

generate()

Get response with metrics

generateStream()

Stream tokens in real-time