generate() - RunAnywhere Documentation

const result = await RunAnywhere.llm.generate('Name three colours')
console.log(result.text)

Signature

One method takes either a prompt or a conversation:

generate(input: string | ChatMessage[], options?: LlmOptions): Promise<GenerationResult>

With options

const result = await RunAnywhere.llm.generate('Explain quantum computing', {
  model: 'qwen3-0.6b',
  maxOutputTokens: 200,
  temperature: 0.7,
})

Generation auto-loads what it needs, and downloads when options.model names a model that is absent.

LlmOptions

Field	Type	Default
`model`	`string`	none; uses the loaded model
`maxOutputTokens`	`number`	proto default
`temperature`	`number`	proto default
`topP`	`number`	proto default
`systemPrompt`	`string`	none
`stopSequences`	`string[]`	`[]`
`tools`	`ToolDefinition[]`	`[]`
`toolChoice`	`ToolChoice`	`auto`
`maxToolCalls`	`number`	`5`

Structured output

React Native’s generateStructured is generic over the parsed type:

interface Person {
  name: string
  age: number
}

const result = await RunAnywhere.llm.generateStructured<Person>(
  'Extract the name and age: Dana is 34.',
  schema,
  'validationOnly'
)

Mode	Behaviour
`'validationOnly'`	Generate freely, then validate. The default.
`'repair'`	Validate, then retry once with a repair instruction.
`'constrained'`	Throws today.

'constrained' throws. Engine-level constrained decoding is not wired in yet.

Errors

Throws SDKException when no model can be loaded or generation fails.