Overview
The RunAnywhere React Native SDK is a production-grade, on-device AI SDK for React Native applications. It enables developers to run AI models directly on iOS and Android devices without requiring network connectivity for inference, ensuring minimal latency and maximum privacy for your users. The SDK provides a unified interface to multiple AI capabilities:LLM
Text generation with streaming support via async iterators
STT
Speech-to-text transcription with Whisper models
TTS
Neural voice synthesis with Piper TTS
VAD
Real-time voice activity detection with Silero VAD
Key Capabilities
- Multi-backend architecture – Choose from LlamaCPP (GGUF models) or ONNX Runtime
- Cross-platform – Single codebase for iOS and Android
- TypeScript-first – Full type safety and IDE autocomplete
- Production-ready – Built-in analytics, logging, and model lifecycle management
Core Philosophy
On-Device First
On-Device First
All AI inference runs locally, ensuring low latency and data privacy. Once models are
downloaded, no network connection is required for inference.
Modular Architecture
Modular Architecture
Backend engines are optional packages—include only what you need. This keeps your app bundle
size minimal.
Privacy by Design
Privacy by Design
Audio and text data never leaves the device unless explicitly configured. Only anonymous
analytics are collected by default.
Platform Parity
Platform Parity
API mirrors the iOS Swift SDK and Android Kotlin SDK for consistent cross-platform development.
Features
Language Models (LLM)
- On-device text generation with streaming support
- Async iterator-based token streaming
- System prompts and customizable generation parameters
- Support for thinking/reasoning models
- LlamaCPP backend for GGUF models
Speech-to-Text (STT)
- Real-time streaming transcription
- Batch audio transcription
- Multi-language support
- Whisper-based models via ONNX Runtime
Text-to-Speech (TTS)
- Neural voice synthesis with Piper TTS
- System voices via platform TTS
- Streaming audio generation for long text
- Customizable voice, pitch, rate, and volume
Voice Activity Detection (VAD)
- Energy-based speech detection with Silero VAD
- Configurable sensitivity thresholds
- Real-time audio stream processing
Voice Agent Pipeline
- Full VAD → STT → LLM → TTS orchestration
- Complete voice conversation flow
- Push-to-talk and hands-free modes
System Requirements
| Platform | Minimum Version |
|---|---|
| React Native | 0.71+ |
| iOS | 15.1+ |
| Android | API 24 (7.0+) |
Apple Silicon devices (M1/M2/M3, A14+) and Android devices with 6GB+ RAM are recommended. Metal
GPU acceleration provides 3-5x speedup on iOS.
Multi-Package Architecture
| Package | Purpose |
|---|---|
@runanywhere/core | Core SDK (required) |
@runanywhere/llamacpp | LLM text generation with GGUF models |
@runanywhere/onnx | STT/TTS/VAD via ONNX Runtime |