wally decisions scores questions with a decision model. It prints a probability
for every answer. wally decide is an alias for the same command.
Two transports, one output. By default (and with --cloud) it asks Eve (eve),
RunAnywhere’s hosted decision model. With --local it scores on your own
machine through an on-device checkpoint, and your text never leaves it.
wally decisions (alias wally decide) sends every request to Eve (eve) by default. You don’t
need to pass a model. Pass --local (or -m with a local checkpoint) to score on-device instead.wally account login). There is no key to set.
The local route needs no sign-in.
Example
Scoring on your machine
--local, Wally loads a decision checkpoint and scores in-process. Two
checkpoints ship: clef-flash-9b (llama.cpp) and clef-flash-mlx (Apple MLX,
macOS only). The first run downloads about 6 GB and offers the pull when the
model is missing; after that it runs offline. Nothing is billed, and the status
line reads:
label_mass), --no-retry is cloud-only, and a model
that isn’t downloaded stops with pull it first with wally models pull <id>
unless you accept the pull offer. With no flags and no --model, Wally asks
once where to score and saves your answer; --route local|cloud sets that
default directly.
Flags
Every flag in the code is in
--help; there are no hidden ones. Wally’s global --json works here too.
- Input. Give exactly one of
--input,--input-fileor piped stdin.--inputand--input-filetogether are refused. With neither, Wally reads stdin if it is not a terminal. - Questions. Mix
--ask,--choiceand--scorefreely, 1 to 128 in all. They are sent in the order given, with idsq1,q2, and so on. - Retries. Without
--no-retry, a429or503is retried, honouringRetry-Afterup to 10 seconds, and an expired sign-in is refreshed once.
Request files
--request takes the exact body of
POST /v1/decisions, with your own question
ids. It is the only way to set prompt_format_version, an option description,
or the yes and no text of a yes/no question.
--request cannot be combined with
--input, --input-file, --ask, --choice, --score, --temperature,
--model, --route, or --image; put those in the file. Images can also be
sent with --image instead of inside the file.