WardrikCore.Retry (wardrik_core v0.1.0-rc.1)

Copy Markdown

Retries model calls and tool calls that fail in a way a retry may fix.

WardrikCore.start_agent(
  agent_id: "triage",
  model: "anthropic:claude-haiku-4-5",
  retries: [attempts: 3, max_wait: :timer.seconds(10), on_exhausted: :fail]
)

Before each retry it waits a random time of up to 1 second, then up to 2, then 4, and so on, capped at :max_wait.

Options

  • :attempts - retries after the first try. 6 unless set.
  • :max_wait - the longest wait, in milliseconds. 60_000 unless set.
  • :on_exhausted - what a model call does once retries run out. :ask waits for a person to say whether to try again (see WardrikCore.Retry.Exhausted). :fail fails the turn. :ask unless set.

What's retried

  • A model call that raised, such as on a timeout, a dropped stream, a rate limit or a 5xx. Not a 4xx other than 408, 425 and 429, and not a call middleware refused.
  • A tool call that raised, crashed or timed out, if its tool is idempotent or read_only.

So a tool should return {:error, reason} for failures a retry won't fix, and raise for those it might.

Summary

Types

t()

An agent's :retries. See the options above.

Functions

attempts(retries)

Returns the number of retries after the first try.

on_exhausted(retries)

Returns what a model call does once retries run out: :ask or :fail.

run(retries, fun, transient, announce)

Runs fun, retrying while transient returns a reason for its answer.

transient?(arg1)

Returns whether a model call that failed with reason may succeed on retry.

Types

t()

@type t() :: keyword()

An agent's :retries. See the options above.

Functions

attempts(retries)

@spec attempts(t()) :: non_neg_integer()

Returns the number of retries after the first try.

on_exhausted(retries)

@spec on_exhausted(t()) :: :ask | :fail

Returns what a model call does once retries run out: :ask or :fail.

run(retries, fun, transient, announce)

@spec run(t(), (-> answer), (answer -> term() | nil), (map() -> any())) ::
  {:ok, answer} | {:spent, answer, pos_integer()}
when answer: term()

Runs fun, retrying while transient returns a reason for its answer.

transient returns nil for an answer that shouldn't be retried. announce is called before each wait. Returns {:ok, answer}, or {:spent, answer, tries} once retries run out.

transient?(arg1)

@spec transient?(term()) :: boolean()

Returns whether a model call that failed with reason may succeed on retry.