financial-risk-assessment

This environment assesses a model's ability to identify and quantify financial risks based on provided company data. It evaluates understanding of financial statements and market indicators.

Overview

Domain: finance Base Class: SingleTurnEnv Difficulty: medium Task: The model must analyze a company's financial profile and market context to determine its overall risk level (low, medium, high).

Quickstart

Installation

uv run vf-install financial-risk-assessment

Usage

import verifiers as vf

env = vf.load_environment("financial-risk-assessment")
results = env.evaluate_sync(
    client=vf.OpenAI(),
    model="gpt-4.1-mini",
    num_examples=10,
    rollouts_per_example=1
)

Evaluation

Run an evaluation with default settings:

uv run vf-eval financial-risk-assessment

Configure model and sampling:

uv run vf-eval financial-risk-assessment \
  -m gpt-4.1-mini \
  -n 20 -r 3 -t 1024 -T 0.7

Environment Arguments

Arg	Type	Default	Description
`num_examples`	int	1000	Number of training examples
`num_eval_examples`	int	100	Number of evaluation examples
`seed`	int	42	Random seed for reproducibility

Metrics

Metric	Meaning
`reward`	Primary reward signal
`format_reward`	Format adherence reward (if applicable)

About

Generated by synthetic-rl-env-creator.

Tags: finance