How it works
A worker proves itself on your own past work before it touches live work.
Stage 1: Backtest
A test on work your team already finished. The worker redoes it, and we compare its answers with your experts', insurer by insurer. You get a backtest report.
Stage 2: Side by side
For a few weeks the worker does live work next to your team. Your team's answers still go out.
Stage 3: Live
Accepted fields go out without a check, under the error limit we agree. Fields marked Check go to your reviewer. A monthly report shows mistakes found later and any credit.
What we need
- Read-only access to a few past months of finished work, with the documents your team used.
- An Azure account where the worker runs.
- A reviewer for the review queue.
- Agreement on the error limit and the credit per wrong field.
Questions
- How many fields skip review today?
- In the October backtest, 8.4% of fields: maximums and deductibles. Everything else goes to your reviewer.
- What is not measured yet?
- Reviewer minutes and live results. The October numbers were also used while we tuned Vera; next month's check is the fresh test.
- Which workers are ready?
- Ready: Vera. Being built and tested, with no numbers until their backtests: Cass and Otto.