Scorer

This document explains the Scorer node, which assigns numerical scores (0-100) to items based on custom criteria.

​

Node Inputs

​

Required Fields

• Item: The content to be scored
• Criteria: Rules for scoring (e.g., “Clarity: 0-30, Grammar: 0-40, Relevance: 0-30”)

​

Optional Fields

• Include Justification: Get AI’s reasoning for scores
• Additional Context: Extra guidance for scoring
• Temperature: Controls scoring consistency (0-1)
• Cache Response: Save responses for reuse

​

Show As Input Options

You can expose these fields as inputs:

• Item
• Criteria
• Additional Context
• Temperature

​

Node Output

• Score: Numerical value between 0-100
• Justification: AI’s scoring explanation (if enabled)

​

Node Functionality

The Scorer node:

• Analyzes content against criteria
• Assigns numerical scores
• Provides scoring rationale
• Handles batch scoring
• Ensures consistent evaluation

​

Available AI Models

• Claude 3.5 Sonnet
• Claude 3 Haiku
• OpenAI o1
• OpenAI o1 mini
• GPT-4o
• GPT-4o Mini
• Gemini 1.5 Pro/Flash
• And more

​

Common Use Cases

1. Content Quality:

Criteria: 
- Writing clarity (0-30)
- Accuracy (0-40)
- Engagement (0-30)

2. Support Responses:

Criteria:
- Politeness (0-25)
- Problem solving (0-50)
- Response time (0-25)

3. Product Reviews:

Criteria:
- Detail level (0-30)
- Helpfulness (0-40)
- Objectivity (0-30)

​

Loop Mode

Input: List of items to score
Process: Score each against criteria
Output: Scores and justifications for each item

​

Important Considerations

1. Expert models (OpenAI o1) cost 30 credits, advanced models (GPT-4o & Claude 3.5) cost 20 credits, and standard models cost 2 credits per run
2. You can drop the credit cost to 1 by providing your own API key under the credentials page
3. Define clear, measurable criteria for accurate output
4. Enable justification for transparency

In summary, the Scorer node helps quantify quality and performance using AI-powered assessment against your custom criteria.