Core Research
Resonance Metrics (R_m)
Quantifying Human-AI Alignment
The Resonance Metric ($R_m$) is a composite score designed to measure the depth and authenticity of alignment between a human participant and an AI agent. It moves beyond simple accuracy to capture the qualitative essence of the interaction.
The R_m Formula
R_m = ((V_align * w1) + (C_hist * w2) + (S_match * w3)) / (1 + δ_entropy)
Note: Components are weighted and normalized to produce the final resonance score.
Metric Components
- Vector Alignment (V_align)Measures semantic similarity between embeddings.
- Contextual Continuity (C_hist)Evaluates overlap and flow with the conversation history.
- Semantic Mirroring (S_match)Analyzes vocabulary and tonal alignment between parties.
- Entropy (δ_entropy)Captures the perplexity or confidence level of the LLM response.
Weight Tuning
The weights (w1, w2, w3) are configurable based on the specific domain or interaction type. For example, a creative collaboration might prioritize S_match, while a technical specification might favor V_align.
Default weights:
w1 (Vector) = 0.5
w2 (Context) = 0.3
w3 (Semantic) = 0.2
w1 (Vector) = 0.5
w2 (Context) = 0.3
w3 (Semantic) = 0.2
Calculating Resonance
Python Reference Implementationdef calculate_resonance(user_input: str, ai_response: str, conversation_history: list) -> float:
"""
Calculates the composite R_m score for a single interaction.
"""
# 1. Calculate base components
V_align = calculate_vector_alignment(user_input, ai_response)
C_hist = calculate_contextual_continuity(ai_response, conversation_history)
S_match = calculate_semantic_mirroring(user_input, ai_response)
# 2. Calculate entropy (delta_entropy)
# Placeholder for actual perplexity calculation
delta_entropy = calculate_entropy(ai_response)
# 3. Apply weights
w1, w2, w3 = 0.5, 0.3, 0.2
# 4. Compute final R_m score
# Note: High entropy reduces resonance, so we divide by (1 + entropy)
# or subtract entropy penalty. The formula below maximizes alignment.
denominator = (V_align * w1) + (C_hist * w2) + (S_match * w3)
R_m = denominator / (1 + delta_entropy)
return R_m