citation validation report

---
layout: raw-data.njk
title: "citation validation report"
---

# DocRef Citation Validation Report

**Generated:** 2025-11-21T08:16:53.265Z
**Document:** ./ConsolidatedStandards/ManualReview/syncopate-draft/1--2025-11-21--en.md

## Executive Summary

| Metric | Count | Percentage |
|--------|-------|------------|
| Total Citations | 493 | 100% |
| Valid (URL exists) | 493 | 100.00% |
| Invalid (URL not found) | 0 | 0.0% |
| Appropriate Citations | 480 | 97.36% |
| Inappropriate Citations | 13 | 2.6% |
| - HIGH severity | 1 | - |
| - MEDIUM severity | 11 | - |
| - LOW severity | 1 | - |

**Source Data:** 9145 unique URLs from 30 JSON files

---

## ✅ INVALID CITATIONS

No invalid citations found. All URLs exist in the JSON database.

---

## ⚠️ POTENTIALLY INAPPROPRIATE CITATIONS (13)

These citations have valid URLs but may not adequately support the statements they're citing.

### 🔴 HIGH Severity (1)

Part/section number mismatches - these are likely errors.

#### 1. Line 101

**Context:** ...**Applicable standards**: You must conform to Federation Assurance Standard, specifically Part 2 - Requirements for Facilitation Providers establishing facilitation mechanisms (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/federation-assurance-standard/2025/en/#part5-title`

**Source ID:** `part5-title`

**Source Content:** "Part 2 — Requirements for Facilitation Providers establishing facilitation mechanisms"

**Issues:**
- Cites title only - may need to cite actual content section instead
- Part number mismatch: text says "Part 2" but URL cites Part 5

**Recommendation:** Correct the part/section number in text or update citation to match intended content.

---

### 🟡 MEDIUM Severity (11)

Title/subtitle citations that may need more specific content references.

#### 1. Line 485

**Context:** ...Design specific processes for groups with limited evidence access (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part4-title`

**Source ID:** `part4-title`

**Source Content:** "Entities with limited evidence"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 2. Line 492

**Context:** ...Strengthen processes when available evidence is unreliable (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part5-title`

**Source ID:** `part5-title`

**Source Content:** "Weak evidence quality"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 3. Line 499

**Context:** ...Prevent individuals from creating multiple identities (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part6-title`

**Source ID:** `part6-title`

**Source Content:** "De-duplication of Entity information"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 4. Line 507

**Context:** ...Strengthen the connection between entities and their information (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part7-title`

**Source ID:** `part7-title`

**Source Content:** "Counter fraud techniques for Binding"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 5. Line 531

**Context:** ...Detect fraudulent authentication attempts through analysis (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part8-title`

**Source ID:** `part8-title`

**Source Content:** "Authentication analytics"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 6. Line 539

**Context:** ...Monitor additional authentication characteristics (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part8-title`

**Source ID:** `part8-title`

**Source Content:** "Authentication analytics"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 7. Line 546

**Context:** ...Build risk profiles using information collected about previous cases to highlight characteristics associated with higher fraud risk (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part9-title`

**Source ID:** `part9-title`

**Source Content:** "Profiling"

**Issues:**
- Cites title only - may need to cite actual content section instead
- Source content very brief (9 chars) for detailed claim (133 chars context)

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 8. Line 550

**Context:** ...Respond appropriately when information doesn't match expectations (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part10-title`

**Source ID:** `part10-title`

**Source Content:** "Dealing with discrepancies"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 9. Line 560

**Context:** ...Protect against insider threats (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/counter-fraud-techniques/2023/en/#part11-title`

**Source ID:** `part11-title`

**Source Content:** "Reducing internal fraud"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 10. Line 2580

**Context:** ...(

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/implementing-the-authentication-assurance-standard/2024/en/#part1-title`

**Source ID:** `part1-title`

**Source Content:** "Introduction"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

#### 11. Line 3474

**Context:** ...(

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/implementing-the-authentication-assurance-standard/2024/en/#part5-title`

**Source ID:** `part5-title`

**Source Content:** "Related advice"

**Issues:**
- Cites title only - may need to cite actual content section instead

**Recommendation:** Consider citing actual content section rather than title. Use MCP server to find more specific citation.

---

### 🔵 LOW Severity (1)

Minor issues that warrant review but may be acceptable.

#### 1. Line 380

**Context:** ...eir effectiveness ([DocRef](https://docref.digital.govt.nz/nz/identification-management/assessing-identification-risk/2025/en/#part3-det5-para1)). Four types of controls contribute to risk reduction (

**Cited URL:** `https://docref.digital.govt.nz/nz/identification-management/assessing-identification-risk/2025/en/#part3-section2-para1`

**Source ID:** `part3-section2-para1`

**Source Content:** "There are 4 types of controls."

**Issues:**
- Source content very brief (30 chars) for detailed claim (200 chars context)

**Recommendation:** Review in context - may be acceptable as-is.

---

## 📊 Citation Distribution by Document

| Document | Total | Valid | Invalid | Inappropriate |
|----------|-------|-------|---------|---------------|
| federation-assurance-standard | 81 | 80 | 0 | 1 |
| identification-terminology | 70 | 70 | 0 | 0 |
| assessing-identification-risk | 53 | 52 | 0 | 1 |
| authentication-assurance-standard | 51 | 51 | 0 | 0 |
| conforming-with-the-identification-standards | 43 | 43 | 0 | 0 |
| information-assurance-standard | 32 | 32 | 0 | 0 |
| levels-of-assurance | 28 | 28 | 0 | 0 |
| implementing-the-federation-assurance-standard | 27 | 27 | 0 | 0 |
| binding-assurance-standard | 26 | 26 | 0 | 0 |
| implementing-the-information-assurance-standard | 24 | 24 | 0 | 0 |
| implementing-the-authentication-assurance-standard | 20 | 18 | 0 | 2 |
| counter-fraud-techniques | 18 | 9 | 0 | 9 |
| implementing-the-binding-assurance-standard | 9 | 9 | 0 | 0 |
| authenticator-types | 3 | 3 | 0 | 0 |
| about-identification-management | 2 | 2 | 0 | 0 |
| dia-distfr | 2 | 2 | 0 | 0 |
| distf | 1 | 1 | 0 | 0 |
| derived-information | 1 | 1 | 0 | 0 |
| using-documents-as-evidence | 1 | 1 | 0 | 0 |
| overview-of-the-identification-standards | 1 | 1 | 0 | 0 |

---

## Next Steps

### Immediate Actions

1. **Fix 1 HIGH severity issues** - Part/section number mismatches (likely errors)
2. **Review 11 MEDIUM severity issues** - Title-only citations

### Using MCP Server for Better Citations

For citations needing replacement, use the MCP server to find better alternatives:

```javascript
// Example: semantic search for better citation
mcp__identification-management-standards__semantic_search({
  query: "specific requirement text",
  limit: 10,
  min_score: 0.8
});
```

---

## Validation Methodology

This validation performs both **validity** and **appropriateness** checks:

### Validity Checks
- URL format and well-formedness
- Fragment ID exists in source JSON data

### Appropriateness Patterns
- **Title-only citations**: Fragment IDs ending in `-title` or `-subtitle`
- **Part/section mismatches**: Text claims differ from URL fragment
- **Short source content**: Very brief source for detailed claims
- **Figure/diagram citations**: Diagrams cited for normative requirements
- **Table header citations**: Header rows cited instead of data rows

**Note:** Automated pattern matching provides initial assessment. Manual review essential for final determination of appropriateness.

---

*Generated by validate-citations.js*