Skip to content

Hallucination Detector is a free and open-source tool that helps you verify the accuracy of your LLM generated content instantly.

Notifications You must be signed in to change notification settings

dcsan/exa-hallucination-detector

 
 

Repository files navigation

🔍 Hallucinations Detector

Powered by Exa.ai - The Search Engine for AIs

Screenshot


🎯 What is Hallucinations Detector?

Hallucinations Detector is a free and open-source tool that helps you verify the accuracy of your content instantly. Think of it as Grammarly, but for factual accuracy instead of grammar. It analyzes your content, identifies potential inaccuracies, and suggests corrections backed by reliable web sources.


✨ Key Features

  • Real-time fact checking of your LLM generated content
  • Source-backed verification
  • Detailed explanations for identified inaccuracies
  • Suggestion-based corrections

🛠️ How It Works

  1. Claim Extraction: When you input your content, the tool uses an LLM (Claude 3.5 Sonnet) to break down your text into individual claims.

  2. Source Verification: Each claim is checked using Exa’s search tool to find reliable sources online that either support or refute it.

  3. Accuracy Analysis: The claims and their corresponding sources are analyzed by our LLM to determine their accuracy.

  4. Results Display: Finally, we show the results in a simple, clear way, pointing out any mistakes and offering suggestions to fix them.


💻 Tech Stack


🚀 Getting Started

Prerequisites

  • Node.js
  • API keys for Exa.ai and Anthropic

Installation

  1. Clone the repository
git clone https://github.com/exa-labs/exa-hallucination-detector.git
cd exa-hallucination-detector
  1. Install dependencies
npm install
# or
yarn install
  1. Set up environment variables Create a .env.local file in the root directory and add your API keys:
EXA_API_KEY=your_exa_api_key
ANTHROPIC_API_KEY=your_anthropic_api_key
  1. Run the development server
npm run dev
# or
yarn dev
  1. Open http://localhost:3000/hallucination-detector in your browser

🔑 API Keys


⭐ About Exa.ai

This project is powered by Exa.ai, a cutting-edge search engine designed specifically for AI applications. Exa provides:

  • Advanced semantic and keyword-based search capabilities

  • Instant retrieval of clean web content

  • Customizable search parameters

  • Similarity search using URLs or text

  • Superior search capabilities compared to traditional search APIs

Try Exa search



Built with ❤️ by team Exa

About

Hallucination Detector is a free and open-source tool that helps you verify the accuracy of your LLM generated content instantly.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 90.6%
  • CSS 8.6%
  • JavaScript 0.8%