Sherlock is a state-of-the-art cybersecurity platform designed to detect synthetic media manipulation. By combining Visual Artifact Analysis (EfficientNet) with Audio Spectral Analysis (MFCC/CNN), Sherlock provides a robust defense against deepfakes.
The system is built with a Security-First architecture, featuring an Edge Gateway that sanitizes and validates requests before they reach the core inference engine.
| Feature | Description |
|---|---|
| 👁️ Multi-Modal Detection | Analyzes both Video (visual artifacts) and Audio (voice synthesis) concurrently. |
| 🛡️ Edge Security | Protected by a Cloudflare Worker gateway that handles Auth, Rate Limiting, and Validation. |
| ⚡ Real-Time Inference | Optimized PyTorch pipeline delivering sub-second frame analysis. |
| 📊 Cyber Dashboard | Modern, dark-mode React/Next.js interface for visualization and reporting. |
| 🔍 Explainable AI | Provides confidence scores for both visual and audio components. |
- Framework: Next.js 14 (App Router)
- Styling: Tailwind CSS, Framer Motion
- Theme: Cyberpunk / Dark Mode
- Platform: Cloudflare Workers
- Language: TypeScript
- Functions: JWT Verification, Rate Limiting
- Framework: FastAPI
- ML Core: PyTorch, TorchVision, Torchaudio
- Processing: OpenCV, Librosa, NumPy
- Python 3.10+
- Node.js 18+
- FFmpeg (Installed and in system PATH)
cd backend
pip install -r requirements.txt
python app/main_api.pyServer will start on
http://localhost:8000
cd edge
npm install
npx wrangler devGateway will start on
http://localhost:8787
cd frontend
npm install
npm run devUI will be available at
http://localhost:3000
You can test the full pipeline using the included integration script or the Web UI.
Option A: Web UI
- Open
http://localhost:3000. - Drag & Drop a video file (MP4/AVI).
- Click ANALYZE MEDIA.
Option B: CLI Test
# Generates a dummy video and sends it through the pipeline
python integration_test.pySherlock/
├── 📂 backend/ # Python ML Engine
│ ├── 📂 app/ # Application Code
│ │ ├── 📂 core/ # Detection Logic
│ │ ├── 📂 services/ # Model & Processor Services
│ │ └── 📂 api/ # FastAPI Endpoints
│ └── main_api.py # Entry Point
│
├── 📂 edge/ # Cloudflare Worker
│ ├── 📂 src/ # Worker Logic (Auth/Proxy)
│ └── wrangler.toml # Edge Config
│
└── 📂 frontend/ # Next.js Dashboard
├── 📂 components/ # React UI Components
└── 📂 app/ # Pages & Layouts
Distributed under the MIT License. See LICENSE for more information.
Built for the future of Cybersecurity.
Developed with ❤️ by Onur Kolay