256 lines
4.3 KiB
Markdown
256 lines
4.3 KiB
Markdown
|
# PJM/IA – Police Interview Emotion Analysis System
|
|||
|
|
|
|||
|
|
## Overview
|
|||
|
|
|
|||
|
|
PJM/IA is an intelligent support platform designed to assist criminal investigators during interviews and interrogations through multimodal emotion analysis.
|
|||
|
|
|
|||
|
|
The system combines multiple Artificial Intelligence approaches to analyze emotional behavior from:
|
|||
|
|
|
|||
|
|
- Facial expressions (FER – Facial Emotion Recognition)
|
|||
|
|
- Voice tone (SER – Speech Emotion Recognition)
|
|||
|
|
- Natural language sentiment analysis
|
|||
|
|
|
|||
|
|
In addition to emotion analysis, the platform automates the administrative workflow associated with interviews by generating official reports automatically and producing annotated multimedia evidence.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## Main Features
|
|||
|
|
|
|||
|
|
### Emotion Recognition
|
|||
|
|
|
|||
|
|
- Facial Emotion Recognition (FER)
|
|||
|
|
- Speech Emotion Recognition (SER)
|
|||
|
|
- Sentiment Analysis using NLP
|
|||
|
|
|
|||
|
|
### Automatic Documentation
|
|||
|
|
|
|||
|
|
- Automatic generation of:
|
|||
|
|
- Complaint Reports
|
|||
|
|
- Witness Examination Reports
|
|||
|
|
- Defendant Interrogation Reports
|
|||
|
|
- Automatic PDF report generation
|
|||
|
|
- Automatic transcription of interview audio into text
|
|||
|
|
|
|||
|
|
### Multimedia Processing
|
|||
|
|
|
|||
|
|
- Video analysis
|
|||
|
|
- Audio analysis
|
|||
|
|
- Live camera streaming analysis
|
|||
|
|
|
|||
|
|
### Evidence Generation
|
|||
|
|
|
|||
|
|
- Annotated interview videos
|
|||
|
|
- Emotion timeline tracking every 10 seconds
|
|||
|
|
- Structured interview archive system
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# System Architecture
|
|||
|
|
|
|||
|
|
The application is divided into modular components:
|
|||
|
|
|
|||
|
|
| Module | Description |
|
|||
|
|
|---|---|
|
|||
|
|
| FER | Facial expression emotion recognition |
|
|||
|
|
| SER | Voice emotion analysis |
|
|||
|
|
| NLP | Sentiment analysis from speech transcription |
|
|||
|
|
| Document Engine | Automatic report generation |
|
|||
|
|
| Streaming Engine | Real-time camera processing |
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Supported Inputs
|
|||
|
|
|
|||
|
|
## Video Formats
|
|||
|
|
|
|||
|
|
- `.mp4`
|
|||
|
|
- `.avi`
|
|||
|
|
- `.mov`
|
|||
|
|
|
|||
|
|
## Audio Formats
|
|||
|
|
|
|||
|
|
- `.mp3`
|
|||
|
|
- `.wav`
|
|||
|
|
- `.ogg`
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Technical Requirements
|
|||
|
|
|
|||
|
|
| Component | Minimum | Recommended |
|
|||
|
|
|---|---|---|
|
|||
|
|
| RAM | 8GB | 16GB |
|
|||
|
|
| Operating System | Windows XP | Windows 10+ |
|
|||
|
|
| Camera | USB Camera | USB Camera |
|
|||
|
|
| Microphone | USB Microphone | USB Microphone |
|
|||
|
|
| Storage | 5GB | SSD Recommended |
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Installation
|
|||
|
|
|
|||
|
|
## Windows Installation
|
|||
|
|
|
|||
|
|
Run:
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
PJM_IA_Installer.exe
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
Follow the installation wizard until completion.
|
|||
|
|
|
|||
|
|
The installer will:
|
|||
|
|
|
|||
|
|
- Install the application
|
|||
|
|
- Create the required directories
|
|||
|
|
- Generate a desktop shortcut
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Authentication
|
|||
|
|
|
|||
|
|
Default credentials for testing purposes:
|
|||
|
|
|
|||
|
|
```txt
|
|||
|
|
Username: kl3z
|
|||
|
|
Password: 12345
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Usage
|
|||
|
|
|
|||
|
|
## 1. Load Subject Information
|
|||
|
|
|
|||
|
|
The investigator must first load:
|
|||
|
|
|
|||
|
|
- Citizen Card (CC)
|
|||
|
|
or
|
|||
|
|
- Military Registration Sheet (FM)
|
|||
|
|
|
|||
|
|
This information is mandatory.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 2. Configure Interview Metadata
|
|||
|
|
|
|||
|
|
Optional metadata:
|
|||
|
|
|
|||
|
|
- Interviewer
|
|||
|
|
- Date
|
|||
|
|
- Time
|
|||
|
|
- Location
|
|||
|
|
- City
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## 3. Choose Analysis Mode
|
|||
|
|
|
|||
|
|
### Video Analysis
|
|||
|
|
|
|||
|
|
Processes prerecorded interrogation videos.
|
|||
|
|
|
|||
|
|
### Audio Analysis
|
|||
|
|
|
|||
|
|
Processes audio recordings.
|
|||
|
|
|
|||
|
|
### Live Streaming
|
|||
|
|
|
|||
|
|
Processes live camera input in real-time.
|
|||
|
|
|
|||
|
|
Press:
|
|||
|
|
|
|||
|
|
```txt
|
|||
|
|
Q
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
to stop recording.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Generated Output
|
|||
|
|
|
|||
|
|
After processing, the system generates:
|
|||
|
|
|
|||
|
|
- Official PJM Word reports
|
|||
|
|
- PDF summary report
|
|||
|
|
- Full interview transcription
|
|||
|
|
- Emotion analysis reports
|
|||
|
|
- Annotated video files
|
|||
|
|
|
|||
|
|
All files are stored automatically in:
|
|||
|
|
|
|||
|
|
```txt
|
|||
|
|
/Corpus/<CC>_<DATE>_<TIME>/
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
Example:
|
|||
|
|
|
|||
|
|
```txt
|
|||
|
|
12345678_2026-05-20_15-30-00
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Interview Analysis
|
|||
|
|
|
|||
|
|
The system performs emotion tracking every 10 seconds and correlates:
|
|||
|
|
|
|||
|
|
- Facial expressions
|
|||
|
|
- Vocal tone
|
|||
|
|
- Speech sentiment
|
|||
|
|
|
|||
|
|
This allows investigators to identify emotional variations throughout the interview.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Technologies Used
|
|||
|
|
|
|||
|
|
- Python
|
|||
|
|
- OpenCV
|
|||
|
|
- NLP
|
|||
|
|
- Speech Recognition
|
|||
|
|
- Machine Learning
|
|||
|
|
- Facial Recognition
|
|||
|
|
- Emotion Classification
|
|||
|
|
- Audio Signal Processing
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Research Context
|
|||
|
|
|
|||
|
|
This project was developed as an AI-assisted criminal investigation support tool focused on:
|
|||
|
|
|
|||
|
|
- Interview enhancement
|
|||
|
|
- Behavioral analysis
|
|||
|
|
- Automated documentation
|
|||
|
|
- Multimodal emotion recognition
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Disclaimer
|
|||
|
|
|
|||
|
|
This project is intended for research and investigative support purposes only.
|
|||
|
|
|
|||
|
|
Emotion recognition systems should not be considered definitive indicators of deception or guilt.
|
|||
|
|
|
|||
|
|
Human supervision and professional investigative procedures remain essential.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# Future Improvements
|
|||
|
|
|
|||
|
|
- GPU acceleration
|
|||
|
|
- Real-time dashboard
|
|||
|
|
- Advanced speaker diarization
|
|||
|
|
- Multi-camera support
|
|||
|
|
- AI-assisted interrogation insights
|
|||
|
|
- Deepfake detection integration
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
# License
|
|||
|
|
|
|||
|
|
Private / Research Project
|
|||
|
|
|