Adicionar README.md
This commit is contained in:
@@ -0,0 +1,255 @@
|
|||||||
|
# PJM/IA – Police Interview Emotion Analysis System
|
||||||
|
|
||||||
|
## Overview
|
||||||
|
|
||||||
|
PJM/IA is an intelligent support platform designed to assist criminal investigators during interviews and interrogations through multimodal emotion analysis.
|
||||||
|
|
||||||
|
The system combines multiple Artificial Intelligence approaches to analyze emotional behavior from:
|
||||||
|
|
||||||
|
- Facial expressions (FER – Facial Emotion Recognition)
|
||||||
|
- Voice tone (SER – Speech Emotion Recognition)
|
||||||
|
- Natural language sentiment analysis
|
||||||
|
|
||||||
|
In addition to emotion analysis, the platform automates the administrative workflow associated with interviews by generating official reports automatically and producing annotated multimedia evidence.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Main Features
|
||||||
|
|
||||||
|
### Emotion Recognition
|
||||||
|
|
||||||
|
- Facial Emotion Recognition (FER)
|
||||||
|
- Speech Emotion Recognition (SER)
|
||||||
|
- Sentiment Analysis using NLP
|
||||||
|
|
||||||
|
### Automatic Documentation
|
||||||
|
|
||||||
|
- Automatic generation of:
|
||||||
|
- Complaint Reports
|
||||||
|
- Witness Examination Reports
|
||||||
|
- Defendant Interrogation Reports
|
||||||
|
- Automatic PDF report generation
|
||||||
|
- Automatic transcription of interview audio into text
|
||||||
|
|
||||||
|
### Multimedia Processing
|
||||||
|
|
||||||
|
- Video analysis
|
||||||
|
- Audio analysis
|
||||||
|
- Live camera streaming analysis
|
||||||
|
|
||||||
|
### Evidence Generation
|
||||||
|
|
||||||
|
- Annotated interview videos
|
||||||
|
- Emotion timeline tracking every 10 seconds
|
||||||
|
- Structured interview archive system
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# System Architecture
|
||||||
|
|
||||||
|
The application is divided into modular components:
|
||||||
|
|
||||||
|
| Module | Description |
|
||||||
|
|---|---|
|
||||||
|
| FER | Facial expression emotion recognition |
|
||||||
|
| SER | Voice emotion analysis |
|
||||||
|
| NLP | Sentiment analysis from speech transcription |
|
||||||
|
| Document Engine | Automatic report generation |
|
||||||
|
| Streaming Engine | Real-time camera processing |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Supported Inputs
|
||||||
|
|
||||||
|
## Video Formats
|
||||||
|
|
||||||
|
- `.mp4`
|
||||||
|
- `.avi`
|
||||||
|
- `.mov`
|
||||||
|
|
||||||
|
## Audio Formats
|
||||||
|
|
||||||
|
- `.mp3`
|
||||||
|
- `.wav`
|
||||||
|
- `.ogg`
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Technical Requirements
|
||||||
|
|
||||||
|
| Component | Minimum | Recommended |
|
||||||
|
|---|---|---|
|
||||||
|
| RAM | 8GB | 16GB |
|
||||||
|
| Operating System | Windows XP | Windows 10+ |
|
||||||
|
| Camera | USB Camera | USB Camera |
|
||||||
|
| Microphone | USB Microphone | USB Microphone |
|
||||||
|
| Storage | 5GB | SSD Recommended |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Installation
|
||||||
|
|
||||||
|
## Windows Installation
|
||||||
|
|
||||||
|
Run:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
PJM_IA_Installer.exe
|
||||||
|
```
|
||||||
|
|
||||||
|
Follow the installation wizard until completion.
|
||||||
|
|
||||||
|
The installer will:
|
||||||
|
|
||||||
|
- Install the application
|
||||||
|
- Create the required directories
|
||||||
|
- Generate a desktop shortcut
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Authentication
|
||||||
|
|
||||||
|
Default credentials for testing purposes:
|
||||||
|
|
||||||
|
```txt
|
||||||
|
Username: kl3z
|
||||||
|
Password: 12345
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Usage
|
||||||
|
|
||||||
|
## 1. Load Subject Information
|
||||||
|
|
||||||
|
The investigator must first load:
|
||||||
|
|
||||||
|
- Citizen Card (CC)
|
||||||
|
or
|
||||||
|
- Military Registration Sheet (FM)
|
||||||
|
|
||||||
|
This information is mandatory.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 2. Configure Interview Metadata
|
||||||
|
|
||||||
|
Optional metadata:
|
||||||
|
|
||||||
|
- Interviewer
|
||||||
|
- Date
|
||||||
|
- Time
|
||||||
|
- Location
|
||||||
|
- City
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 3. Choose Analysis Mode
|
||||||
|
|
||||||
|
### Video Analysis
|
||||||
|
|
||||||
|
Processes prerecorded interrogation videos.
|
||||||
|
|
||||||
|
### Audio Analysis
|
||||||
|
|
||||||
|
Processes audio recordings.
|
||||||
|
|
||||||
|
### Live Streaming
|
||||||
|
|
||||||
|
Processes live camera input in real-time.
|
||||||
|
|
||||||
|
Press:
|
||||||
|
|
||||||
|
```txt
|
||||||
|
Q
|
||||||
|
```
|
||||||
|
|
||||||
|
to stop recording.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Generated Output
|
||||||
|
|
||||||
|
After processing, the system generates:
|
||||||
|
|
||||||
|
- Official PJM Word reports
|
||||||
|
- PDF summary report
|
||||||
|
- Full interview transcription
|
||||||
|
- Emotion analysis reports
|
||||||
|
- Annotated video files
|
||||||
|
|
||||||
|
All files are stored automatically in:
|
||||||
|
|
||||||
|
```txt
|
||||||
|
/Corpus/<CC>_<DATE>_<TIME>/
|
||||||
|
```
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
```txt
|
||||||
|
12345678_2026-05-20_15-30-00
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Interview Analysis
|
||||||
|
|
||||||
|
The system performs emotion tracking every 10 seconds and correlates:
|
||||||
|
|
||||||
|
- Facial expressions
|
||||||
|
- Vocal tone
|
||||||
|
- Speech sentiment
|
||||||
|
|
||||||
|
This allows investigators to identify emotional variations throughout the interview.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Technologies Used
|
||||||
|
|
||||||
|
- Python
|
||||||
|
- OpenCV
|
||||||
|
- NLP
|
||||||
|
- Speech Recognition
|
||||||
|
- Machine Learning
|
||||||
|
- Facial Recognition
|
||||||
|
- Emotion Classification
|
||||||
|
- Audio Signal Processing
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Research Context
|
||||||
|
|
||||||
|
This project was developed as an AI-assisted criminal investigation support tool focused on:
|
||||||
|
|
||||||
|
- Interview enhancement
|
||||||
|
- Behavioral analysis
|
||||||
|
- Automated documentation
|
||||||
|
- Multimodal emotion recognition
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Disclaimer
|
||||||
|
|
||||||
|
This project is intended for research and investigative support purposes only.
|
||||||
|
|
||||||
|
Emotion recognition systems should not be considered definitive indicators of deception or guilt.
|
||||||
|
|
||||||
|
Human supervision and professional investigative procedures remain essential.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Future Improvements
|
||||||
|
|
||||||
|
- GPU acceleration
|
||||||
|
- Real-time dashboard
|
||||||
|
- Advanced speaker diarization
|
||||||
|
- Multi-camera support
|
||||||
|
- AI-assisted interrogation insights
|
||||||
|
- Deepfake detection integration
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# License
|
||||||
|
|
||||||
|
Private / Research Project
|
||||||
|
|
||||||
Reference in New Issue
Block a user