Analysis_Tools

Vulnerability Analysis and Enrichment Tools

Tools for processing CVE records and generating CPE Applicability Statements. Processes CVE data from MITRE and NVD APIs to create interactive HTML reports for CPE matching and configuration generation.

Overview

Understanding the Problem Space:

For comprehensive insight into the challenges this tool addresses, see CPE Automation Challenges.

Dashboard Quick Links:

CPE Applicability Generator

Processes CVE records to generate CPE Applicability Statements:

Ingests CVE information from CVE List and NVD APIs
Extracts CPE attribute values from affected product data
Queries NVD /cpes/ API for matching CPE Names
Processes results to identify relevant CPE Base String values
Generates HTML reports for user review and selection
Produces CPE Applicability Statements (configurations) from selected CPE Base Strings

Documentation

CPE Automation Challenges - Problem domains, solutions, and codebase architecture
Badge and Modal System Reference - Complete badge/modal system documentation
CPE Caching System - Cache configuration and management
Logging System - Structured logging patterns and configuration
Dashboard Usage - Dashboard system and usage
Dataset Generation - Dataset generation methodology and capabilities

Test Documentation

Test Suites Overview - Comprehensive test documentation

Examples

The complete collection of generated pages is maintained at Hashmire/cpeApplicabilityGeneratorPages.

To access a specific CVE analysis page, use the following URL pattern:

https://hashmire.github.io/cpeApplicabilityGeneratorPages/generated_pages/[CVE-ID].html

Note: Not all CVEs are currently present in the dataset.

Usage

Dataset Generation

# Traditional status-based generation
python generate_dataset.py --statuses "Received" "Awaiting Analysis"

# Generate dataset for CVEs modified in the last 30 days
python generate_dataset.py --last-days 30

# Generate dataset for specific date range
python generate_dataset.py --start-date 2024-01-01 --end-date 2024-01-31

All dataset outputs are isolated in run-specific directories under runs/[timestamp]_[context]/logs/.

Alias Mapping Report Generation

# Generate alias extraction report from default NVD-ish cache (standalone)
python -m src.analysis_tool.reporting.generate_alias_report

# Generate report for specific source by name or UUID
python -m src.analysis_tool.reporting.generate_alias_report \
    --source-filter "Microsoft Corporation"

# Generate report using existing run directory from dataset generation
python -m src.analysis_tool.reporting.generate_alias_report \
    --run-id 2025-12-01_10-30-00_dataset_last_7_days_nvd-ish

Reports are generated as per-source files in runs/[timestamp]_alias_report/logs/:

aliasExtractionReport_index.json - Source listing with statistics
aliasExtractionReport_[source]_[id].json - Individual source reports with alias data
Interactive HTML dashboard generated from report JSON files

Source Data Concern Report Generation

# Generate SDC report from default NVD-ish cache (standalone)
python -m src.analysis_tool.reporting.generate_sdc_report

# Generate report using existing run directory from dataset generation
python -m src.analysis_tool.reporting.generate_sdc_report \
    --run-id 2025-12-01_10-30-00_dataset_last_7_days_nvd-ish

Reports are generated as per-source files in runs/[timestamp]_sdc_report/logs/:

sourceDataConcernReport_index.json - Source listing with statistics
sourceDataConcernReport_[source]_[id].json - Individual source reports