OSSJavaLast updated: 2023-08-15
Manual CVE_R
Based on S_M-C after manual review
12.7%
21 / 165 CVEs
OWASP Benchmark F1
49.0%
OWASP Benchmark v1.2 (Java)
Composite score
Manual 60 / F1 30 / (1-FP)10
29.5
Approx.FP: 28.6%
Real-world detections by scenario
Counts (bar) plus percentages (line) per benchmark scenario.
Approximate false positives
#Dvul and #Dvul&Dpatch for S_F-C / S_M-C.
SF-C
60.5%#Dvul = 38, #Dvul&Dpatch = 23
| Dvul | 38 |
| Dvul&Dpatch | 23 |
| Rate | 60.5% |
SM-C
28.6%#Dvul = 21, #Dvul&Dpatch = 6
| Dvul | 21 |
| Dvul&Dpatch | 6 |
| Rate | 28.6% |
Claimed vs measured coverage
Over-claim is computed with the Manual (S_M-C) column.
Over-claim
(#Supported - #Detected) / #Supported
80.4%
Speed notes
Qualitative tier plus study observations.
Tier: mid
Roughly 5-15 min depending on project size
- Run time jumps sharply once projects pass ~50k LoC (all tools).
Manual definition: research teams manually inspected S_M-C detections and removed patch-only hits. Over-claim is evaluated against that Manual baseline.