Using 1,000 Windows PE binaries, the effort measured how often the model cleared benign samples, flagged malware, or chose escalation. After looking at about 40 functions per binary, the best model scored a strict balanced accuracy of 0.805 and a triage‑balanced accuracy of 0.855. Roughly 65 % of malware were flagged, 12 % were escalated, and 94 % of benign samples were cleared.
When the same models were run on larger binaries, recall dropped from about 0.78 in the smallest size group to roughly 0.33 in the largest, while high‑specificity models kept their ability to avoid false positives. This shows that the system’s performance is uneven across file sizes, underscoring the need for size‑aware thresholds.
In short, the study demonstrates that current large‑language models can help automate binary triage under a fixed evidence budget, but their effectiveness is limited for larger files and depends on careful tuning of seed‑count limits.