theseus: extract claims from 2026-04-22-theseus-multilayer-probe-scav-robustness-synthesis
Some checks are pending
Mirror PR to Forgejo / mirror (pull_request) Waiting to run
Some checks are pending
Mirror PR to Forgejo / mirror (pull_request) Waiting to run
- Source: inbox/queue/2026-04-22-theseus-multilayer-probe-scav-robustness-synthesis.md - Domain: ai-alignment - Claims: 0, Entities: 0 - Enrichments: 3 - Extracted by: pipeline ingest (OpenRouter anthropic/claude-sonnet-4.5) Pentagon-Agent: Theseus <PIPELINE>
This commit is contained in:
parent
d7240dfd2e
commit
3ab888bf4e
3 changed files with 21 additions and 0 deletions
|
|
@ -30,3 +30,10 @@ The 29-78% AUROC improvement occurs because deception-relevant concept direction
|
|||
**Source:** Theseus synthetic analysis (2026-04-22)
|
||||
|
||||
Nordby et al.'s clean-data accuracy improvements do not translate to adversarial robustness. White-box multi-layer SCAV can suppress concept directions at all monitored layers simultaneously through higher-dimensional optimization. Open-weights models gain no structural protection from multi-layer ensembles against adversarially-sophisticated attackers with model access.
|
||||
|
||||
|
||||
## Challenging Evidence
|
||||
|
||||
**Source:** Theseus adversarial robustness analysis
|
||||
|
||||
The 29-78% AUROC improvement is a clean-data accuracy result that does not translate to adversarial robustness. Nordby et al. contains no adversarial evaluation. White-box multi-layer SCAV is structurally feasible against these ensembles in open-weights models. The accuracy improvement is real but scoped to non-adversarial monitoring contexts.
|
||||
|
|
|
|||
|
|
@ -30,3 +30,10 @@ Multi-layer ensemble probes do not escape the dual-use attack surface identified
|
|||
**Source:** Theseus synthetic analysis (2026-04-22)
|
||||
|
||||
Multi-layer ensemble architectures do not eliminate the fundamental attack surface in white-box settings. White-box multi-layer SCAV generalizes the single-layer attack by computing concept directions at each monitored layer and constructing perturbations that suppress all simultaneously. The attack cost increases but the structural vulnerability remains.
|
||||
|
||||
|
||||
## Extending Evidence
|
||||
|
||||
**Source:** Theseus synthetic analysis of Nordby et al. × SCAV
|
||||
|
||||
Multi-layer ensemble monitoring does not eliminate the dual-use attack surface, only shifts it from single-layer to multi-layer SCAV. With white-box access, attackers can generalize SCAV to suppress concept directions at all monitored layers simultaneously through higher-dimensional optimization. Open-weights models remain fully vulnerable. Black-box robustness depends on untested rotation pattern universality question.
|
||||
|
|
|
|||
|
|
@ -31,3 +31,10 @@ The dual-use finding now extends to multi-layer ensemble monitoring with deploym
|
|||
**Source:** Theseus synthetic analysis (2026-04-22)
|
||||
|
||||
The dual-use vulnerability extends to multi-layer ensemble monitoring, not just single-layer probes. However, the severity is deployment-context-dependent: open-weights models (white-box adversaries) remain fully vulnerable, while closed-source models (black-box adversaries) may gain protection if rotation patterns are model-specific (untested assumption).
|
||||
|
||||
|
||||
## Extending Evidence
|
||||
|
||||
**Source:** Theseus synthetic analysis of Nordby et al. (arXiv 2604.13386, April 2026)
|
||||
|
||||
Multi-layer ensemble probes (Nordby et al. 2026) improve clean monitoring accuracy 29-78% but provide no structural protection against white-box adversaries in open-weights models. White-box multi-layer SCAV can compute concept directions at each monitored layer and construct a single perturbation suppressing all simultaneously. The dual-use finding extends to all monitoring precision levels with scope qualification: open-weights models face structural vulnerability regardless of ensemble complexity; closed-source models may gain genuine black-box protection if rotation patterns are model-specific (untested).
|
||||
|
|
|
|||
Loading…
Reference in a new issue