README.md

Superficial Alignment

This repository contains code for the paper "Extracting and Understanding the Superficial Knowledge in Alignment (NAACL 2025)"

Step1: Extract token logits

bash scripts/extract_logit.sh

Step2: Train linear model

bash scripts/train_logit.sh

Step3: Run eval

bash scripts/run_eval.sh