Use More Embedding Models in Similarity Search for Semantic Cache

[rootfs]

Is your feature request related to a problem? Please describe.
Currently the semantic cache uses all-MiniLM-L12-v2 embedding model in semantic cache. This model supports max seq up to 512. This works for short prompts.

For long prompts, other embedding models need to be explored.

Describe the solution you'd like
Document the limitation or support embedding models with longer max seq.

Describe alternatives you've considered

Additional context
#59

[zhengkezhou1]

Hi, @rootfs. I would like to work on this. First of all, I will perform a test to document the limitations of the current system.

[rootfs]

Thank you for your interest @zhengkezhou1

I am assigning this issue to you now. If you want to pick up an embedding model (as in #59) to start with, that'll be a good start.

[zhengkezhou1]

Construct prompts of different lengths for testing using part of:
https://huggingface.co/datasets/roneneldan/TinyStories/resolve/main/TinyStoriesV2-GPT4-valid.txt

curl -X POST http://localhost:8801/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d @long-prompt.json

Constraint:
Both prompts exceed the maximum length (512 tokens), and prompt-2 is a prefix of prompt-1

Result:
Separate caches were created for each prompt (cache miss).

{"level":"info","ts":"2025-09-15T11:11:03.328347+08:00","caller":"observability/logging.go:140","msg":"Starting metrics server on :9190"}
{"level":"info","ts":"2025-09-15T11:11:03.329118+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:11:03.329214+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:11:03.329262+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:11:03.329272+08:00","caller":"candle-binding/semantic-router.go:276","msg":"Initializing BERT similarity model: sentence-transformers/all-MiniLM-L12-v2"}
{"level":"info","ts":"2025-09-15T11:11:03.507475+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:11:03.507513+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:11:03.507517+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:11:03.587783+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:11:03.663625+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:11:03.740437+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:11:03.817147+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:11:03.894211+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:11:03.894235+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:11:03.894241+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:11:03.894251+08:00","caller":"candle-binding/semantic-router.go:643","msg":"Initializing ModernBERT classifier model: models/category_classifier_modernbert-base_model"}
{"level":"info","ts":"2025-09-15T11:11:04.673652+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:11:04.67371+08:00","caller":"candle-binding/semantic-router.go:691","msg":"Initializing ModernBERT jailbreak classifier model: models/jailbreak_classifier_modernbert-base_model"}
{"level":"info","ts":"2025-09-15T11:11:05.506248+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:11:05.506297+08:00","caller":"candle-binding/semantic-router.go:715","msg":"Initializing ModernBERT PII token classifier model: models/pii_classifier_modernbert-base_presidio_token_model"}
{"level":"info","ts":"2025-09-15T11:11:06.329901+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:11:06.332495+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:11:06.524312+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:11:06.524348+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:11:06.524353+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:11:06.524363+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:11:06.52437+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:11:06.524373+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:11:06.524376+08:00","caller":"observability/logging.go:140","msg":"Starting vLLM Semantic Router ExtProc with config: config/config.yaml"}
{"level":"info","ts":"2025-09-15T11:11:06.524427+08:00","caller":"observability/logging.go:140","msg":"Starting Classification API server on port 8080"}
{"level":"info","ts":"2025-09-15T11:11:06.524472+08:00","caller":"observability/logging.go:140","msg":"Starting LLM Router ExtProc server on port 50051..."}
{"level":"info","ts":"2025-09-15T11:11:06.524887+08:00","caller":"observability/logging.go:140","msg":"Found global classification service on attempt 1/5"}
{"level":"info","ts":"2025-09-15T11:11:06.524939+08:00","caller":"observability/logging.go:140","msg":"Classification API server listening on port 8080"}
{"level":"info","ts":"2025-09-15T11:11:21.164024+08:00","caller":"observability/logging.go:140","msg":"Started processing a new request"}
{"level":"info","ts":"2025-09-15T11:11:21.164817+08:00","caller":"observability/logging.go:140","msg":"Received request headers"}
{"level":"info","ts":"2025-09-15T11:11:21.164845+08:00","caller":"observability/logging.go:140","msg":"Processing 10 request headers"}
{"level":"info","ts":"2025-09-15T11:11:21.165812+08:00","caller":"observability/logging.go:140","msg":"Received request body"}
{"level":"info","ts":"2025-09-15T11:11:21.16703+08:00","caller":"observability/logging.go:140","msg":"Original model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:12:18.077558+08:00","caller":"observability/logging.go:140","msg":"Jailbreak classification result: {0 0.99992585}"}
{"level":"info","ts":"2025-09-15T11:12:18.077583+08:00","caller":"observability/logging.go:140","msg":"BENIGN: 'benign' (confidence: 1.000, threshold: 0.700)"}
{"level":"info","ts":"2025-09-15T11:12:18.077586+08:00","caller":"observability/logging.go:140","msg":"No jailbreak detected in request content"}
{"level":"info","ts":"2025-09-15T11:12:19.099289+08:00","caller":"observability/logging.go:140","msg":"Using specified model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:13:18.442883+08:00","caller":"observability/logging.go:140","msg":"PII token classification found 93 entities"}
{"level":"info","ts":"2025-09-15T11:13:18.442958+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [919-923] with confidence 0.754"}
{"level":"info","ts":"2025-09-15T11:13:18.442963+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [1089-1094] with confidence 0.794"}
{"level":"info","ts":"2025-09-15T11:13:18.442969+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2010-2016] with confidence 0.711"}
{"level":"info","ts":"2025-09-15T11:13:18.442971+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [2116-2121] with confidence 0.885"}
{"level":"info","ts":"2025-09-15T11:13:18.442974+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lucy') at [3096-3101] with confidence 0.976"}
{"level":"info","ts":"2025-09-15T11:13:18.442988+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [4350-4354] with confidence 0.711"}
{"level":"info","ts":"2025-09-15T11:13:18.442997+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6407-6411] with confidence 0.733"}
{"level":"info","ts":"2025-09-15T11:13:18.442999+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [7439-7443] with confidence 0.747"}
{"level":"info","ts":"2025-09-15T11:13:18.443001+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [7447-7451] with confidence 0.731"}
{"level":"info","ts":"2025-09-15T11:13:18.443004+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8193-8198] with confidence 0.960"}
{"level":"info","ts":"2025-09-15T11:13:18.443006+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Gigi') at [9238-9243] with confidence 0.718"}
{"level":"info","ts":"2025-09-15T11:13:18.443048+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Gigi') at [9511-9515] with confidence 0.747"}
{"level":"info","ts":"2025-09-15T11:13:18.443071+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' wise') at [10343-10348] with confidence 0.708"}
{"level":"info","ts":"2025-09-15T11:13:18.443076+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [10523-10527] with confidence 0.912"}
{"level":"info","ts":"2025-09-15T11:13:18.443088+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Her') at [10890-10894] with confidence 0.740"}
{"level":"info","ts":"2025-09-15T11:13:18.44309+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [11042-11046] with confidence 0.797"}
{"level":"info","ts":"2025-09-15T11:13:18.443095+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11407-11412] with confidence 0.818"}
{"level":"info","ts":"2025-09-15T11:13:18.443097+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11774-11780] with confidence 0.842"}
{"level":"info","ts":"2025-09-15T11:13:18.443099+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11977-11982] with confidence 0.758"}
{"level":"info","ts":"2025-09-15T11:13:18.443102+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Bella') at [12695-12701] with confidence 0.939"}
{"level":"info","ts":"2025-09-15T11:13:18.443105+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [15847-15851] with confidence 0.703"}
{"level":"info","ts":"2025-09-15T11:13:18.443146+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [16574-16578] with confidence 0.718"}
{"level":"info","ts":"2025-09-15T11:13:18.443168+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17203-17207] with confidence 0.759"}
{"level":"info","ts":"2025-09-15T11:13:18.443172+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17497-17501] with confidence 0.834"}
{"level":"info","ts":"2025-09-15T11:13:18.443175+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17674-17678] with confidence 0.707"}
{"level":"info","ts":"2025-09-15T11:13:18.443178+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sara') at [17876-17880] with confidence 0.918"}
{"level":"info","ts":"2025-09-15T11:13:18.443181+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18015-18020] with confidence 0.951"}
{"level":"info","ts":"2025-09-15T11:13:18.443268+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18239-18244] with confidence 0.866"}
{"level":"info","ts":"2025-09-15T11:13:18.443304+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18523-18528] with confidence 0.929"}
{"level":"info","ts":"2025-09-15T11:13:18.443307+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sara') at [19058-19062] with confidence 0.902"}
{"level":"info","ts":"2025-09-15T11:13:18.443309+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [19739-19744] with confidence 0.835"}
{"level":"info","ts":"2025-09-15T11:13:18.443316+08:00","caller":"observability/logging.go:140","msg":"Detected PII types: [PERSON]"}
{"level":"info","ts":"2025-09-15T11:13:18.443319+08:00","caller":"observability/logging.go:140","msg":"Detected PII type 'PERSON' in content"}
{"level":"info","ts":"2025-09-15T11:13:18.443321+08:00","caller":"observability/logging.go:140","msg":"PII policy check passed for model llama3.2"}
{"level":"info","ts":"2025-09-15T11:13:18.443325+08:00","caller":"observability/logging.go:140","msg":"Selected endpoint address: 127.0.0.1:11434 for model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:13:18.443344+08:00","caller":"observability/logging.go:136","msg":"routing_decision","event":"routing_decision","reason_code":"model_specified","category":"","reasoning_enabled":false,"selected_endpoint":"127.0.0.1:11434","routing_latency_ms":117276,"request_id":"71c749d7-7155-4103-bf45-480eddb62786","original_model":"llama3.2","selected_model":"llama3.2","reasoning_effort":""}
{"level":"info","ts":"2025-09-15T11:13:43.636221+08:00","caller":"observability/logging.go:136","msg":"llm_usage","model":"llama3.2","prompt_tokens":4096,"completion_latency_ms":142470,"currency":"USD","event":"llm_usage","request_id":"71c749d7-7155-4103-bf45-480eddb62786","completion_tokens":305,"total_tokens":4401,"cost":0.00039347000000000004}
{"level":"info","ts":"2025-09-15T11:13:43.636325+08:00","caller":"observability/logging.go:140","msg":"Cache updated for request ID: 71c749d7-7155-4103-bf45-480eddb62786"}
{"level":"info","ts":"2025-09-15T11:13:43.637341+08:00","caller":"observability/logging.go:140","msg":"Stream canceled gracefully"}
{"level":"info","ts":"2025-09-15T11:14:03.263076+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:14:03.263676+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:14:03.264159+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:14:03.26421+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:14:03.264234+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:14:03.264247+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:14:03.363976+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:14:03.457452+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:14:03.537702+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:14:03.61551+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:14:03.693545+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:14:03.693572+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:14:03.693579+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:14:03.693584+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:14:03.693587+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:14:03.693589+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:14:03.695292+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:14:05.321805+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:14:05.321851+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:14:05.321857+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:14:05.321863+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:14:05.321869+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:14:05.321872+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:14:05.321879+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:14:37.127358+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:14:37.127834+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:14:37.128129+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:14:37.128403+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:14:37.128532+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:14:37.128555+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:14:37.246556+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:14:37.327447+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:14:37.407449+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:14:37.486809+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:14:37.565967+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:14:37.56599+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:14:37.565997+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:14:37.566001+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:14:37.566004+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:14:37.566008+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:14:37.568028+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:14:37.81282+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:14:37.812869+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:14:37.812873+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:14:37.81288+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:14:37.812886+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:14:37.81289+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:14:37.812906+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:14:42.769938+08:00","caller":"observability/logging.go:140","msg":"Started processing a new request"}
{"level":"info","ts":"2025-09-15T11:14:42.770036+08:00","caller":"observability/logging.go:140","msg":"Received request headers"}
{"level":"info","ts":"2025-09-15T11:14:42.77005+08:00","caller":"observability/logging.go:140","msg":"Processing 10 request headers"}
{"level":"info","ts":"2025-09-15T11:14:42.770723+08:00","caller":"observability/logging.go:140","msg":"Received request body"}
{"level":"info","ts":"2025-09-15T11:14:42.772279+08:00","caller":"observability/logging.go:140","msg":"Original model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:15:32.102633+08:00","caller":"observability/logging.go:140","msg":"Jailbreak classification result: {0 0.99994147}"}
{"level":"info","ts":"2025-09-15T11:15:32.102711+08:00","caller":"observability/logging.go:140","msg":"BENIGN: 'benign' (confidence: 1.000, threshold: 0.700)"}
{"level":"info","ts":"2025-09-15T11:15:32.102716+08:00","caller":"observability/logging.go:140","msg":"No jailbreak detected in request content"}
{"level":"info","ts":"2025-09-15T11:15:33.201152+08:00","caller":"observability/logging.go:140","msg":"Using specified model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:16:23.363752+08:00","caller":"observability/logging.go:140","msg":"PII token classification found 89 entities"}
{"level":"info","ts":"2025-09-15T11:16:23.363787+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [920-924] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:16:23.363791+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [1090-1095] with confidence 0.795"}
{"level":"info","ts":"2025-09-15T11:16:23.363797+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2011-2017] with confidence 0.742"}
{"level":"info","ts":"2025-09-15T11:16:23.3638+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [2117-2122] with confidence 0.893"}
{"level":"info","ts":"2025-09-15T11:16:23.363802+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2241-2247] with confidence 0.772"}
{"level":"info","ts":"2025-09-15T11:16:23.363804+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lucy') at [3097-3102] with confidence 0.981"}
{"level":"info","ts":"2025-09-15T11:16:23.363807+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lucy') at [3521-3525] with confidence 0.701"}
{"level":"info","ts":"2025-09-15T11:16:23.363809+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [4351-4355] with confidence 0.758"}
{"level":"info","ts":"2025-09-15T11:16:23.363811+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [4961-4966] with confidence 0.710"}
{"level":"info","ts":"2025-09-15T11:16:23.363813+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6262-6266] with confidence 0.704"}
{"level":"info","ts":"2025-09-15T11:16:23.363857+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6408-6412] with confidence 0.774"}
{"level":"info","ts":"2025-09-15T11:16:23.36386+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [7440-7444] with confidence 0.748"}
{"level":"info","ts":"2025-09-15T11:16:23.363862+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [7448-7452] with confidence 0.778"}
{"level":"info","ts":"2025-09-15T11:16:23.363864+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8194-8199] with confidence 0.968"}
{"level":"info","ts":"2025-09-15T11:16:23.363866+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [8265-8269] with confidence 0.717"}
{"level":"info","ts":"2025-09-15T11:16:23.363868+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8377-8382] with confidence 0.809"}
{"level":"info","ts":"2025-09-15T11:16:23.36387+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Gigi') at [9512-9516] with confidence 0.735"}
{"level":"info","ts":"2025-09-15T11:16:23.363872+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' wise') at [10344-10349] with confidence 0.753"}
{"level":"info","ts":"2025-09-15T11:16:23.363874+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [10524-10528] with confidence 0.938"}
{"level":"info","ts":"2025-09-15T11:16:23.363875+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Her') at [10891-10895] with confidence 0.761"}
{"level":"info","ts":"2025-09-15T11:16:23.363877+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sue') at [10962-10965] with confidence 0.711"}
{"level":"info","ts":"2025-09-15T11:16:23.363879+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [11043-11047] with confidence 0.845"}
{"level":"info","ts":"2025-09-15T11:16:23.363881+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11408-11413] with confidence 0.796"}
{"level":"info","ts":"2025-09-15T11:16:23.363883+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11558-11564] with confidence 0.728"}
{"level":"info","ts":"2025-09-15T11:16:23.363884+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11775-11781] with confidence 0.883"}
{"level":"info","ts":"2025-09-15T11:16:23.363886+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11978-11983] with confidence 0.776"}
{"level":"info","ts":"2025-09-15T11:16:23.363888+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Bella') at [12696-12702] with confidence 0.942"}
{"level":"info","ts":"2025-09-15T11:16:23.36389+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [16575-16579] with confidence 0.733"}
{"level":"info","ts":"2025-09-15T11:16:23.363958+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17204-17208] with confidence 0.735"}
{"level":"info","ts":"2025-09-15T11:16:23.363963+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17498-17502] with confidence 0.802"}
{"level":"info","ts":"2025-09-15T11:16:23.363965+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17675-17679] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:16:23.363967+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sara') at [17877-17881] with confidence 0.912"}
{"level":"info","ts":"2025-09-15T11:16:23.363969+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18016-18021] with confidence 0.951"}
{"level":"info","ts":"2025-09-15T11:16:23.36397+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18240-18245] with confidence 0.913"}
{"level":"info","ts":"2025-09-15T11:16:23.363995+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18524-18529] with confidence 0.948"}
{"level":"info","ts":"2025-09-15T11:16:23.364004+08:00","caller":"observability/logging.go:140","msg":"Detected PII types: [PERSON]"}
{"level":"info","ts":"2025-09-15T11:16:23.364006+08:00","caller":"observability/logging.go:140","msg":"Detected PII type 'PERSON' in content"}
{"level":"info","ts":"2025-09-15T11:16:23.364012+08:00","caller":"observability/logging.go:140","msg":"PII policy check passed for model llama3.2"}
{"level":"info","ts":"2025-09-15T11:16:23.364022+08:00","caller":"observability/logging.go:140","msg":"Selected endpoint address: 127.0.0.1:11434 for model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:16:23.364041+08:00","caller":"observability/logging.go:136","msg":"routing_decision","reason_code":"model_specified","request_id":"56c55089-c142-4e9b-9891-591cafe31833","original_model":"llama3.2","category":"","reasoning_enabled":false,"reasoning_effort":"","routing_latency_ms":100592,"event":"routing_decision","selected_model":"llama3.2","selected_endpoint":"127.0.0.1:11434"}
{"level":"info","ts":"2025-09-15T11:16:44.174309+08:00","caller":"observability/logging.go:136","msg":"llm_usage","request_id":"56c55089-c142-4e9b-9891-591cafe31833","prompt_tokens":4096,"total_tokens":4322,"cost":0.00036582000000000004,"model":"llama3.2","completion_tokens":226,"completion_latency_ms":121403,"currency":"USD","event":"llm_usage"}
{"level":"info","ts":"2025-09-15T11:16:44.174442+08:00","caller":"observability/logging.go:140","msg":"Cache updated for request ID: 56c55089-c142-4e9b-9891-591cafe31833"}
{"level":"info","ts":"2025-09-15T11:16:44.175263+08:00","caller":"observability/logging.go:140","msg":"Stream canceled gracefully"}

Constraint:
Both prompts exceed the maximum length (512 tokens), and prompt-1 is a prefix of prompt-2.

Result:
Separate caches were created for each prompt (cache miss).

{"level":"info","ts":"2025-09-15T11:26:20.88598+08:00","caller":"observability/logging.go:140","msg":"Starting metrics server on :9190"}
{"level":"info","ts":"2025-09-15T11:26:20.887611+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:26:20.887742+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:26:20.887805+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:26:20.887819+08:00","caller":"candle-binding/semantic-router.go:276","msg":"Initializing BERT similarity model: sentence-transformers/all-MiniLM-L12-v2"}
{"level":"info","ts":"2025-09-15T11:26:21.049643+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:26:21.04968+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:26:21.049684+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:26:21.132885+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:26:21.212074+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:26:21.290209+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:26:21.36834+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:26:21.446678+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:26:21.4467+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:26:21.446706+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:26:21.446715+08:00","caller":"candle-binding/semantic-router.go:643","msg":"Initializing ModernBERT classifier model: models/category_classifier_modernbert-base_model"}
{"level":"info","ts":"2025-09-15T11:26:22.251511+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:26:22.251577+08:00","caller":"candle-binding/semantic-router.go:691","msg":"Initializing ModernBERT jailbreak classifier model: models/jailbreak_classifier_modernbert-base_model"}
{"level":"info","ts":"2025-09-15T11:26:23.006192+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:26:23.006252+08:00","caller":"candle-binding/semantic-router.go:715","msg":"Initializing ModernBERT PII token classifier model: models/pii_classifier_modernbert-base_presidio_token_model"}
{"level":"info","ts":"2025-09-15T11:26:23.121033+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:26:23.122851+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:26:23.318298+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:26:23.318342+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:26:23.318346+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:26:23.31836+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:26:23.318367+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:26:23.318371+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:26:23.318374+08:00","caller":"observability/logging.go:140","msg":"Starting vLLM Semantic Router ExtProc with config: config/config.yaml"}
{"level":"info","ts":"2025-09-15T11:26:23.318407+08:00","caller":"observability/logging.go:140","msg":"Starting Classification API server on port 8080"}
{"level":"info","ts":"2025-09-15T11:26:23.318478+08:00","caller":"observability/logging.go:140","msg":"Starting LLM Router ExtProc server on port 50051..."}
{"level":"info","ts":"2025-09-15T11:26:23.318898+08:00","caller":"observability/logging.go:140","msg":"Found global classification service on attempt 1/5"}
{"level":"info","ts":"2025-09-15T11:26:23.31895+08:00","caller":"observability/logging.go:140","msg":"Classification API server listening on port 8080"}
{"level":"info","ts":"2025-09-15T11:26:37.118003+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:26:37.118312+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:26:37.118491+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:26:37.118535+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:26:37.118559+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:26:37.11857+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:26:37.24031+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:26:37.370898+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:26:37.449996+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:26:37.528425+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:26:37.606961+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:26:37.606982+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:26:37.606989+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:26:37.606993+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:26:37.606996+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:26:37.606998+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:26:37.608774+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:26:37.83363+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:26:37.833672+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:26:37.833686+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:26:37.833693+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:26:37.8337+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:26:37.833704+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:26:37.83371+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:26:52.612059+08:00","caller":"observability/logging.go:140","msg":"Started processing a new request"}
{"level":"info","ts":"2025-09-15T11:26:52.613256+08:00","caller":"observability/logging.go:140","msg":"Received request headers"}
{"level":"info","ts":"2025-09-15T11:26:52.61329+08:00","caller":"observability/logging.go:140","msg":"Processing 10 request headers"}
{"level":"info","ts":"2025-09-15T11:26:52.614823+08:00","caller":"observability/logging.go:140","msg":"Received request body"}
{"level":"info","ts":"2025-09-15T11:26:52.616913+08:00","caller":"observability/logging.go:140","msg":"Original model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:27:33.206308+08:00","caller":"observability/logging.go:140","msg":"Jailbreak classification result: {0 0.99994767}"}
{"level":"info","ts":"2025-09-15T11:27:33.206335+08:00","caller":"observability/logging.go:140","msg":"BENIGN: 'benign' (confidence: 1.000, threshold: 0.700)"}
{"level":"info","ts":"2025-09-15T11:27:33.206338+08:00","caller":"observability/logging.go:140","msg":"No jailbreak detected in request content"}
{"level":"info","ts":"2025-09-15T11:27:34.232515+08:00","caller":"observability/logging.go:140","msg":"Using specified model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:28:15.573012+08:00","caller":"observability/logging.go:140","msg":"PII token classification found 80 entities"}
{"level":"info","ts":"2025-09-15T11:28:15.573053+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [920-924] with confidence 0.721"}
{"level":"info","ts":"2025-09-15T11:28:15.573058+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [1090-1095] with confidence 0.776"}
{"level":"info","ts":"2025-09-15T11:28:15.573061+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [2117-2122] with confidence 0.921"}
{"level":"info","ts":"2025-09-15T11:28:15.573064+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2241-2247] with confidence 0.753"}
{"level":"info","ts":"2025-09-15T11:28:15.573066+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lucy') at [3097-3102] with confidence 0.975"}
{"level":"info","ts":"2025-09-15T11:28:15.573083+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [5829-5834] with confidence 0.706"}
{"level":"info","ts":"2025-09-15T11:28:15.57309+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6143-6147] with confidence 0.742"}
{"level":"info","ts":"2025-09-15T11:28:15.573093+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6262-6266] with confidence 0.728"}
{"level":"info","ts":"2025-09-15T11:28:15.573096+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [6400-6404] with confidence 0.702"}
{"level":"info","ts":"2025-09-15T11:28:15.573098+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6408-6412] with confidence 0.779"}
{"level":"info","ts":"2025-09-15T11:28:15.5731+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [7440-7444] with confidence 0.765"}
{"level":"info","ts":"2025-09-15T11:28:15.57313+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [7448-7452] with confidence 0.756"}
{"level":"info","ts":"2025-09-15T11:28:15.573134+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8194-8199] with confidence 0.970"}
{"level":"info","ts":"2025-09-15T11:28:15.573137+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8377-8382] with confidence 0.779"}
{"level":"info","ts":"2025-09-15T11:28:15.573138+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Gigi') at [9239-9244] with confidence 0.712"}
{"level":"info","ts":"2025-09-15T11:28:15.57314+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Gigi') at [9512-9516] with confidence 0.763"}
{"level":"info","ts":"2025-09-15T11:28:15.573143+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' wise') at [10344-10349] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:28:15.573145+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [10524-10528] with confidence 0.938"}
{"level":"info","ts":"2025-09-15T11:28:15.573147+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('S') at [10687-10688] with confidence 0.855"}
{"level":"info","ts":"2025-09-15T11:28:15.573148+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Her') at [10891-10895] with confidence 0.739"}
{"level":"info","ts":"2025-09-15T11:28:15.57315+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [11043-11047] with confidence 0.800"}
{"level":"info","ts":"2025-09-15T11:28:15.573152+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11408-11413] with confidence 0.804"}
{"level":"info","ts":"2025-09-15T11:28:15.573154+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11558-11564] with confidence 0.714"}
{"level":"info","ts":"2025-09-15T11:28:15.573156+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11775-11781] with confidence 0.861"}
{"level":"info","ts":"2025-09-15T11:28:15.573158+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11978-11983] with confidence 0.749"}
{"level":"info","ts":"2025-09-15T11:28:15.573159+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Bella') at [12696-12702] with confidence 0.940"}
{"level":"info","ts":"2025-09-15T11:28:15.573161+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [15848-15852] with confidence 0.731"}
{"level":"info","ts":"2025-09-15T11:28:15.573229+08:00","caller":"observability/logging.go:140","msg":"Detected PII types: [PERSON]"}
{"level":"info","ts":"2025-09-15T11:28:15.573236+08:00","caller":"observability/logging.go:140","msg":"Detected PII type 'PERSON' in content"}
{"level":"info","ts":"2025-09-15T11:28:15.573242+08:00","caller":"observability/logging.go:140","msg":"PII policy check passed for model llama3.2"}
{"level":"info","ts":"2025-09-15T11:28:15.573257+08:00","caller":"observability/logging.go:140","msg":"Selected endpoint address: 127.0.0.1:11434 for model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:28:15.573275+08:00","caller":"observability/logging.go:136","msg":"routing_decision","event":"routing_decision","original_model":"llama3.2","selected_model":"llama3.2","reasoning_enabled":false,"selected_endpoint":"127.0.0.1:11434","reason_code":"model_specified","request_id":"e03923a9-c0be-49d7-9f97-d9e0ae9e0b1b","category":"","reasoning_effort":"","routing_latency_ms":82957}
{"level":"info","ts":"2025-09-15T11:28:35.595112+08:00","caller":"observability/logging.go:136","msg":"llm_usage","model":"llama3.2","prompt_tokens":4096,"completion_latency_ms":102980,"cost":0.00035882000000000004,"event":"llm_usage","request_id":"e03923a9-c0be-49d7-9f97-d9e0ae9e0b1b","completion_tokens":206,"total_tokens":4302,"currency":"USD"}
{"level":"info","ts":"2025-09-15T11:28:35.595223+08:00","caller":"observability/logging.go:140","msg":"Cache updated for request ID: e03923a9-c0be-49d7-9f97-d9e0ae9e0b1b"}
{"level":"info","ts":"2025-09-15T11:28:35.596739+08:00","caller":"observability/logging.go:140","msg":"Stream canceled gracefully"}
{"level":"info","ts":"2025-09-15T11:28:45.163542+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:28:45.164219+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:28:45.16476+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:28:45.164822+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:28:45.164851+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:28:45.164867+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:28:45.28281+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:28:45.363558+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:28:45.441755+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:28:45.520351+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:28:45.598552+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:28:45.598579+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:28:45.598585+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:28:45.59859+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:28:45.598593+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:28:45.598596+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:28:45.600311+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:28:47.330758+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:28:47.330803+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:28:47.330808+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:28:47.330816+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:28:47.330823+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:28:47.330829+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:28:47.330836+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","event":"config_reloaded","file":"config/config.yaml"}
{"level":"info","ts":"2025-09-15T11:28:52.294399+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:28:52.294825+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:28:52.295303+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:28:52.295355+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:28:52.295384+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:28:52.295397+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:28:52.416735+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:28:52.510896+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:28:52.594104+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:28:52.673529+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:28:52.751532+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:28:52.751556+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:28:52.751561+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:28:52.751565+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:28:52.751568+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:28:52.751571+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:28:52.752993+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:28:52.978289+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:28:52.978322+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:28:52.978326+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:28:52.978332+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:28:52.978341+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:28:52.978345+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:28:52.978352+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","event":"config_reloaded","file":"config/config.yaml"}
{"level":"info","ts":"2025-09-15T11:28:54.562121+08:00","caller":"observability/logging.go:140","msg":"Started processing a new request"}
{"level":"info","ts":"2025-09-15T11:28:54.562251+08:00","caller":"observability/logging.go:140","msg":"Received request headers"}
{"level":"info","ts":"2025-09-15T11:28:54.562274+08:00","caller":"observability/logging.go:140","msg":"Processing 10 request headers"}
{"level":"info","ts":"2025-09-15T11:28:54.562893+08:00","caller":"observability/logging.go:140","msg":"Received request body"}
{"level":"info","ts":"2025-09-15T11:28:54.564024+08:00","caller":"observability/logging.go:140","msg":"Original model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:29:45.044892+08:00","caller":"observability/logging.go:140","msg":"Jailbreak classification result: {0 0.99994147}"}
{"level":"info","ts":"2025-09-15T11:29:45.044947+08:00","caller":"observability/logging.go:140","msg":"BENIGN: 'benign' (confidence: 1.000, threshold: 0.700)"}
{"level":"info","ts":"2025-09-15T11:29:45.044954+08:00","caller":"observability/logging.go:140","msg":"No jailbreak detected in request content"}
{"level":"info","ts":"2025-09-15T11:29:46.099742+08:00","caller":"observability/logging.go:140","msg":"Using specified model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:30:36.704965+08:00","caller":"observability/logging.go:140","msg":"PII token classification found 89 entities"}
{"level":"info","ts":"2025-09-15T11:30:36.704991+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [920-924] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:30:36.704996+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [1090-1095] with confidence 0.795"}
{"level":"info","ts":"2025-09-15T11:30:36.704999+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2011-2017] with confidence 0.742"}
{"level":"info","ts":"2025-09-15T11:30:36.705002+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [2117-2122] with confidence 0.893"}
{"level":"info","ts":"2025-09-15T11:30:36.705004+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2241-2247] with confidence 0.772"}
{"level":"info","ts":"2025-09-15T11:30:36.705025+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lucy') at [3097-3102] with confidence 0.981"}
{"level":"info","ts":"2025-09-15T11:30:36.705028+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lucy') at [3521-3525] with confidence 0.701"}
{"level":"info","ts":"2025-09-15T11:30:36.70503+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [4351-4355] with confidence 0.758"}
{"level":"info","ts":"2025-09-15T11:30:36.705033+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [4961-4966] with confidence 0.710"}
{"level":"info","ts":"2025-09-15T11:30:36.705035+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6262-6266] with confidence 0.704"}
{"level":"info","ts":"2025-09-15T11:30:36.705037+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6408-6412] with confidence 0.774"}
{"level":"info","ts":"2025-09-15T11:30:36.705083+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [7440-7444] with confidence 0.748"}
{"level":"info","ts":"2025-09-15T11:30:36.70509+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [7448-7452] with confidence 0.778"}
{"level":"info","ts":"2025-09-15T11:30:36.705093+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8194-8199] with confidence 0.968"}
{"level":"info","ts":"2025-09-15T11:30:36.705095+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [8265-8269] with confidence 0.717"}
{"level":"info","ts":"2025-09-15T11:30:36.705097+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8377-8382] with confidence 0.809"}
{"level":"info","ts":"2025-09-15T11:30:36.705099+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Gigi') at [9512-9516] with confidence 0.735"}
{"level":"info","ts":"2025-09-15T11:30:36.705102+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' wise') at [10344-10349] with confidence 0.753"}
{"level":"info","ts":"2025-09-15T11:30:36.705104+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [10524-10528] with confidence 0.938"}
{"level":"info","ts":"2025-09-15T11:30:36.705106+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Her') at [10891-10895] with confidence 0.761"}
{"level":"info","ts":"2025-09-15T11:30:36.705107+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sue') at [10962-10965] with confidence 0.711"}
{"level":"info","ts":"2025-09-15T11:30:36.705109+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [11043-11047] with confidence 0.845"}
{"level":"info","ts":"2025-09-15T11:30:36.705167+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11408-11413] with confidence 0.796"}
{"level":"info","ts":"2025-09-15T11:30:36.705171+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11558-11564] with confidence 0.728"}
{"level":"info","ts":"2025-09-15T11:30:36.705173+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11775-11781] with confidence 0.883"}
{"level":"info","ts":"2025-09-15T11:30:36.705175+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11978-11983] with confidence 0.776"}
{"level":"info","ts":"2025-09-15T11:30:36.705178+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Bella') at [12696-12702] with confidence 0.942"}
{"level":"info","ts":"2025-09-15T11:30:36.70518+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [16575-16579] with confidence 0.733"}
{"level":"info","ts":"2025-09-15T11:30:36.705189+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17204-17208] with confidence 0.735"}
{"level":"info","ts":"2025-09-15T11:30:36.705191+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17498-17502] with confidence 0.802"}
{"level":"info","ts":"2025-09-15T11:30:36.705193+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17675-17679] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:30:36.705195+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sara') at [17877-17881] with confidence 0.912"}
{"level":"info","ts":"2025-09-15T11:30:36.705197+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18016-18021] with confidence 0.951"}
{"level":"info","ts":"2025-09-15T11:30:36.70521+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18240-18245] with confidence 0.913"}
{"level":"info","ts":"2025-09-15T11:30:36.705213+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18524-18529] with confidence 0.948"}
{"level":"info","ts":"2025-09-15T11:30:36.70522+08:00","caller":"observability/logging.go:140","msg":"Detected PII types: [PERSON]"}
{"level":"info","ts":"2025-09-15T11:30:36.705222+08:00","caller":"observability/logging.go:140","msg":"Detected PII type 'PERSON' in content"}
{"level":"info","ts":"2025-09-15T11:30:36.705226+08:00","caller":"observability/logging.go:140","msg":"PII policy check passed for model llama3.2"}
{"level":"info","ts":"2025-09-15T11:30:36.705231+08:00","caller":"observability/logging.go:140","msg":"Selected endpoint address: 127.0.0.1:11434 for model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:30:36.705248+08:00","caller":"observability/logging.go:136","msg":"routing_decision","reason_code":"model_specified","category":"","routing_latency_ms":102141,"request_id":"927d57bf-2193-414b-abc6-827184123e8d","original_model":"llama3.2","selected_model":"llama3.2","reasoning_enabled":false,"reasoning_effort":"","selected_endpoint":"127.0.0.1:11434","event":"routing_decision"}
{"level":"info","ts":"2025-09-15T11:30:51.932508+08:00","caller":"observability/logging.go:136","msg":"llm_usage","request_id":"927d57bf-2193-414b-abc6-827184123e8d","completion_tokens":76,"total_tokens":4172,"event":"llm_usage","model":"llama3.2","prompt_tokens":4096,"completion_latency_ms":117369,"cost":0.00031332000000000007,"currency":"USD"}
{"level":"info","ts":"2025-09-15T11:30:51.932632+08:00","caller":"observability/logging.go:140","msg":"Cache updated for request ID: 927d57bf-2193-414b-abc6-827184123e8d"}
{"level":"info","ts":"2025-09-15T11:30:51.939153+08:00","caller":"observability/logging.go:140","msg":"Stream canceled gracefully"}

Constraint:
Prompt-1 is longer than 512 tokens. Prompt-2 is shorter than 512 tokens and is a prefix of Prompt-1.

Result:
Separate caches were created for both prompts (cache miss).

{"level":"info","ts":"2025-09-15T11:34:34.331878+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:34:34.331883+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:34:34.331892+08:00","caller":"candle-binding/semantic-router.go:643","msg":"Initializing ModernBERT classifier model: models/category_classifier_modernbert-base_model"}
{"level":"info","ts":"2025-09-15T11:34:35.125393+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:34:35.125449+08:00","caller":"candle-binding/semantic-router.go:691","msg":"Initializing ModernBERT jailbreak classifier model: models/jailbreak_classifier_modernbert-base_model"}
{"level":"info","ts":"2025-09-15T11:34:35.918847+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:34:35.918921+08:00","caller":"candle-binding/semantic-router.go:715","msg":"Initializing ModernBERT PII token classifier model: models/pii_classifier_modernbert-base_presidio_token_model"}
{"level":"info","ts":"2025-09-15T11:34:36.702077+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:34:36.704823+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:34:36.900949+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:34:36.900984+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:34:36.900988+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:34:36.900999+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:34:36.901007+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:34:36.901011+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:34:36.901014+08:00","caller":"observability/logging.go:140","msg":"Starting vLLM Semantic Router ExtProc with config: config/config.yaml"}
{"level":"info","ts":"2025-09-15T11:34:36.901052+08:00","caller":"observability/logging.go:140","msg":"Starting Classification API server on port 8080"}
{"level":"info","ts":"2025-09-15T11:34:36.901109+08:00","caller":"observability/logging.go:140","msg":"Starting LLM Router ExtProc server on port 50051..."}
{"level":"info","ts":"2025-09-15T11:34:36.901522+08:00","caller":"observability/logging.go:140","msg":"Found global classification service on attempt 1/5"}
{"level":"info","ts":"2025-09-15T11:34:36.901585+08:00","caller":"observability/logging.go:140","msg":"Classification API server listening on port 8080"}
{"level":"info","ts":"2025-09-15T11:34:39.132654+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:34:39.132937+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:34:39.133094+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:34:39.133132+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:34:39.133157+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:34:39.133188+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:34:39.237391+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:34:39.312028+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:34:39.387476+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:34:39.462737+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:34:39.537962+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:34:39.537984+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:34:39.537989+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:34:39.537993+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:34:39.537995+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:34:39.537998+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:34:39.539674+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:34:39.754757+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:34:39.75479+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:34:39.754793+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:34:39.754799+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:34:39.754804+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:34:39.754807+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:34:39.754814+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","event":"config_reloaded","file":"config/config.yaml"}
{"level":"info","ts":"2025-09-15T11:35:07.656491+08:00","caller":"observability/logging.go:140","msg":"Started processing a new request"}
{"level":"info","ts":"2025-09-15T11:35:07.658337+08:00","caller":"observability/logging.go:140","msg":"Received request headers"}
{"level":"info","ts":"2025-09-15T11:35:07.658377+08:00","caller":"observability/logging.go:140","msg":"Processing 10 request headers"}
{"level":"info","ts":"2025-09-15T11:35:07.658962+08:00","caller":"observability/logging.go:140","msg":"Received request body"}
{"level":"info","ts":"2025-09-15T11:35:07.659991+08:00","caller":"observability/logging.go:140","msg":"Original model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:35:57.174759+08:00","caller":"observability/logging.go:140","msg":"Jailbreak classification result: {0 0.99994147}"}
{"level":"info","ts":"2025-09-15T11:35:57.174787+08:00","caller":"observability/logging.go:140","msg":"BENIGN: 'benign' (confidence: 1.000, threshold: 0.700)"}
{"level":"info","ts":"2025-09-15T11:35:57.174791+08:00","caller":"observability/logging.go:140","msg":"No jailbreak detected in request content"}
{"level":"info","ts":"2025-09-15T11:35:58.198658+08:00","caller":"observability/logging.go:140","msg":"Using specified model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:36:48.191529+08:00","caller":"observability/logging.go:140","msg":"PII token classification found 89 entities"}
{"level":"info","ts":"2025-09-15T11:36:48.191555+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Tom') at [920-924] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:36:48.191559+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [1090-1095] with confidence 0.795"}
{"level":"info","ts":"2025-09-15T11:36:48.191562+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2011-2017] with confidence 0.742"}
{"level":"info","ts":"2025-09-15T11:36:48.191564+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [2117-2122] with confidence 0.893"}
{"level":"info","ts":"2025-09-15T11:36:48.191567+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Mommy') at [2241-2247] with confidence 0.772"}
{"level":"info","ts":"2025-09-15T11:36:48.191575+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lucy') at [3097-3102] with confidence 0.981"}
{"level":"info","ts":"2025-09-15T11:36:48.191577+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lucy') at [3521-3525] with confidence 0.701"}
{"level":"info","ts":"2025-09-15T11:36:48.191579+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [4351-4355] with confidence 0.758"}
{"level":"info","ts":"2025-09-15T11:36:48.191581+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [4961-4966] with confidence 0.710"}
{"level":"info","ts":"2025-09-15T11:36:48.191583+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6262-6266] with confidence 0.704"}
{"level":"info","ts":"2025-09-15T11:36:48.191585+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [6408-6412] with confidence 0.774"}
{"level":"info","ts":"2025-09-15T11:36:48.191619+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [7440-7444] with confidence 0.748"}
{"level":"info","ts":"2025-09-15T11:36:48.191626+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [7448-7452] with confidence 0.778"}
{"level":"info","ts":"2025-09-15T11:36:48.191629+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8194-8199] with confidence 0.968"}
{"level":"info","ts":"2025-09-15T11:36:48.191631+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Max') at [8265-8269] with confidence 0.717"}
{"level":"info","ts":"2025-09-15T11:36:48.191633+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Lily') at [8377-8382] with confidence 0.809"}
{"level":"info","ts":"2025-09-15T11:36:48.191635+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Gigi') at [9512-9516] with confidence 0.735"}
{"level":"info","ts":"2025-09-15T11:36:48.191637+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' wise') at [10344-10349] with confidence 0.753"}
{"level":"info","ts":"2025-09-15T11:36:48.191639+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [10524-10528] with confidence 0.938"}
{"level":"info","ts":"2025-09-15T11:36:48.191641+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Her') at [10891-10895] with confidence 0.761"}
{"level":"info","ts":"2025-09-15T11:36:48.191643+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sue') at [10962-10965] with confidence 0.711"}
{"level":"info","ts":"2025-09-15T11:36:48.191644+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sue') at [11043-11047] with confidence 0.845"}
{"level":"info","ts":"2025-09-15T11:36:48.191696+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11408-11413] with confidence 0.796"}
{"level":"info","ts":"2025-09-15T11:36:48.1917+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11558-11564] with confidence 0.728"}
{"level":"info","ts":"2025-09-15T11:36:48.191702+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Emily') at [11775-11781] with confidence 0.883"}
{"level":"info","ts":"2025-09-15T11:36:48.191704+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Emily') at [11978-11983] with confidence 0.776"}
{"level":"info","ts":"2025-09-15T11:36:48.191706+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Bella') at [12696-12702] with confidence 0.942"}
{"level":"info","ts":"2025-09-15T11:36:48.191708+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [16575-16579] with confidence 0.733"}
{"level":"info","ts":"2025-09-15T11:36:48.191735+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17204-17208] with confidence 0.735"}
{"level":"info","ts":"2025-09-15T11:36:48.191738+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17498-17502] with confidence 0.802"}
{"level":"info","ts":"2025-09-15T11:36:48.19174+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Lily') at [17675-17679] with confidence 0.743"}
{"level":"info","ts":"2025-09-15T11:36:48.191742+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON ('Sara') at [17877-17881] with confidence 0.912"}
{"level":"info","ts":"2025-09-15T11:36:48.191744+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18016-18021] with confidence 0.951"}
{"level":"info","ts":"2025-09-15T11:36:48.191746+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18240-18245] with confidence 0.913"}
{"level":"info","ts":"2025-09-15T11:36:48.191748+08:00","caller":"observability/logging.go:140","msg":"Detected PII entity: PERSON (' Sara') at [18524-18529] with confidence 0.948"}
{"level":"info","ts":"2025-09-15T11:36:48.191752+08:00","caller":"observability/logging.go:140","msg":"Detected PII types: [PERSON]"}
{"level":"info","ts":"2025-09-15T11:36:48.191754+08:00","caller":"observability/logging.go:140","msg":"Detected PII type 'PERSON' in content"}
{"level":"info","ts":"2025-09-15T11:36:48.191759+08:00","caller":"observability/logging.go:140","msg":"PII policy check passed for model llama3.2"}
{"level":"info","ts":"2025-09-15T11:36:48.191763+08:00","caller":"observability/logging.go:140","msg":"Selected endpoint address: 127.0.0.1:11434 for model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:36:48.191777+08:00","caller":"observability/logging.go:136","msg":"routing_decision","reason_code":"model_specified","original_model":"llama3.2","category":"","reasoning_effort":"","selected_endpoint":"127.0.0.1:11434","event":"routing_decision","request_id":"409f0ecf-b67a-4f05-8ee7-a1e685011525","selected_model":"llama3.2","reasoning_enabled":false,"routing_latency_ms":100532}
{"level":"info","ts":"2025-09-15T11:37:10.471956+08:00","caller":"observability/logging.go:136","msg":"llm_usage","completion_tokens":250,"total_tokens":4346,"completion_latency_ms":122812,"cost":0.00037422000000000003,"currency":"USD","event":"llm_usage","request_id":"409f0ecf-b67a-4f05-8ee7-a1e685011525","model":"llama3.2","prompt_tokens":4096}
{"level":"info","ts":"2025-09-15T11:37:10.472109+08:00","caller":"observability/logging.go:140","msg":"Cache updated for request ID: 409f0ecf-b67a-4f05-8ee7-a1e685011525"}
{"level":"info","ts":"2025-09-15T11:37:10.473521+08:00","caller":"observability/logging.go:140","msg":"Stream canceled gracefully"}
{"level":"info","ts":"2025-09-15T11:37:37.967072+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:37:37.967881+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:37:37.968525+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:37:37.96863+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:37:37.968675+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:37:37.968692+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:37:38.080361+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:37:38.156043+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:37:38.233162+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:37:38.308648+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:37:38.383839+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:37:38.383862+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:37:38.38387+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:37:38.383876+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:37:38.383878+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:37:38.383881+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:37:38.385556+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:37:40.107363+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:37:40.107409+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:37:40.107414+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:37:40.107423+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:37:40.107429+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:37:40.107432+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:37:40.107438+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:37:42.726485+08:00","caller":"observability/logging.go:140","msg":"Started processing a new request"}
{"level":"info","ts":"2025-09-15T11:37:42.726561+08:00","caller":"observability/logging.go:140","msg":"Received request headers"}
{"level":"info","ts":"2025-09-15T11:37:42.72657+08:00","caller":"observability/logging.go:140","msg":"Processing 10 request headers"}
{"level":"info","ts":"2025-09-15T11:37:42.726834+08:00","caller":"observability/logging.go:140","msg":"Received request body"}
{"level":"info","ts":"2025-09-15T11:37:42.72701+08:00","caller":"observability/logging.go:140","msg":"Original model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:37:42.873776+08:00","caller":"observability/logging.go:140","msg":"Jailbreak classification result: {0 0.9999982}"}
{"level":"info","ts":"2025-09-15T11:37:42.873815+08:00","caller":"observability/logging.go:140","msg":"BENIGN: 'benign' (confidence: 1.000, threshold: 0.700)"}
{"level":"info","ts":"2025-09-15T11:37:42.873818+08:00","caller":"observability/logging.go:140","msg":"No jailbreak detected in request content"}
{"level":"info","ts":"2025-09-15T11:37:43.036464+08:00","caller":"observability/logging.go:140","msg":"Using specified model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:37:43.156037+08:00","caller":"observability/logging.go:140","msg":"PII policy check passed for model llama3.2"}
{"level":"info","ts":"2025-09-15T11:37:43.156066+08:00","caller":"observability/logging.go:140","msg":"Selected endpoint address: 127.0.0.1:11434 for model: llama3.2"}
{"level":"info","ts":"2025-09-15T11:37:43.156081+08:00","caller":"observability/logging.go:136","msg":"routing_decision","request_id":"f93c96f8-a1f9-4f28-b443-42021e099c72","original_model":"llama3.2","selected_model":"llama3.2","category":"","reasoning_enabled":false,"reasoning_effort":"","routing_latency_ms":429,"reason_code":"model_specified","selected_endpoint":"127.0.0.1:11434","event":"routing_decision"}
{"level":"info","ts":"2025-09-15T11:37:55.307248+08:00","caller":"observability/logging.go:136","msg":"llm_usage","prompt_tokens":103,"completion_tokens":448,"total_tokens":551,"completion_latency_ms":12580,"cost":0.00016401,"currency":"USD","request_id":"f93c96f8-a1f9-4f28-b443-42021e099c72","model":"llama3.2","event":"llm_usage"}
{"level":"info","ts":"2025-09-15T11:37:55.307285+08:00","caller":"observability/logging.go:140","msg":"Cache updated for request ID: f93c96f8-a1f9-4f28-b443-42021e099c72"}
{"level":"info","ts":"2025-09-15T11:37:55.309012+08:00","caller":"observability/logging.go:140","msg":"Stream canceled gracefully"}
{"level":"info","ts":"2025-09-15T11:38:23.943826+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:23.944184+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:23.944393+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:23.944446+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:23.944475+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:23.94449+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:24.059314+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:38:24.135915+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:24.213829+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:24.289765+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:24.366357+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:24.366384+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:24.366391+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:24.366395+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:24.366398+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:24.366401+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:24.368359+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:24.595391+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:24.595427+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:24.595431+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:24.595439+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:24.595445+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:24.595449+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:24.595456+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:24.991882+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:24.992047+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:24.992111+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:24.992132+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:24.992148+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:24.992157+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:25.107048+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:38:25.187696+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:25.270329+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:25.350663+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:25.429729+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:25.429767+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:25.429774+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:25.42978+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:25.429782+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:25.429785+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:25.431218+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:25.656356+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:25.6564+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:25.656404+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:25.65641+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:25.656416+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:25.656419+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:25.656425+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:37.337296+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:37.338027+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:37.338256+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:37.338313+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:37.338337+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:37.338348+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:37.455736+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:38:37.531675+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:37.607419+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:37.682739+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:37.757754+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:37.757779+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:37.757786+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:37.75779+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:37.757794+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:37.757796+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:37.759215+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:37.973581+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:37.973622+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:37.973626+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:37.973632+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:37.973638+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:37.973641+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:37.973647+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:38.737577+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:38.737872+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:38.738105+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:38.738173+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:38.738205+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:38.73822+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:38.854633+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:38:38.932337+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:39.009004+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:39.085178+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:39.160727+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:39.160751+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:39.160757+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:39.160761+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:39.160764+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:39.160766+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:39.162122+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:39.374413+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:39.374447+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:39.37445+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:39.374456+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:39.374462+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:39.374466+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:39.374472+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:46.767935+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:46.76816+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:46.768282+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:46.768325+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:46.768348+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:46.768358+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:46.883272+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:38:46.959443+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:47.036485+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:47.11214+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:47.151719+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:47.151773+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:47.151791+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:47.151798+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:47.151803+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:47.151805+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:47.189135+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:47.189157+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:47.189165+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:47.189169+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:47.189172+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:47.189174+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:47.190614+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
{"level":"info","ts":"2025-09-15T11:38:47.272656+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:47.356244+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:47.43196+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:47.431998+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:47.432002+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:47.432008+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:47.432013+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:47.432016+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:47.432032+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:47.439622+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:47.51819+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:47.599345+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:47.599368+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:47.599373+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:47.599377+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:47.59938+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:47.599383+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:47.600903+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:47.843333+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:47.843397+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:47.843402+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:47.84341+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:47.843418+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:47.843421+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:47.84343+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:52.995415+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:52.995716+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:52.995877+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:52.99593+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:52.995958+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:52.995973+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:53.11075+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:38:53.186641+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:53.26204+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:53.336937+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:53.374885+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:38:53.374935+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:38:53.374954+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:38:53.37496+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:38:53.374966+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:38:53.374968+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:38:53.412276+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:53.412292+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:53.412296+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:53.4123+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:53.412302+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:53.412305+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:53.413744+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
{"level":"info","ts":"2025-09-15T11:38:53.494376+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:53.578608+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:38:53.647157+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:53.647201+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:53.647208+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:53.647218+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:53.647227+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:53.647234+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:53.647247+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:38:53.662711+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:38:53.739659+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:38:53.81853+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:38:53.818553+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:38:53.81856+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:38:53.818564+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:53.818567+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:38:53.81857+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:38:53.82+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:38:54.034845+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:38:54.03489+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:38:54.034895+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:38:54.034902+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:38:54.034908+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:38:54.034911+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:38:54.034918+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:39:00.968769+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:39:00.968953+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:39:00.969018+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:39:00.969037+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:39:00.969053+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:39:00.969059+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:39:01.083359+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:39:01.159008+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:39:01.235816+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:39:01.311224+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:39:01.386734+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:39:01.38676+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:39:01.386765+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:39:01.38677+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:39:01.386772+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:39:01.386775+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:39:01.388503+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:39:01.606562+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:39:01.606608+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:39:01.606612+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:39:01.606619+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:39:01.606625+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:39:01.606628+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:39:01.606635+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:39:29.204937+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:39:29.205156+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:39:29.205279+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:39:29.205319+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:39:29.205341+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:39:29.205351+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:39:29.319868+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:39:29.399698+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:39:29.477389+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:39:29.556929+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:39:29.635841+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:39:29.635859+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:39:29.635863+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:39:29.635867+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:39:29.63587+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:39:29.635873+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:39:29.637242+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:39:29.854115+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:39:29.854151+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:39:29.854155+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:39:29.854161+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:39:29.854168+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:39:29.854171+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:39:29.854206+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}
{"level":"info","ts":"2025-09-15T11:39:39.131545+08:00","caller":"observability/logging.go:140","msg":"Loaded category mapping with 14 categories"}
{"level":"info","ts":"2025-09-15T11:39:39.131718+08:00","caller":"observability/logging.go:140","msg":"Loaded PII mapping with 35 PII types"}
{"level":"info","ts":"2025-09-15T11:39:39.131799+08:00","caller":"observability/logging.go:140","msg":"Loaded jailbreak mapping with 2 jailbreak types"}
{"level":"info","ts":"2025-09-15T11:39:39.131828+08:00","caller":"observability/logging.go:140","msg":"Category descriptions: [business law psychology biology chemistry history other health economics math physics computer science philosophy engineering]"}
{"level":"info","ts":"2025-09-15T11:39:39.131842+08:00","caller":"observability/logging.go:140","msg":"Semantic cache enabled (backend: memory) with threshold: 0.8000, TTL: 3600 seconds"}
{"level":"info","ts":"2025-09-15T11:39:39.131847+08:00","caller":"observability/logging.go:140","msg":"In-memory cache max entries: 1000"}
{"level":"info","ts":"2025-09-15T11:39:39.254942+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: get_weather - Get current weather information, temperature, conditions, forecast for any location, city, or place. Check weather today, now, current conditions, temperature, rain, sun, cloudy, hot, cold, storm, snow"}
{"level":"info","ts":"2025-09-15T11:39:39.338168+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: search_web - Search the internet, web search, find information online, browse web content, lookup, research, google, find answers, discover, investigate"}
{"level":"info","ts":"2025-09-15T11:39:39.423284+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: calculate - Calculate mathematical expressions, solve math problems, arithmetic operations, compute numbers, addition, subtraction, multiplication, division, equations, formula"}
{"level":"info","ts":"2025-09-15T11:39:39.503056+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: send_email - Send email messages, email communication, contact people via email, mail, message, correspondence, notify, inform"}
{"level":"info","ts":"2025-09-15T11:39:39.580455+08:00","caller":"observability/logging.go:140","msg":"Loaded tool: create_calendar_event - Schedule meetings, create calendar events, set appointments, manage calendar, book time, plan meeting, organize schedule, reminder, agenda"}
{"level":"info","ts":"2025-09-15T11:39:39.580481+08:00","caller":"observability/logging.go:140","msg":"Loaded 5 tools from file: config/tools_db.json"}
{"level":"info","ts":"2025-09-15T11:39:39.580487+08:00","caller":"observability/logging.go:140","msg":"Tools database enabled with threshold: 0.2000, top-k: 3"}
{"level":"info","ts":"2025-09-15T11:39:39.58049+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT category classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:39:39.580494+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT jailbreak classifier (classes auto-detected from model)"}
{"level":"info","ts":"2025-09-15T11:39:39.580496+08:00","caller":"observability/logging.go:140","msg":"Initialized ModernBERT PII token classifier for entity detection"}
{"level":"info","ts":"2025-09-15T11:39:39.582054+08:00","caller":"observability/logging.go:140","msg":"Initializing LoRA models: Intent=models/lora_intent_classifier_bert-base-uncased_model, PII=models/lora_pii_detector_bert-base-uncased_model, Security=models/lora_jailbreak_classifier_bert-base-uncased_model, Architecture=bert"}
Detected BERT token classifier - using BERT naming
{"level":"info","ts":"2025-09-15T11:39:39.843905+08:00","caller":"observability/logging.go:140","msg":"LoRA C bindings initialized successfully"}
{"level":"info","ts":"2025-09-15T11:39:39.843951+08:00","caller":"observability/logging.go:140","msg":"Unified classifier auto-discovered and initialized. Using batch processing."}
{"level":"info","ts":"2025-09-15T11:39:39.843954+08:00","caller":"observability/logging.go:140","msg":"Router initialization: Using auto-discovered unified classifier"}
{"level":"info","ts":"2025-09-15T11:39:39.843966+08:00","caller":"observability/logging.go:140","msg":"Reasoning configuration - Total categories: 14"}
{"level":"info","ts":"2025-09-15T11:39:39.843972+08:00","caller":"observability/logging.go:140","msg":"Reasoning ENABLED for categories (6): [biology chemistry math physics computer science engineering]"}
{"level":"info","ts":"2025-09-15T11:39:39.843975+08:00","caller":"observability/logging.go:140","msg":"Reasoning DISABLED for categories (8): [business law psychology history other health economics philosophy]"}
{"level":"info","ts":"2025-09-15T11:39:39.844+08:00","caller":"observability/logging.go:136","msg":"config_reloaded","file":"config/config.yaml","event":"config_reloaded"}