Hang Chen Xinyu Yang Jiaying Zhu Wenya Wang

Skill Path: Unveiling Language Skills from Circuit Graphs featured image
Large Language Models

Skill Path: Unveiling Language Skills from Circuit Graphs

Circuit graph discovery has emerged as a fundamental approach to elucidating the skill mechanistic of language models. Despite the output faithfulness of circuit graphs, they …

hang-chen-xinyu-yang-jiaying-zhu-wenya-wang
•
Read more
Quantifying Semantic Emergence in Language Models featured image
Large Language Models

Quantifying Semantic Emergence in Language Models

Large language models (LLMs) are widely recognized for their exceptional capacity to capture semantics meaning. Yet, there remains no established metric to quantify this …

hang-chen-xinyu-yang-jiaying-zhu-wenya-wang
•
Read more