Evaluation Analysis of Large Language Models Based on TKG and Document Vectorisation
Year: 2024
Type: conference-paper
Abstract: The integration of Temporal Knowledge Graphs (TKGs) and document vectorization techniques into the evaluation of large language models (LLMs) presents a significant advancement in natural language processing. This study explores how TKGs, which encapsulate temporal relationships and time-stamped events, can enhance the contextual understanding of LLMs. By converting documents into numerical vectors through methods like TF-IDF, Word2Vec, and BERT embeddings, we aim to improve the semantic coherence and temporal accuracy of these models. Our methodology involves collecting and preprocessing temporal and document data, followed by vectorizing this information and fine-tuning LLMs to incorporate the temporal dynamics and rich contextual embeddings. The results indicate that integrating TKGs and advanced vectorization significantly boosts the temporal and relational understanding of LLMs, leading to better performance across various applications.
Authors: Yulang Yuan, Haotong Wang
Institution: Dalian Jiaotong University
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4406668078