Work

Transforming Unstructured Data in IT Project: A Comparative Study of Zero-Shot and Generative AI Text Classification

Year: 2025
Type: article
Abstract: In today's world, we have a lot of messy, unorganized data from things like comments, interviews, and images. This is especially true in IT projects, where there's often too much information to handle easily. Our study looks at how we can turn this messy data into useful numbers and insights using smart computer programs. We tested two main methods: Zero-Shot Text Classification and Generative AI Text Classification. Zero-Shot is like having a smart assistant that can sort information without needing examples first. Generative AI is more like having a creative writer who can come up with new examples to help sort information. We asked 42 participants with experience in working with unstructured data to answer some questions, then used these methods to analyze their answers. We found that Zero-Shot works better for information that has clear patterns, while Generative AI is good at handling more complex or unclear information. Our results show that choosing the right method can make a big difference in how well we understand and use the data. Zero-Shot was about 15% more accurate for well-organized information, while Generative AI was 20% better at dealing with complex, messy data. This research helps companies and researchers choose the best way to make sense of their data, especially in IT projects where there's often too much information to handle manually.
Language: English
Open Access status: diamond
OpenAlex ID: W7215310084
FWCI:
Cites: 11
Cited by:
Related to: 10