Predicting Career Change and First Job Sector Using LinkedIn Data: A Machine Learning Approach
Year: 2026
Type: dissertation
Abstract: The transition from education to the labour market has become increasingly non-linear and individualized. Rather than following a single, predictable path, many professionals move across sectors throughout their careers, driven by technological change, personal ambition, and globalization. Understanding these trajectories can help raise awareness of the prevalence of non-linear careers and support individuals, academic institutions, and policymakers in preparing for the future of work. This thesis investigates whether publicly available LinkedIn profile data can be used to predict two key early-career outcomes: whether graduates remain in the sector associated with their field of study or move into a different sector, and the sector of their first job. To address these questions, a dataset of 3,600 LinkedIn profiles from a public GitHub repository was curated through data cleaning, preprocessing, and feature engineering. Weak labels were assigned using domain-specific keywords, and a pre-trained BERT model was fine-tuned to classify job positions into eleven main sectors. The resulting features included counts of experiences, education entries, and skills, as well as highest education level and the ratio of experiences to education entries. These features, together with the BERT-based sector predictions, were used to train logistic regression models for binary and multi-class classification tasks. Given the severe class imbalance in the dataset, with only around 3% of individuals remaining in their original academic sector, class weighting and repeated stratified cross-validation were applied. For the binary task, the weighted logistic regression model achieved a macro F1-score of 0.56 and a balanced accuracy of 0.84, outperforming a baseline that always predicted sector change. For the multi-class task, the model achieved a macro F1-score of 0.13. Overall, the findings show that cross-sector career transitions are common in this dataset and highlight both the potential and the limitations of using small-scale social media data to model early-career outcomes. The main contribution of this thesis is the development and evaluation of an interpretable machine learning framework that demonstrates the feasibility of using LinkedIn data to analyse earlycareer mobility and predict both career change and first-job sector.
Institution: Universidade Nova de Lisboa
Language: English
Topic: AI and HR Technologies
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7171754202
