Abstract

This paper investigates the task of predicting job experience levels in recruitment texts, aiming to automatically identify the qualifications required for positions. Unlike traditional text classification, recruitment texts typically possess explicit internal structures, with different paragraphs playing disproportionate roles in conveying experience clues. To address this, we propose a structure-aware Section-Aware BERT approach that segments and encodes key paragraphs (titles, responsibilities, requirements) for integrated modeling, building upon rule-based systems and classical baselines TF-IDF. Simultaneously, we evaluate large language models under both few-shot and fine-tuning settings on the same dataset to compare the capability boundaries of different modeling paradigms. Experimental results demonstrate that explicitly leveraging text structure significantly improves experience level prediction performance, particularly in scenarios with ambiguous job titles. Further error analysis reveals systemic challenges in this task, including confusion between Entry and Senior levels and the blurred boundaries of Mid-level positions. This research provides an effective modeling approach and analytical framework for understanding structured recruitment texts.

Keywords

Subject

Publication details

Journal
Not available
Open access
Green open access

Cite this article

APA 7

Liang, C., Wu, E., Wang, S., & You, Y. (2026). Evaluating Modeling Approaches for Experience-Level Classification in Job Description. https://omanscience.com/en/articles/evaluating-modeling-approaches-for-experience-level-classification-in-job-description

MLA 9

Liang, Celia, et al. "Evaluating Modeling Approaches for Experience-Level Classification in Job Description." https://omanscience.com/en/articles/evaluating-modeling-approaches-for-experience-level-classification-in-job-description.

Chicago (author–date)

Liang, Celia, Eddie Wu, Shiqi Wang, and Yonah You. 2026. "Evaluating Modeling Approaches for Experience-Level Classification in Job Description." https://omanscience.com/en/articles/evaluating-modeling-approaches-for-experience-level-classification-in-job-description.

Harvard

Liang, C., Wu, E., Wang, S. and You, Y. (2026) 'Evaluating Modeling Approaches for Experience-Level Classification in Job Description', Available at: https://omanscience.com/en/articles/evaluating-modeling-approaches-for-experience-level-classification-in-job-description.

Vancouver

Liang C, Wu E, Wang S, You Y. Evaluating Modeling Approaches for Experience-Level Classification in Job Description. https://omanscience.com/en/articles/evaluating-modeling-approaches-for-experience-level-classification-in-job-description

IEEE

C. Liang, E. Wu, S. Wang, and Y. You, "Evaluating Modeling Approaches for Experience-Level Classification in Job Description," https://omanscience.com/en/articles/evaluating-modeling-approaches-for-experience-level-classification-in-job-description.