Abstract
Style transfer lacks a reliable evaluation standard: ground truth is inherently ill-defined, and existing automatic metrics often fail to reflect human preference. This paper introduces ASTRA (Assessment of Style TRansfer Algorithms), an approach for automatic evaluation of style transfer algorithms; it contains two components, ASTRA-Data and ASTRA-Score. ASTRA-Data consists of a benchmark image set of content and style references, a collection of style transfer results generated on the benchmark set, and user study data capturing human judgements through a two-stage pairwise comparison protocol. From these annotations, we derive ranking-based ground truth for content preservation, style fidelity, and overall preference. Based on ASTRA-Data, we construct ASTRA-Score, a learnt evaluator that predicts preference-aligned scores from content-style-stylization image triplets, enabling automatic and scalable evaluation of new models applied to the benchmark set. Experimental results demonstrate that ASTRA-Score achieves substantially higher correlation with human rankings compared to prior metrics. Overall, ASTRA establishes a robust mechanism for standardised evaluation of style transfer methods.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Deng, Y., Ioannou, E., Mould, D., Maddock, S., Rosin, P. L., & Lai, Y. K. (2026). Perceptually Aligned Evaluation of Style Transfer. https://omanscience.com/en/articles/perceptually-aligned-evaluation-of-style-transfer
MLA 9
Deng, Yang, et al. "Perceptually Aligned Evaluation of Style Transfer." https://omanscience.com/en/articles/perceptually-aligned-evaluation-of-style-transfer.
Chicago (author–date)
Deng, Yang, Eleftherios Ioannou, David Mould, Steve Maddock, Paul L. Rosin, and Yu-Kun Lai. 2026. "Perceptually Aligned Evaluation of Style Transfer." https://omanscience.com/en/articles/perceptually-aligned-evaluation-of-style-transfer.
Harvard
Deng, Y., Ioannou, E., Mould, D., Maddock, S., Rosin, P. L. and Lai, Y. K. (2026) 'Perceptually Aligned Evaluation of Style Transfer', Available at: https://omanscience.com/en/articles/perceptually-aligned-evaluation-of-style-transfer.
Vancouver
Deng Y, Ioannou E, Mould D, Maddock S, Rosin PL, Lai YK. Perceptually Aligned Evaluation of Style Transfer. https://omanscience.com/en/articles/perceptually-aligned-evaluation-of-style-transfer
IEEE
Y. Deng, E. Ioannou, D. Mould, S. Maddock, P. L. Rosin, and Y. K. Lai, "Perceptually Aligned Evaluation of Style Transfer," https://omanscience.com/en/articles/perceptually-aligned-evaluation-of-style-transfer.