Abstract
We introduce Heuristic-Guided Fourier Fine-Tuning (HeuFouFT), a task-guided framework for selecting trainable frequency coordinates in Fourier fine-tuning. Existing uniform and Gaussian band-pass schemes allocate a limited spectral budget through fixed, task-agnostic rules. HeuFouFT instead searches for coordinates using downstream performance. A coarse intensity map from lightweight block-level probes initializes three metaheuristic optimizers: Genetic Algorithm with Simulated Annealing (GA-SA), Particle Swarm Optimization (PSO), and Cuckoo Search (CS). During search, a Random Forest filters each population so that only the top 30% of candidates proceed to proxy fine-tuning. On E2E with GPT-2-Medium, all three variants outperform random-uniform FourierFT, Gaussian band-pass FourierFT, and LoRA across five metrics. PSO further outperforms LoCA, the best-performing baseline, on four metrics while using 37.6% fewer trainable spectral coefficients. Once coordinates are selected, HeuFouFT requires only 15--18% FLOPs of Full FT. These results show that task-guided search allocates limited spectral capacity more effectively than fixed sampling. Our code is publicly available.
Keywords
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Wang, R., Hou, Y., Zhu, Y., Shen, T., Wan, T., & Qin, Z. (2026). HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning. https://omanscience.com/en/articles/heufouft-task-guided-metaheuristic-coordinate-search-for-fourier-fine-tuning
MLA 9
Wang, Ruiheng, et al. "HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning." https://omanscience.com/en/articles/heufouft-task-guided-metaheuristic-coordinate-search-for-fourier-fine-tuning.
Chicago (author–date)
Wang, Ruiheng, Yubo Hou, Yakun Zhu, Tianle Shen, Tao Wan, and Zengchang Qin. 2026. "HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning." https://omanscience.com/en/articles/heufouft-task-guided-metaheuristic-coordinate-search-for-fourier-fine-tuning.
Harvard
Wang, R., Hou, Y., Zhu, Y., Shen, T., Wan, T. and Qin, Z. (2026) 'HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning', Available at: https://omanscience.com/en/articles/heufouft-task-guided-metaheuristic-coordinate-search-for-fourier-fine-tuning.
Vancouver
Wang R, Hou Y, Zhu Y, Shen T, Wan T, Qin Z. HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning. https://omanscience.com/en/articles/heufouft-task-guided-metaheuristic-coordinate-search-for-fourier-fine-tuning
IEEE
R. Wang, Y. Hou, Y. Zhu, T. Shen, T. Wan, and Z. Qin, "HeuFouFT: Task-Guided Metaheuristic Coordinate Search for Fourier Fine-Tuning," https://omanscience.com/en/articles/heufouft-task-guided-metaheuristic-coordinate-search-for-fourier-fine-tuning.