Recently,many Sequential Recommendation methods adopt self-attention mechanisms to model user preferences.However,these methods tend to focus more on low-frequency information while neglecting highfrequency informatio...Recently,many Sequential Recommendation methods adopt self-attention mechanisms to model user preferences.However,these methods tend to focus more on low-frequency information while neglecting highfrequency information,which makes them ineffective in balancing users’long-and short-term preferences.At the same time,manymethods overlook the potential of frequency domainmethods,ignoring their efficiency in processing frequency information.To overcome this limitation,we shift the focus to the combination of time and frequency domains and propose a novel Hybrid Time-Frequency Dual-Branch Transformer for Sequential Recommendation,namely HyTiFRec.Specifically,we design two hybrid filter modules:the learnable hybrid filter(LHF)and the window hybrid filter(WHF).We combine these with the Efficient Attention(EA)module to form the dual-branch structure to replace the self-attention components in Transformers.The EAmodule is used to extract sequential and global information.The LHF andWHF modules balance the proportion of different frequency bands,with LHF globally modulating the spectrum in the frequency domain and WHF retaining frequency components within specific local frequency bands.Furthermore,we use a time domain residual information addition operation in the hybrid filter module,which reduces information loss and further facilitates the hybrid of time-frequency methods.Extensive experiments on five widely-used real-world datasets show that our proposed method surpasses state-of-the-art methods.展开更多
基金supported by a grant from the Natural Science Foundation of Zhejiang Province under Grant LY21F010016.
文摘Recently,many Sequential Recommendation methods adopt self-attention mechanisms to model user preferences.However,these methods tend to focus more on low-frequency information while neglecting highfrequency information,which makes them ineffective in balancing users’long-and short-term preferences.At the same time,manymethods overlook the potential of frequency domainmethods,ignoring their efficiency in processing frequency information.To overcome this limitation,we shift the focus to the combination of time and frequency domains and propose a novel Hybrid Time-Frequency Dual-Branch Transformer for Sequential Recommendation,namely HyTiFRec.Specifically,we design two hybrid filter modules:the learnable hybrid filter(LHF)and the window hybrid filter(WHF).We combine these with the Efficient Attention(EA)module to form the dual-branch structure to replace the self-attention components in Transformers.The EAmodule is used to extract sequential and global information.The LHF andWHF modules balance the proportion of different frequency bands,with LHF globally modulating the spectrum in the frequency domain and WHF retaining frequency components within specific local frequency bands.Furthermore,we use a time domain residual information addition operation in the hybrid filter module,which reduces information loss and further facilitates the hybrid of time-frequency methods.Extensive experiments on five widely-used real-world datasets show that our proposed method surpasses state-of-the-art methods.
