Soft: Softmax-free transformer with linear complexity

Conference proceeding

Jiachen Lu, Jinghan Yao, Junge Zhang, XIATIAN ZHU, Hang Xu, Chunjing Xu, TAO XIANG and Li Zhang

NeurIPS 2021 (06/12/2021 - 14/12/2021)

12/2021

Metrics

35 Record Views

Title: Soft: Softmax-free transformer with linear complexity
Creators: Jiachen Lu
Jinghan Yao
Junge Zhang
XIATIAN ZHU - University of Surrey, School of Computer Science and Electronic Engineering
Hang Xu
Chunjing Xu
TAO XIANG - University of Surrey, School of Computer Science and Electronic Engineering
Li Zhang
Conference: NeurIPS 2021 (06/12/2021 - 14/12/2021)
Identifiers: 99654462502346
Academic Unit: School of Computer Science and Electronic Engineering
Resource Type: Conference proceeding