摘要
在处理海量数据时,以软件方式实现的Z标准(Zstd)无损压缩算法难以满足特定应用领域对压缩速度的需求.对Zstd进行硬件加速设计是解决这一问题的有效方案,尤其是针对Zstd的有限状态熵编码(finitestateentropy,FSE)的硬件加速.因此,提出一种适用于Zstd的FSE压缩、解压硬件实现架构,采用固定压缩表实现最优的硬件加速步骤;通过增加序列映射的硬件模块来降低存储空间并提高传输速度;采用软硬件协同设计方案,并对硬件实现架构进行7级流水设计.通过VisualStudio与Modelsim的联合验证平台进行验证,实验结果表明在TSMC55 nm的工艺下,系统最高频率可达到750 MHz.与软件实现相比,整体压缩速度提高了9倍以上,整体解压速度提高了约100倍.
The Zstd(Zstandard)lossless compression algorithm that implemented by software is difficult to meet the demand of compression speed in specific application field when processing massive data.It is an effective solution to this problem by using the hardware acceleration scheme,especially for the hardware acceleration of FSE(finite state entropy).Thus,a hardware implementation of the compression and decompression in FSE is proposed for Zstd.This scheme determines the optimal hardware acceleration step by fixing the size of compression table,reduces the storage space and improves the transmission speed by adding hardware modules of sequence mapping,enhances the time of parallel processing by dividing the seven-stages of flow and realizes the architecture by software and hardware collaboration.The proposed architecture is implemented in the TSMC 55 nm process,and the highest frequency can reach 750 MHz.The experimental results show that compared with the software implementation,the speed of the whole compression is more than 9 times faster,the speed of the whole decompression is more than the 100 times faster.
作者
黄海
邢琳
那宁
张国良
赵石磊
刘志伟
Huang Hai;Xing Lin;Na Ning;Zhang Guoliang;Zhao Shilei;Liu Zhiwei(School of Software and Microelectronics,Harbin University of Science and Technology,Harbin 150080;School of Computer Science and Technology,Harbin University of Science and Technology,Harbin 150080;Ninth Research Institute,China Aerospace Science and Technology Corporation,Beijing 100094)
出处
《计算机辅助设计与图形学学报》
EI
CSCD
北大核心
2021年第4期640-648,共9页
Journal of Computer-Aided Design & Computer Graphics
基金
国家重点研发计划“光电子与微电子器件及集成”重点专项(2018YFB2202100)
黑龙江省自然科学基金优秀青年项目(YQ2019F010)
黑龙江省普通本科高等学校青年创新人才培养计划(UNPYSCT-2017081)
黑龙江省博士后科研启动基金(LBH-Q18065)。
关键词
无损压缩算法
有限状态熵编码
Z标准
硬件加速
lossless compression algorithm
finite state entropy encoding
Zstandard
hardware acceleration
