Adaptive Integrate-and-Fire Time Encoding Machine With Quantization
1mo ago
Source
IEEEAdaptive Integrate-and-Fire Time Encoding Machine With Quantizationieee.orgAn integrate-and-fire time-encoding machine (IF-TEM) is a power-effective asynchronous sampler that translates amplitude information into non-uniform time sequences. In this work, we propose a novel Adaptive IF-TEM (AIF-TEM) approach, which dynamically adapts the TEM bias and the induced Nyquist ratio in response to temporal amplitude and frequency variations of the input signal. We provide a comprehensive analysis of AIF-TEM’s oversampling and distortion properties. We also investigate the quantization process for AIF-TEM and analyze the corresponding mean squared error (MSE) bound. Our results show that AIF-TEM achieves significant improvements in rate-distortion performance compared to classical IF-TEM and traditional Nyquist (i.e., periodic) sampling methods for band-limited signals. In particular, AIF-TEM achieves at least a 12 dB reduction in reconstruction MSE under a fixed oversampling rate. When quantization is considered, AIF-TEM provides at least a 14 dB improvement in quantization MSE compared to IF-TEM. Furthermore, AIF-TEM achieves the same reconstruction accuracy using less than 30% of the total bits required by IF-TEM, highlighting the superior efficiency of our adaptive approach. Additionally, we introduce a dynamic quantization technique for AIF-TEM, which further improves performance by at least 10 dB compared to its classical quantization baseline.
You might also wanna read
Optimizing Linux timestamps on x86: 30% faster custom timers without vDSO
A deep technical exploration of optimizing Linux timestamps on x86 architecture, achieving 30% speed improvements over standard system clock
Comparing Audio and Image Processing: A Technical Exploration of Downsampling Across Media Types
The article explores a technical thought experiment comparing raster graphics and audio files as sequences of analog measurements, examining
TurboQuant: Compressing AI Vectors to 2-4 Bits Using Random Rotations
TurboQuant is a novel compression technique for AI vectors (KV caches, embeddings, attention keys) that compresses each coordinate to 2-4 bi
BIFE: A New Framework for Stable Minute-Long Video Generation Using Semantic Sparse KV Cache and Block Forcing
This paper introduces BIFE (Better Interaction, Fewer Errors), a framework for minute-long video generation that addresses two key challenge
OrbitQuant: Efficient Quantization for Diffusion Transformers
mlllm.io·1d ago
TurboQuant: AI Efficiency Technology Using Extreme Compression for High-Dimensional Vectors
The article discusses TurboQuant, a new AI efficiency technology that addresses the memory bottleneck problem in AI models caused by high-di
research.google·3mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.