Quantization, in mathematics and digital signal processing, is the process of mapping input values from a large set (often a continuous set) to output values in a (countable) smaller set, often with a finite number of elements. Rounding and truncation are typical examples of quantization processes.
Questions tagged [quantization]
102 questions
8
votes
2 answers
Quantization SNR of sine wave doesn't match 1.761 + 6.02 * Q
I am trying to show with numpy that the quantization noise of a sine wave matches the SNR formula of SNR = 1.761 + 6.02 * Q.
The numpy code is simple:
import numpy as np
import matplotlib
from matplotlib import pylab, mlab, pyplot
plt =…
Tom Verbeure
- 442
- 1
- 7
7
votes
1 answer
Optimal amplitude of an $m$-bit sinusoid
A continuous-time sinusoid of zero-to-peak real amplitude $A \le 2^{m-1}-0.5$ (e.g., for $m=16$, $A \le 32767.5$) is quantized to $m$-bit resolution by rounding it to the nearest integer (Fig. 1). What is the optimal amplitude for different $m \le…
Olli Niemitalo
- 12,226
- 1
- 25
- 54
6
votes
3 answers
Why are we always interested in mean-squared distortion?
When dealing with quantizers, and in many other communications problems, the interest is usually on the mean-squared distortion or mean-squared error, rather than mean absolute error or anything else. Gallager explains the reason here, probably…
gtak
- 83
- 3
6
votes
1 answer
Compute SQNR (Signal to Quantization Noise Ratio)
I'm studying the quantization of an audio signal and in particular the SQNR (Signal to Quantization Noise Ratio).
The book on which the study says that:
where:
N is the number of bits in the digital representation
V indicates that the signal…
beth
- 207
- 1
- 3
- 8
5
votes
1 answer
Expected value of a quantized noisy signal
I am given a noisy signal $y(t) = x(t) + w(t)$, where $x(t)$ is my desired signal and $w(t)$ is the noise. In my scenario, the noise is very strong, much stronger than the desired signal $x(t)$. However, I know it is zero mean. Hence, if I can…
Florian
- 2,198
- 1
- 4
- 16
5
votes
1 answer
What is "hard quantization" strategy?
I am working on classification and several times I encountered with this term.
What is hard quantization strategy?
What does it differ from soft approach?
David
- 657
- 1
- 13
- 24
4
votes
3 answers
Practical IIR filter implementation
I'm trying to implement a digital IIR filter on an FPGA and would be happy for some inputs regarding the actual digital implementation. I don't have a lot of experience with FPGAs and digital filters in general and this whole matter seems more…
FaradayParadox
- 81
- 1
4
votes
3 answers
Precise 5th and 7th harmonics of a sampled sine wave
Does anyone know in decibels (to 1/100th of a dB) what the theoretical 3rd, 5th and 7th harmonic of a 0dB fs 24-bit (i.e. full-level; 0dB = -8,388,607 to 8,388,607) sampled sine wave without dither will be? Where the harmonics are a product of the…
Richard
- 61
- 4
4
votes
2 answers
What distribution is the easiest to compress?
I'm currently playing around with some compression algorithms and I'm asking myself if there is a type of data distribution / noise distribution that is easier to target with quantization (meaning less distortions at same rate). To my understanding…
Jane Dough
- 55
- 3
4
votes
1 answer
Does delta-sigma ADC also reduce Gaussian noise on input signal to ADC or just quantization noise?
The motive for posing this questions arises from a difference of analysis between a colleague an myself.
Our general environment is in the construction of an analog front-end which takes in signals to an instrumentation amp in the low microvolt…
DSP_user
- 41
- 2
4
votes
4 answers
From a physics perspective, why does D/A quantization error result in a noise floor?
For the last week or so I have been trying to understand how quantization error results in the noise floor outside of a mathematical perspective and I haven't really had any luck finding a source that discussed quantization noise without using…
user3841
- 43
- 3
4
votes
1 answer
What is "Maximum Quantization Error"?
I have an formula for this "Maximum Quantization Error" but i dont know what it is based in. Its just thrown in my study material without further explanation.
It is defined as:
$$Q = \dfrac {\Delta x}{2^{N+1}}$$
where $N$ is the number of bits used…
Diedre
- 55
- 1
- 1
- 5
3
votes
2 answers
Oversampling in quantization
Q: It is said that "to maintain the same quality in the two cases, we require that the power spectral densities remain the same". Why is this a measure of the same quality? Why is not
the integral of each power spectral density over the…
DSPinfinity
- 325
- 1
- 8
3
votes
1 answer
Sample & Hold: Estimate jitter delay of an ADC
I've got a question regarding the effects of sample and hold.
My input signal is $x$, and my output signal $x_{SH}$. The error between the signals is $e_{SH} = x_{SH}-x$.
The sampling frequency is set to $f_s = 1000kHz$ and the jitter delay to…
Phobos
- 357
- 1
- 11
3
votes
2 answers
A query on the non-uniform quantization
I have read that non-uniform quantization boosts the smaller amplitude signals by a large amount. However the larger amplitude signals receive a small gain. As shown in the below diagram (Compressor Input and Output).
The Input - Output…
METALHEAD
- 325
- 2
- 6
- 11