Browsing by Subject "Mean-squared error"

Now showing 1 - 3 of 3

Open Access
Noise enhanced parameter estimation using quantized observations
(2010) Balkan, Gökçe Osman
In this thesis, optimal additive noise is characterized for both single and multiple parameter estimation based on quantized observations. In both cases, first, optimal probability distribution of noise that should be added to observations is formulated in terms of a Cramer-Rao lower bound (CRLB) minimization problem. In the single parameter case, it is proven that optimal additive “noise” can be represented by a constant signal level, which means that randomization of additive signal levels (equivalently, quantization levels) are not needed for CRLB minimization. In addition, the results are extended to the cases in which there exists prior information about the unknown parameter and the aim is to minimize the Bayesian CRLB (BCRLB). Then, numerical examples are presented to explain the theoretical results. Moreover, performance obtained via optimal additive noise is compared to performance of the commonly used dither signals. Furthermore, mean-squared error (MSE) performances of maximum likelihood (ML) and maximum a-posteriori probability (MAP) estimates are investigated in the presence and absence of additive noise. In the multiple parameter case, the form of the optimal random additive noise is derived for CRLB minimization. Next, the theoretical result is supported with a numerical example, where the optimum noise is calculated by using the particle swarm optimization (PSO) algorithm. Finally, the optimal constant noise in the multiple parameter estimation problem in the presence of prior information is discussed.
Open Access
Optimal parameter encoding strategies for estimation theoretic secure communications
(2019-12) Göken, Çağrı
Physical layer security has gained a renewed interest with the advances in modern wireless communication technologies. In estimation theoretic security, secrecy levels are measured via estimation theoretic tools and metrics, such as mean-squared error (MSE), where the objective is to perform accurate estimation of the parameter at the intended receiver while keeping the estimation error at the eavesdropper above a certain level. This framework proves useful both for analyzing the achievable performance under security constraints in parameter estimation problems, and for designing low-complexity, practical methods to enhance security in communication systems. In this dissertation, we investigate optimal deterministic encoding of random scalar and vector parameters in the presence of an eavesdropper, who is unaware of the encoding operation. We also analyze optimal stochastic encoding of a random parameter under secrecy constraints in a Gaussian wiretap channel model, where the eavesdropper is aware of the encoding strategy at the transmitter. In addition, we perform optimal parameter design for secure broadcast of a parameter to multiple receivers with fixed estimators. First, optimal deterministic encoding of a scalar parameter is investigated in the presence of an eavesdropper. The aim is to minimize the expectation of the conditional Cram´er-Rao bound (ECRB) at the intended receiver while keeping the MSE at the eavesdropper above a certain threshold. The eavesdropper is modeled to employ the linear minimum mean-squared error (LMMSE) estimator based on the encoded version of the parameter. First, the optimal encoding function is derived in the absence of secrecy constraints for any given prior distribution on the parameter. Next, an optimization problem is formulated under a secrecy constraint and various solution approaches are proposed. Also, theoretical results on the form of the optimal encoding function are provided. Furthermore, a robust parameter encoding approach is developed. In this case, the objective is to maximize the worst-case Fisher information of the parameter at the intended receiver while keeping the MSE at the eavesdropper above a certain level. The optimal encoding function is derived when there exist no secrecy constraints. Next, to obtain the solution of the problem in the presence of the secrecy constraint, the form of the encoding function that maximizes the MSE at the eavesdropper is explicitly derived for any given level of worst-case Fisher information. Then, based on this result, a low-complexity algorithm is provided to calculate the optimal encoding function for the given secrecy constraint. Numerical examples are presented to illustrate the theoretical results for both the ECRB and worst-case Fisher information based designs. Second, optimal deterministic encoding of a vector parameter is investigated in the presence of an eavesdropper. The objective is to minimize the ECRB at the intended receiver while satisfying an individual secrecy constraint on the MSE of estimating each parameter at the eavesdropper. The eavesdropper is modeled to employ the LMMSE estimator based on the noisy observation of the encoded parameter without being aware of encoding. First, the problem is formulated as a constrained optimization problem in the space of vector-valued functions. Then, two practical solution strategies are developed based on nonlinear individual encoding and affine joint encoding of parameters. Theoretical results on the solutions of the proposed strategies are provided for various scenarios on channel conditions and parameter distributions. Finally, numerical examples are presented to illustrate the performance of the proposed solution approaches. Third, estimation theoretic secure transmission of a scalar random parameter is investigated in the presence of an eavesdropper. The aim is to minimize the estimation error at the receiver under a secrecy constraint at the eavesdropper; or, alternatively, to maximize the estimation error at the eavesdropper for a given estimation accuracy limit at the receiver. In the considered setting, the encoder at the transmitter is allowed to use a randomized mapping between two one-to-one and continuous functions and the eavesdropper is fully aware of the encoding strategy at the transmitter. For small numbers of observations, both the eavesdropper and the receiver are modeled to employ LMMSE estimators, and for large numbers of observations, the ECRB metric is employed for both the receiver and the eavesdropper. Optimization problems are formulated and various theoretical results are provided in order to obtain the optimal solutions and to analyze the effects of encoder randomization. In addition, numerical examples are presented to corroborate the theoretical results. It is observed that stochastic encoding can bring significant performance gains for estimation theoretic secrecy problems. Finally, estimation theoretic secure broadcast of a random parameter is investigated. In the considered setting, each receiver device employs a fixed estimator and carries a certain security risk such that its decision can be available to a malicious third party with a certain probability. The encoder at the transmitter is allowed to use a random mapping to minimize the weighted sum of the conditional Bayes risks of the estimators under secrecy and average power constraints. After formulating the optimal parameter design problem, it is shown that the optimization problem can be solved individually for each parameter value and the optimal mapping at the transmitter involves a randomization among at most three different signal levels. Sufficient conditions for improvability and nonimprovability of the deterministic design via stochastic encoding are obtained. Numerical examples are provided to corroborate the theoretical results.
Open Access
Statistics of the MLE and approximate upper and lower bounds-Part I: Application to TOA estimation
(Institute of Electrical and Electronics Engineers Inc., 2014) Mallat, A.; Gezici, Sinan; Dardari, D.; Craeye, C.; Vandendorpe, L.
In nonlinear deterministic parameter estimation, the maximum likelihood estimator (MLE) is unable to attain the Cramér-Rao lower bound at low and medium signal-to-noise ratios (SNRs) due the threshold and ambiguity phenomena. In order to evaluate the achieved mean-squared error (MSE) at those SNR levels, we propose new MSE approximations (MSEA) and an approximate upper bound by using the method of interval estimation (MIE). The mean and the distribution of the MLE are approximated as well. The MIE consists in splitting the a priori domain of the unknown parameter into intervals and computing the statistics of the estimator in each interval. Also, we derive an approximate lower bound (ALB) based on the Taylor series expansion of noise and an ALB family by employing the binary detection principle. The accuracy of the proposed MSEAs and the tightness of the derived approximate bounds are validated by considering the example of time-of-arrival estimation.