PROBLEM STATEMENTS OF DATA PROCESSING BASED ON CRITERION OF MINIMUM EXTENT

Authors

  • S. M. Vovk Oles Honchar Dnipro National University, Ukraine, Ukraine

DOI:

https://doi.org/10.15588/1607-3274-2019-1-15

Keywords:

processing, criterion, extent, approximation, inverse problem.

Abstract

Context. In order to process the data containing anomalous values as well as to obtain the sparse solutions or solutions with small extent, the requirement to minimize the extent of the function used to find solution can be used. In this paper the object of the study is the process of setting the data processing problems on the basis of this requirement, which is further referred to as the criterion of minimum extent.
Objective. The goal of this work is the development of an approach to the formulation of the data processing problems based on criterion of minimum extent. 
Method. On the basis of minimum extent criterion, a new approach is proposed. This approach allows to formulate the data approximation problem as well as the inverse problem with a direct linear operator and with a solution of small extent or with a sparse solution in conditions that the initial data contain noise and anomalous values. The statement of the approximation problem is obtained
by setting a parametric data model and applying the criterion of minimum extent to the solution residual. The statement of the inverse problem is obtained by applying the criterion of minimum extent to the solution of the problem and to the solution residual. The special cases of this statement are presented and it is noted that this statement generalizes the statement of the Tikhonov regularization
problem. The proposed problem statements are formulated as minimization problems for the corresponding functionals constructed on the basis of the “superset” of cost functions. In the general case, the indicated functionals are neither convex nor unimodal, and their minimization can be a laborious task.
Results. The proposed problem statements generalize those that are performed on the basis of the least squares criterion and/or least modules criterion. Numerical simulation of the problem of approximation by a linear function of noisy data in the presence of impulsive noise, as well as in the presence of an interfering fragment of exponential function, confirmed the feasibility of the proposed statement and its effectiveness. Numerical simulation of the inverse problem, corresponded to the overdetermined system of linear algebraic equations with gross errors in its right-hand side and sparse solution, also confirmed the feasibility of using the criterion
of minimum extent for its formulation.
Conclusions. The problem statement of data processing which is based on the criterion of minimum extent is expedient under conditions when the part of the data is roughly distorted and/or when the desired solution has a small extent. The statements based on the criterion of minimum extent allow us to expand the range of the problems to be solved.

References

Millar R. B. Maximum Likelihood Estimation and Inference:

With Examples in R, SAS and ADMB. New York,

Wiley, 2011, 376 p.

Huber P., Ronchetti E. M. Robust statistics. 2nd ed. Hoboken,

Wiley, 2009, 370 p.

Tihonov A. N., Goncharskij A. V., Stepanov V. V., Jagola

A. G. Reguljarizirujushhie algoritmy i apriornaja informacija.

Moscow, Nauka, 1983, 200 p.

Wolberg J. Data Analysis Using the Method of Least

Squares: Extracting the Most Information from Experiments.

Berlin, SpringerVerlag, 2005, 250 p.

Chandola V., Banerjee A., Kumar V. Anomaly detection: A

survey, ACM Computing Surveys, 2009, Vol. 41, No. 3,

pp. 15–58.

Elgmati E. A., Gredni N. B. Quartile Method Estimation of

Two-Parameter Exponential Distribution Data with Outliers,

International Journal of Statistics and Probability, 2016,

Vol. 5, No. 5, pp. 12–15.

Shevlyakov G. L., Vilchevski N. O. Robustness in data

analysis: criteria and methods. Utrecht, VSP, 2002, 310 p.

Hampel F. R. Ronchetti E. M., Rousseeuw P. J., Stahel

W. A. Robust statistics: the approach based on influence

functions. Hoboken, NJ, Wiley, 2011, 502 p.

DOI=10.1002/9781118186435.

Demidenko E. Z. Optimizacija i regressija. Moscow, Nauka,

, 296 с.

Aysal T. C., Barner K. E. Meridian filtering for robust signal

processing, IEEE Trans. on Signal Processing, 2007, V. 55,

No. 8, pp. 3949–3962.

Borulko V. F., Vovk S. M. Minimum-duration filtering,

Radio Electronics, Computer Science, Control, 2016, No. 1,

pp. 7–14. DOI: 10.15588/1607-3274-2016-1-1.

Vovk S. M. General approach to building the methods of

filtering based on the minimum duration principle,

Radioelectronics and Communications Systems, 2016,

V. 59, No. 7, pp. 281–292. DOI:

3103/S0735272716070013.

Selesnick I. W., Bayram İ. Enhanced Sparsity by Non-

Separable Regularization, IEEE Transactions on Signal

Processing, 2016, Vol. 64, No. 9, pp. 2298–2313. DOI:

1109/TSP.2016.2518989.

Little M. A., Jones N. S. Generalized methods and solvers

for noise removal from piecewise constant signals. I. Background

theory, Proceedings of the Royal Society A, 2011,

Vol. 467, pp. 3088–3114. DOI:10.1098/rspa.2010.0671.

Little M. A., Jones N. S. Generalized methods and solvers

for noise removal from piecewise constant signals. II. New

methods, Proceedings of the Royal Society A, 2011,

Vol. 467, pp. 3115–3140. DOI: 10.1098/rspa.2010.0674.

Liu Q., Yang C., Gu Y., So H. C. Robust Sparse Recovery

via Weakly Convex Optimization in Impulsive Noise, Signal

Processing, 2018, Vol. 152, pp. 84–89. DOI:

=https://doi.org/10.1016/j.sigpro.2018.05.020.

Titchmarsh E. C. The theory of functions. New York, Oxford

University Press, 1939, 454 p.

Tibshirani R. Regression shrinkage and selection via the

lasso: a retrospective, Journal of the Royal Statistical Society

Series B, 2011, Vol. 73, No. 3, pp. 273–282. DOI=

https://doi.org/10.1111/j.1467-9868.2011.00771.x

Vovk S. M. Metod chislennogo differencirovanija zashumlennyh

dannyh s vybrosami, Radio Electronics, Computer

Science, Control, 2017, No. 3, pp. 44–52. DOI:

15588/1607-3274-2017-3-5].

Vovk S. M., Borul’ko V. F. Dvojstvennyj metod minimuma

prostranstvennoj protjazhennosti dlja robastnogo ocenivanija

parametrov dipol’nyh istochnikov izluchenija, Radio Electronics,

Computer Science, Control, 2014, No. 2, pp. 8–17.

DOI: 10.15588/1607-3274-2014-2-1.

How to Cite

Vovk, S. M. (2019). PROBLEM STATEMENTS OF DATA PROCESSING BASED ON CRITERION OF MINIMUM EXTENT. Radio Electronics, Computer Science, Control, (1). https://doi.org/10.15588/1607-3274-2019-1-15

Issue

Section

Progressive information technologies