# Joint Monitoring Using Information Theoretic Control Charts

## DOI:

https://doi.org/10.6092/issn.1973-2201/16505## Keywords:

Shewhart chart, Information theoretic charts, Kullback-Leibler, Weibull distribution, Lognormal distribution## Abstract

Statistical process control consists of sophisticated and well-organized methods which contribute to monitor and improve the quality of a product. Control charts are now routinely used in many applied areas to enhance the quality of products. In this study, a general framework is presented to construct univariate control charts for joint monitoring using the information theoretic approach. To this end, we monitor a process by maximizing the entropy and by minimizing the cross entropy. Information control charts are free from strict distributional assumptions, as information charts are based on information discrepancy between the initial moment μ_{0} and the data moments r_{t} . These charts can jointly monitor mean and variance and thus provide a unified approach that is helpful in reducing the labor for designing separate charts. Besides real data applications, in this study, Monte Carlo simulations are used to assess the performance of the information charts using the average run length as a performance criterion assuming different distributions including normal, gamma, exponential, lognormal,Weibull and beta. Furthermore, a comparison with the traditional charts is also given for each distribution.

## References

N. AHMED, S. ALI, I. SHAH (2022). Type-I censored data monitoring using different conditional statistics. Quality and Reliability Engineering International, 38, no. 1, pp. 64–88.

S.ALI (2017). Time-between-events control charts for an exponentiated class of distributions of the renewal process. Quality and Reliability Engineering International, 33, no. 8, pp. 2625–2651.

S.ALI, S. M. RAZA, M.ASLAM, M.MOEEN BUTT (2021). CEV-HybridDEWMAcharts 34 M. Qureshi, S. Ali and I. Shah for censored data using Weibull distribution. Communications in Statistics-Simulation and Computation, 50, no. 2, pp. 446–461.

L. C. ALWAN, N. EBRAHIMI, E. S. SOOFI (1998). Information theoretic framework for process control. European Journal of Operational Research, 111, no. 3, pp. 526–542.

M. ASLAM, O.-H. ARIF, C.-H. JUN (2017). A control chart for gamma distribution using multiple dependent state sampling. Industrial Engineering and Management Systems, 16, no. 1, pp. 109–117.

M. ASLAM, N. KHAN, C.-H. JUN (2018). A hybrid exponentially weighted moving average chart for COM-Poisson distribution. Transactions of the Institute of Measurement and Control, 40, no. 2, pp. 456–461.

J. BOONE, S. CHAKRABORTI (2012). Two simple Shewhart-type multivariate nonparametric control charts. Applied Stochastic Models in Business and Industry, 28, no. 2, pp. 130–140.

P. L. BROCKETT (1991). Information-theoretic approach to actuarial science: A unification and extension of relevant theory and applications. Transactions of the Society of Actuaries, 91, no. 452, pp. 73–135.

G. CELANO, P. CASTAGLIOLA, S. CHAKRABORTI (2016). Joint shewhart control charts for location and scale monitoring in finite horizon processes. Computers & Industrial Engineering, 101, pp. 427–439.

S. CHAKRABORTI, M. A. GRAHAM (2019). Nonparametric (distribution-free) control charts: An updated overview and some results. Quality Engineering, 31, no. 4, pp. 523–544.

Y.-C. CHANG, C.-M. CHEN (2020). A Kullback-Leibler information control chart for linear profiles monitoring. Quality and Reliability Engineering International, 36, no. 7, pp. 2225–2248.

Y.-C. CHANG, Y.-C. WU (2022). A parameter-free exponential control chart based on Kullback-Leibler information for time-between-events monitoring. Quality and Reliability Engineering International, 38, no. 2, pp. 733–756.

K. CHATTERJEE, C. KOUKOUVINOS, A. LAPPA, P. ROUPA (2023). A joint monitoring of the process mean and variance with a generally weighted moving average maximum control chart. Communications in Statistics-Simulation and Computation, pp. 1–21.

G. CHEN, S. W. CHENG (1998). Max chart: Combining X-bar Chart and S Chart. Statistica Sinica, 08, no. 1998, pp. 263–271.

G. CHEN, S. W. CHENG, H. XIE (2001). Monitoring process mean and variability with one EWMA chart. Journal of Quality Technology, 33, no. 2, pp. 223–233.

G.CHEN, S.W.CHENG, H.XIE (2004). A newEWMAcontrol chart for monitoring both location and dispersion. Quality Technology & Quantitative Management, 1, no. 2, pp. 217–231. S. CHOWDHURY, A. MUKHERJEE, S. CHAKRABORTI (2014). A new distribution-free control chart for joint monitoring of unknown location and scale parameters of continuous

distributions. Quality and Reliability Engineering International, 30, no. 2, pp. 191–204.

S. CHOWDHURY, A.MUKHERJEE, S. CHAKRABORTI (2015). Distribution-free phase ii CUSUM control chart for joint monitoring of location and scale. Quality and Reliability Engineering International, 31, no. 1, pp. 135–151.

N. DAS (2009). A new multivariate non-parametric control chart based on sign test. Quality Technology & Quantitative Management, 6, no. 2, pp. 155–169.

N. DAS, A. BHATTACHARYA (2008). A new non-parametric control chart for controlling variability. Quality Technology & Quantitative Management, 5, no. 4, pp. 351–361.

M. L. DELIGNETTE-MULLER, C. DUTANG, et al. (2015). Fitdistrplus: An R package for fitting distributions. Journal of Statistical Software, 64, no. 4, pp. 1–34.

K. DERYA, H. CANAN (2012). Control charts for skewed distributions: Weibull, gamma, and lognormal. Metodoloski Zvezki, 9, no. 2, pp. 95–106.

R. DOMANGUE, S. C. PATCH (1991). Some omnibus exponentially weighted moving average statistical process monitoring schemes. Technometrics, 33, no. 3, pp. 299–313.

M. DOOSTPARAST, S. DEEPAK, A. ZANGOIE (2013). Estimation with the lognormal distribution on the basis of records. Journal of Statistical Computation and Simulation, 83, no. 12, pp. 2339–2351.

F. F. GAN (1995). Joint monitoring of process mean and variance using exponentially weighted moving average control charts. Technometrics, 37, no. 4, pp. 446–453.

V. GHADAGE, V. GHUTE (2023). A nonparametric control chart for joint monitoring of location and scale. Reliability: Theory & Applications, 18, no. 1(72), pp. 553–563.

R. D. GUPTA, D. KUNDU (2001). Exponentiated exponential family: an alternative to gamma and weibull distributions. Biometrical Journal, 43, no. 1, pp. 117–130.

R. D. GUPTA, D. KUNDU (2003). Closeness of gamma and generalized exponential distribution. Communications in Statistics-Theory and Methods, 32, no. 4, pp. 705–721.

S. HAO, S. HUANG, J. YANG (2016). Design of gamma control charts based on the narrowest confidence interval. In 2016 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM). pp. 219–223.

D. M. HOLLAND, T. FITZ-SIMONS (1982). Fitting statistical distributions to air quality data by the maximum likelihood method. Atmospheric Environment (1967), 16, no. 5, pp. 1071–1076.

W.-H. HUANG, H. WANG, A. B. YEH (2016). Control charts for the lognormal mean. Quality and Reliability Engineering International, 32, no. 4, pp. 1407–1416.

Z. JALILIBAL,A.AMIRI, M. B.KHOO (2022). Aliterature reviewon joint control schemes in statistical process monitoring. Quality andReliability Engineering International, 38, no. 6, pp. 3270–3289.

E. T. JAYNES (1957). Information theory and statistical mechanics. American Physical Society, 106, no. 4, pp. 620–630.

J. N. KAPUR (1989). Maximum-entropy models in science and engineering. John Wiley & Sons, New York.

M. B. C. KHOO, S. Y. TEH, Z.WU (2010). Monitoring process mean and variability with one double EWMA chart. Communications in Statistics—Theory and Methods, 39, no. 20, pp. 3678–3694.

S. KULLBACK (1959). Statistics and information theory. J.Wiley and Sons, New York.

C. LI, A. MUKHERJEE, Q. SU, M. XIE (2016). Design and implementation of two CUSUM schemes for simultaneously monitoring the process mean and variance with unknown parameters. Quality and Reliability Engineering International, 32, no. 8, pp. 2961–2975.

A.MCCRACKEN, S.CHAKRABORTI (2013). Control charts for joint monitoring of mean and variance: an overview. Quality Technology & Quantitative Management, 10, no. 1, pp. 17–36.

P.W.MIELKE JR (1975). Convenient beta distribution likelihood techniques for describing and comparing meteorological data. Journal of Applied Meteorology, 14, no. 6, pp. 985–990.

D. C. MONTGOMERY (2019). Introduction to statistical quality control. John Wiley & Sons, New York, 8 ed.

A.MUKHERJEE, S. CHAKRABORTI (2012). A distribution-free control chart for the joint monitoring of location and scale. Quality and Reliability Engineering International, 28, no. 3, pp. 335–352.

A. MUKHERJEE, A. K. MCCRACKEN, S. CHAKRABORTI (2015). Control charts for simultaneous monitoring of parameters of a shifted exponential distribution. Journal of Quality Technology, 47, no. 2, pp. 176–192.

M. NABEEL, S. ALI, I. SHAH (2021). Robust proportional hazard-based monitoring schemes for reliability data. Quality and Reliability Engineering International, 37, no. 8, pp. 3347–3361.

A. RAJAN, Y. C. KUANG, M. P.-L. OOI, S. N. DEMIDENKO, H. CARSTENS (2018). Moment-constrained maximum entropy method for expanded uncertainty evaluation. IEEE Access, 6, pp. 4072–4082.

S. Z. RAMADAN (2018). Joint and control charts optimal design using genetic algorithm. Mathematical Problems in Engineering, 2018, pp. 1–10.

S. M. M. RAZA, S. ALI, I. SHAH, M. M. BUTT (2021). Conditional mean-and median based cumulative sum control charts for Weibull data. Quality and Reliability Engineering International, 37, no. 2, pp. 502–526.

S. M. M. RAZA, A. F. SIDDIQI (2017). EWMA and DEWMA control charts for Poissonexponential distribution: conditional median approach for censored data. Quality and Reliability Engineering International, 33, no. 2, pp. 387–399.

E. M. SANIGA (1977). Joint economically optimal design of ¯x and r control charts. Management Science, 24, no. 4, pp. 420–431.

T. SAWA (1978). Information criteria for discriminating among alternative regression models. Econometrica: Journal of the Econometric Society, 46, no. 6, pp. 1273–1291.

R. SHANKER, H. FESSHAYE, S. SELVARAJ (2015). On modeling of lifetimes data using exponential and Lindley distributions. Biometrics & Biostatistics International Journal, 2, no. 5, pp. 1–10.

J. SHORE, R. JOHNSON (1980). Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Transactions on Information Theory, 26, no. 1, pp. 26–37.

E. S. SOOFI, N. EBRAHIMI, M. HABIBULLAH (1995). Information distinguishability with application to analysis of failure data. Journal of the American Statistical Association, 90, no. 430, pp. 657–668.

Y. TAKEMOTO, I. ARIZONO (2023). Kullback–Leibler Information Control Chart, John Wiley&Sons, Ltd, pp. 1–10. URLhttps://onlinelibrary.wiley.com/doi/abs/ 10.1002/9781118445112.stat08408.

C.-C. TORNG, H.-N. LIAO, P.-H. LEE, J.-C. WU (2009). Performance evaluation of a Tukey’s control chart in monitoring gamma distribution and short run processes. Proceedings of the International MultiConference of Engineers and Computer Scientists, 2, pp. 18–20.

E. M.WHITE, R. SCHROEDER (1987). A simultaneous control chart. Journal of Quality Technology, 19, no. 1, pp. 1–10.

L. XUE, Q. WANG, Z. HE, P. QIU (2023). A nonparametric EWMA control chart for monitoring mixed continuous and count data. Quality Technology & Quantitative Management. URL https://doi.org/10.1080/16843703.2023.2246765.

## Downloads

## Published

## How to Cite

*Statistica*,

*83*(1), 41–80. https://doi.org/10.6092/issn.1973-2201/16505

## Issue

## Section

## License

Copyright (c) 2023 Statistica

This work is licensed under a Creative Commons Attribution 3.0 Unported License.