The comparative studies on reliability for Rayleigh models
Ji Eun Oh 1 · Joong Kweon Sohn 2
12 Department of Statistics, Kyungpook National University
Received 12 January 2018, revised 12 March 2018, accepted 13 March 2018
Abstract
In this paper, several methods to estimate the reliability R of a Rayleigh model as a function of given time t are proposed and studied. Many research have been done by providing some informations on parameters of a Raleigh model rather R itself. Here R is a probability to endure a certain level of stress. Thus for the Bayesian method, several priors are given to R directly. Also a bootstrap method and a maximum likelihood method are examined and compared with a Bayesian method in term of mean square errors. we find that Bayesian methods perform better than other methods.
Keywords: Bayes estimator, bootstrap estimator, maximum likelihood estimator, rayleigh distribution, reliability.
1. Introduction
Reliability is the probability that a product or system will work properly for a specified period of time under the design operating conditions without failure. So that the reliability depends on specific time as a random variable and its function from the chosen distribution can be estimated and controled for system maintenance. The study of reliability is important to develop the appropriate future plans to improve the quality and performance of the system recently. Many authors had been studied to estimate the reliability from their own statistical distribution function that they assumed.
Among all the statistical life time model, the Rayleigh distribution is the most important models and the widely used in large-scale tests in life and reliability. In this study, we assume that the life times of units follow a Rayleigh distribution, which has been widely used to describe life time reliability analyses.
The study of maximum likelihood estimation (MLE) of reliability with different distribu- tion have been discussed by several authors. The MLE is used to derive point and asymptotic confidence estimates of the unknown parameters. First Harter and Moore (1965) showed an explicit form for the MLE of based on type II censored data. Thoman et al. (1970) studied with maximum likelihood (ML) estimator and exact confidence interval for reliability and
1
Graduate student, Department of Statistics, Kyungpook National University, Daegu 41566, Korea.
2
Corresponding author: Professor, Department of Statistics, Kyungpook National University, Daegu
41566, Korea. E-mail: [email protected]
tolerance limits in the Weibull distribution. Dyer and Whisenand (1973) considered the best linear unbiased estimator of the parameter of the Rayleigh distribution. Smith et al. (1987) considered MLE and exact confidence intervals for reliability in the Weibull Distribution.
Kang and Kim (1994) considered the approximate MLE of scale parameter of weibull dis- tribution with type II censoring. Lee et al. (2014) also studied reliability estimation and ratio distribution in a general exponential distribution. Kim and Cha (2016) considered the bivariate reliability models with multiple dynamic competing risks.
Inferences for the Rayleigh distribution have been discussed by several authors. Sinha and Howlader (1983) showed the Credible and highest predictive density (HPD) intervals of the parameter and reliability of Rayleigh distribution. The approximate MLE is proofed as effi- cient as the best linear unbiased estimator of Rayleigh distribution by Balakrishnan (1989).
Bayesian estimation and prediction problems for the Rayleigh distribution based on Type II censored sample have been considered by Fernandez (2000). Wu et al. (2006) considered the Bayesian estimator and prediction intervals for future observations based on progressively type II censored samples. Kim and Han (2009) considered ML estimator, approximate ML estimator and Bayes estimation procedures for the scale parameter based on a multiply type II censored sample. Dey (2009) compared the Bayes estimates of reliability function with different loss function. Recently, Lee et all (2010) considered the reliability of right truncated Rayleigh distribution. Pak et al. and Kweon et al. (2014) considered the reliability estima- tion with Rayleigh distribution on fuzzy lifetime data and type I hybrid censored sample, respectively. Rasheed and Aaref (2016) studied reliability estimation in inverse Rayleigh distribution using precautionary loss function with MLE method and Bayesian method.
Most of studies deal with scale parameter of Rayleigh or inverse Rayleigh distribution so far according to literature reviews. We focus on estimating reliability of Rayleigh distribution and derive three estimator of reliability that not focus on the distribution parameter but on reliability parameter directly.
We use the following notation that the Rayleigh distribution with the scale parameter σ and the corresponding density function f (x; σ) for σ > 0 is given by
f (x; σ) = x
σ 2 e −
2σ2x2, x > 0, σ > 0 (1.1) and reliability function as follow.
θ = R(t) = P (X > t) = e −
2σ2t2, x > 0, t > 0, σ > 0. (1.2) This study has two objectives. First, it aims to develop three estimators of reliability based on the MLE method, bootstrap method and Bayesian method. We also focus on reliability function to estimate not the scale parameter of Rayleigh distribution. The second objective is to compute and compare the confidence intervals of reliability using the estimators from the previous three method.
In Section 2, we calculate the maximum likelihood (ML) estimator of the reliability func-
tion θ with MLE method and derive the asymptotic distribution and the confidence interval
of θ. In order to the confidence limits for parameter, we calculate the Fisher information
matrix to obtain the asymptotic variances and covariance of the ML estimator of the pa-
rameter.
In Section 3, we generate the bootstrap samples using the ML estimator from section 2 and obtain the bootstrap estimator and confidence interval of bootstrap sample with N replications.
In Section 4, we derive the Bayes estimator of reliability with the inverse gamma prior on scale parameter and HPD confidence interval.
In Section 5, we show some results based on Monte-Carlo simulation to compare the mean squared error (MSE) of each estimator using MLE method and bootstrap method and Bayesian method in different sample size and the scale parameter σ. Also we showed some results of three kinds of confidence interval of reliability and compare the coverage probability and interval length of each estimator.
2. Maximum likelihood estimation (MLE) method
The method of maximum likelihood estimation by Harter and Moore (1965) is a commonly used procedure because it has very desirable properties.
The Rayleigh distribution applies to a non-limited positive continuous variable, the prob- ability density function and the cumulative distribution function is given by:
f (x, σ) = x
σ 2 e −
2σ2x2, x > 0, σ > 0, (2.1) F (x, σ) =1 − e −
2σ2x2, x > 0, σ > 0, (2.2) where x is a continuous random variable defined over (0, ∞) and σ is the scale parameter.
The reliability function on specific time t which is R(t),
θ = R(t) = P (X > t) = Z t
0
F (x, σ)dx = e −
2σ2t2, x > 0, t > 0, σ > 0.
We recalled R(t) is a function of θ, θ = e −
2σ2t2, t > 0, σ > 0 and σ 2 = − 2logθ t
2.
To find the estimate of ML estimator of reliability function R(t), we first have to find the ML estimator of σ 2 which is a scale parameter of the Rayleigh distribution.
Suppose x = (x 1 , x 2 , · · · , x n ) be an observed random sample of size n from the Rayleigh distribution, where σ is a scale parameter. The likelihood function of the observed sample is
L(σ|x) = 1 σ 2n
n
Y
i=1
x i
!
exp −
n
X
i=1
x 2 i 2σ 2
!
. (2.3)
The log-likelihood function may then be written as
l(σ|x) = log(L(σ|x)) =
n
X
i=1
logx i − 2nlogσ − P n
i=1 x 2 i
2σ 2 . (2.4)
The ML estimator of σ 2 can be obtained by first derivative of (2.4) with respect to σ,
σ ˆ 2 = P x 2 i 2n .
The likelihood function of θ, which can be obtained by replace the σ 2 = − 2logθ t
2to (2.3) is given by
L(θ|x) =
− 2logθ t 2
n n Y
i=1
x i
! exp
− P x 2 i 2
− 2logθ t 2
(2.5)
and log-likelihood function of θ may then be written as
l(θ|x) = nlog(2logθ) − 2nlogt + X
logx i + P x 2 i t 2
logθ. (2.6)
Calculating the first partial derivatives of (2.6) with respect to θ and equating to zero, we obtain the likelihood equation
∂l(θ|x)
∂θ = n
θlogθ + P x 2 i t 2
1 θ = 0.
Hence, the ML estimator of θ
θ ˆ M LE = exp
− t 2 n P x 2 i
. (2.7)
We can get the ˆ θ M LE with invariance properties of MLE.
θ ˆ M LE = ˆ R(t) = exp
− t 2 2ˆ σ 2
= exp
− t 2 n P x 2 i
. (2.8)
2.1. Asymptotic distribution and confidence interval of reliability
In this section, first we need to find the asymptotic distribution of ˆ σ 2 and then we drive the asymptotic distribution of ˆ θ. Base on the asymptotic distribution of ˆ θ, we can get the asymptotic confidence interval of θ. In order to the confidence limits for parameter, we calculate the Fisher information matrix to obtain the asymptotic variances and covariance of the ML estimator of the parameter.
From the log-likelihood function in (2.6), we have
∂ 2 l(θ|x)
∂θ 2 = n
(1 + logθ) − P x 2 i t 2
1
θ 2 . (2.9)
The Fisher information I(θ) is then obtained by taking expectation of minus (2.9). In practice, we usually estimate the I(θ) by I 0 (ˆ θ) that obtained by following
I(θ) = −E ∂ 2 l(θ|x)
∂ 2 θ
,
I 0 (ˆ θ) = − E
n
(1 + logθ) − P x 2 i t 2
1 θ 2
= 2nσ 2 (1 + logθ) − nθ 2 t 2 θ 2 t 2 (1 + logθ) ,
V ar(ˆ θ) = 1
I 0 (ˆ θ) = θ 2 t 2 (1 + logθ) 2n ˆ σ 2 (1 + logθ) − nθ 2 t 2
.
Under some mild regularity conditions ˆ θ is approximately normally distributed with mean θ and variance d V ar(ˆ θ).
θ ∼ N (θ, d ˆ V ar(ˆ θ)).
Thus, the 100(1 − α)% approximate confidence interval for θ is
θ − z ˆ
α2
q
V ar(ˆ d θ), θ + z ˆ
α2
q V ar(ˆ d θ)
,
V AR(ˆ [ θ) = θ 2 t 2 (1 + logθ) 2n ˆ σ 2 (1 + logθ) − nθ 2 t 2 ,
= θ 2 t 2 (1 + logθ) P x 2 i (1 + logθ) − nθ 2 t 2 , where z
α2
is the percentile of the standard normal distribution with right-tail probability α 2 and ˆ σ 2 = P x 2n
2i.
3. Bootstrap method
The bootstrap method introduced in Efron (1982) is a very general resampling procedure for estimating the distributions of statistics based on independent observations. The boot- strap method is shown to be successful in many situations, which is being accepted as an alternative to the asymptotic methods.
For the above example, we can easily calculate its bootstrap distribution. We can easily
imagine that the above computation becomes too complicated to compute directly if n is
large. Therefore, simple random sampling was proposed to generate bootstrap distribution.
In the bootstrap literature, a variety alternatives are suggested other than simple random sampling.
The following steps are followed to obtain bootstrap sample from Rayleigh distribution with parameter.
Step 1 : Generate random samples x 1 , x 2 , · · · , x n is a data sample drawn from Rayleigh distribution with the scale parameter σ and compute the ML estimator of σ 2 , ˆ σ 2 . Step 2 : Generate a bootstrap sample x ∗ 1 , x ∗ 2 , · · · , x ∗ n from Rayleigh distribution with σ ˆ 2 . Based on bootstrap sample, compute the new estimator of scale parameter, ˆ σ ∗ and bootstrap estimator of reliability using equation (2.8), say ˆ θ Boot .
Step 3 : Repeat Step2, NBOOT times. NBOOT is 2000 replications.
3.1. The bootstrap confidence interval of reliability
In this section, we propose to use the percentile bootstrap method based on the idea of Efron (1982). We follow the next few step to get the bootstrap interval of estimator using bootstrap method.
To generate the confidence intervals by bootstrapping, the sampling distribution of the parameter θ is simulated by sampling over and over from the current data and recomputing parameter estimates θ from each “bootstrapped” sample. The variability shown by the many θ ∗ values gives us a hint about the variability of the one estimate θ we got from our data.
Step 1 : Generate random samples x 1 , x 2 , · · · , x n is a data sample drawn from Rayleigh distribution with the scale parameter σ 2 and compute the ML estimator of σ 2 , ˆ σ 2 . Step 2 : Using ˆ σ 2 , generate a bootstrap sample x ∗ 1 , x ∗ 2 , · · · , x ∗ n from Rayleigh distribu- tion. Based on bootstrap sample, compute bootstrap estimate of reliability using ˆ σ ∗ and equation (2.8), say ˆ θ Boot .
Step 3 : Repeat Step2-3 NBOOT times based on N different bootstrap samples.
Step 4 : Generate the confidence interval of which has asymptotic normal distribution with mean θ and variance d V ar(ˆ θ ∗ ).
4. Bayesian method
Bayesian analysis is an important approach to statistics, which formally seeks use of prior information and Bayes Theorem provides the formal basis for using this information. An important pre-requisite in Bayesian estimation is the appropriate choice of prior for the parameters. However, Bayesian analysts also hard to choose which prior is better than the other. Very often, priors are chosen according to ones subjective knowledge and beliefs. In this paper, we derive the Bayes estimator with the inverse gamma prior on scale parameter and comparing with non-informative prior at simulation study.
First we develop the Bayesian estimation procedure for the estimation of reliability form
Rayleigh distribution assuming independent inverse gamma prior for the unknown model
parameters. Thus, we consider the natural conjugate prior for given by
π(σ) = β α
Γ(α) σ −(α+1) exp
− β 2σ 2
∝ 1 σ
(α+1)
exp
− β 2σ 2
, σ > 0, α > 0, β > 0, (4.1) where shape parameter α > 0 and scale parameter β > 0. This density is known as the square-root inverted gamma distribution.
By combining (2.6) and (4.1), the posterior density of σ is given by
π(σ|x) =
2 P x
2 i+β 2
2n+α2Γ 2n+α 2 (σ 2 ) n+α+1 exp
− P x 2 i + β 2σ 2
, (4.2)
where it is the inverse gamma density, IG(α, β) with α = 2n+α 2 , β = P x 2
2i+β . It is well known that the Bayes estimator of σ under squared loss function.
To estimate the reliability function θ, θ = e −
2σ2t2, t > 0, σ > 0 and substituting σ 2 = − 2logθ t
2into (4.2). The posterior probability density function of θ is given by
π(θ|x) =
P x
2 i+β 2
2n+α2Γ 2n+α 2
exp
P x
2i+β
−
2logθt2− logθ t
2 2n+α+22
t 2 2
(logθ) −2 1 θ ,
=
P x
2 i+β 2
2n+α2Γ 2n+α 2 θ
2n+α2−1 (−logθ)
2n+α2−1 , 0 < θ < 1. (4.3) The Bayes estimator of reliability function θ with the squared error loss function which is L(ˆ θ, θ) = (ˆ θ − θ) 2 , ˆ θ Bayes is by Dey (2009),
θ ˆ Bayes =E(θ|x) = Z ∞
0
θpi(θ|x)dθ
θ ˆ Bayes =
1 + t 2 P x 2 i + β
−
n+α2. (4.4)
If α = 0, β = 0, we get a non-informative prior and also if α = 1, β = 1, we get a inverse gamma prior.
4.1. The Bayesian confidence interval of relability
In order to derive the confidence interval for Bayes estimator, we use the posterior density
function of θ. We already have the posterior probability density function from previous
chapter and given by
π(θ|x) =
P x
2 i+β 2
2n+α2Γ 2n+α 2 θ
P x2i+β
2