C ONCLUSION

This paper illustrates how we can prioritize the software modules in order to test the impor-tant modules primarily with the help of the fuzzy multi-criteria approach and the fuzzy rule based system. The advantage of this approach is that it optimizes the testing costs and time for individual components.

By prioritizing, the software modules with the fuzzy multi-criteria approach made sure that critical errors do not pass undetected during testing. Thus, the exact time when the software can be released can be predicted using the above proposed model. After allowing a little deviation from the values and accepting low risk faults in the system, we can test the software effectively even if we have limited resources available to us. The fault tolerance concept assists us in testing the software within a given time and cost. At the end of the resources, we can also find out if we have tested enough or if there is a further need for testing the important modules. This facilitates us in being able to make a decision about whether the software product is ready to be released in the market or not.

In this paper, a simple and efficient method has been proposed to deal with the multi-criteria ranking of alternatives in the presence of uncertainty. It has been shown that the concept of fuzziness is worth considering in the ranking of modules in the cases where criteria values and criteria weights are vague linguistic terms. By using discrete fuzzy sets to describe vague lin-guistic terms, the handling of uncertainty in the proposed ranking method is computationally attractive.

R

[1] Roger S Pressman, “Software Engineering: A Practitioner’s Approach”, TMH sixth Edition 2006.

[2] Aditya P. Mathur, “Foundations of Software Testing. perason education, First edition 2008.

[3] Harrold M, Testing: A Roadmap, In Future of Software Engineering, 22nd International Conference on Software Engineering, Limerick, Ireland, 2000.

[4] Beizer, B, Software Testing Techniques, 2nd. Edition, US, 2000.

Fig. 16. Chart representing the comparisons of effort estimations

Praveen Ranjan Srivastava

[5] Nageswaran Suresh, Test Effort Estimation Using Use Case Points. Quality Week 2001, San Fran-cisco, California, USA, available at http://www.cognizant.com/html/content/cogcommunity/Test_ Ef-fort_Estimation.pdf.

[6] Dalal and McIntosh, “When to Stop Testing for Large Software Systems with Changing Code,” IEEE Transaction On Software Engineering, Vol.20, No.4, April, 1994.

[7] FuLi Jin, Guisheng Yin and Dekun Yang, “Fuzzy Integrated Evaluation for Measuring Quality of Feature Space-Based Component Model”, Proceedings of International Conference on Internet Com-puting in Science and Engineering, 2008, pp.349-354.

[8] Souheil Khaddaj and G Horgan, “The Evaluation of Software Quality Factors in Very Large Informa-tion Systems”, Electronic Journal of informaInforma-tion system EvaluaInforma-tion, Vol.7, Issue 1, 2004.

[9] Sandra A. Slaughter, Donald E Harter and Mayuram S Krishnan, “Evaluation the cost of software quality” Communications of the ACM Vol.41, Issue 8, 1998, pp.67-73.

[10] J. E. Gaffney,”Metrics in Software Quality Assurance”, ACM Annual Conference/Annual Meeting, 1981, pp.126-130.

[11] Joseph P. CavaNo.and James A. McCall,” A Framework for the Measurement of Software Quality”, Proceedings of the software quality assurance workshop on Functional and performance, 1978, pp.133-139.

[12] Roy, B,”Multi-criteria Methodology for Decision Aiding”, Dordrecht, Kluwer Academic Publishers, 1996.

[13] Lily Lin and Huey-Ming Lee, “A Fuzzy Software Quality Assessment Model to Evaluate User Satis-faction”, Proceedings of the Second International Conference on Innovative Computing, Information and Control, IEEE Computer Society, 2007, pp.1-4.

[14] Bo Yang, Lan Yao and Hong-Zhong Huang, “Early Software Quality Prediction Based on a Fuzzy Neural Network Model”, ICNC, Vol.1, 2007, pp.760-764.

[15] Klir, G., & Folger T.,”Fuzzy Sets, Uncertainty and Information”, Prentice Hall, 1988.

[16] Yager, R.R, “Fuzzy decision making including unequal objectives”, Fuzzy Sets and Systems Vol.1, 1978, pp.87-95.

[17] Baas, S.M. and Kwakernaak, H, “Rating and Ranking of Multiple - Aspect Alternatives Using Fuzzy Sets”, Automatica Vol.13, 1977, pp.47-58.

[18] Dong, W.M. and Wong, F.S, “Fuzzy weighted averages and implementation of the extension princi-ple”, Fuzzy Sets and Systems Vol.21, 1987, pp.183-199.

[19] Carlsson, C and Fuller, R “Fuzzy multiple criteria decision making”, Recent developments Fuzzy Sets and Systems Vol.78, 1996, pp.139-153.

[20] Singh Ajit Pratap and A. K. Vidarthi, “Optimal allocation of landfill disposal site: A fuzzy multi-criteria approach”, Iranian Journal of Environmental Health Science & Engineering, Vol.5 No.1, 2008, pp.25-34.

[21] Ribeiro, R.A, “Fuzzy multiple attribute decision making: A review and new preference elicitation techniques”, Fuzzy Sets and Systems Vol.78, 1996, pp.155-181.

[22] Radojevic, D. and Petrovic, S,”A Fuzzy Approach to Preference Structure in Mult-criteria Ranking”, International Transactions in Operational Research Vol.4, No.5/6, 1997, pp.419-430.

[23] Srivastava Praveen Ranjan,Singh Ajit Pratap,V Vagesh,Chapter name : Assessment of software qual-ity: a fuzzy multi criteria approach (as a book chapter) Chapter No.11, pp200-219.

http://www.igi-global.com/bookstore/Chapter.aspx?TitleId=44377.

[24] Hamer Peter G. & Frewin Gillian D,”M.H. Halstead's Software Science - a critical examination”, International Conference on Software Engineering, Tokyo, Japan, 1982, pp.197-206.

[25] M. H. Halstead,”Software Science-A progress report”, Second Software Life Cycle Management Workshop, Atlanta, sponsored by the IEEE and the U.S. Army Computer Systems Command, 1978.

[26] Kushwaha Dharmender Singh & Misra A.K. “Software Test Effort Estimation”, ACM SIGSOFT Software Engineering Notes Vol.33, No.3, 2008.

[27] McCabe, T,”A Software Complexity Measure”, IEEE Transactions on Software Engineering, Vol.2, No.4, 1976, pp.308-320.

Optimal Software Release Using Time and Cost Benefits via Fuzzy Multi-Criteria and Fault Tolerance

[28] Jones, Capers,”Applied software measurement”, McGraw-Hill, 1996.

[29] Nagappan, N,” Toward a software testing and reliability early warning metric suite”, 26th Interna-tional Conference on Software Engineering [ICSE], 2004, pp.60-62.

[30] Nageswaran Suresh,” Test Effort Estimation Using Use Case Points”. Quality Week 2001, San Fran-cisco, California, USA, 2001, http://www.cognizant.com/html/content/cogcommunity/Test_Effort_

Estimation.pdf

[31] Jørgensen, M.,”Realism in Assessment of Effort Estimation Uncertainty: It Matters How You Ask”.

IEEE Transactions on Software Engineering, Vol.30, No.4, 2004, pp.209-217.

[32] Eduardo Aranha, Paulo Borba, “an Estimation Model for Test Execution Effort”, Empirical Software Engineering and Measurement [ESEM] conference, 2007, pp.107-116.

[33] Xu. S. and Rajlich. V, “Cognitive Process during Program Debugging”, 3rd IEEE International Conference on Cognitive Informatics [ICCI], 2004, pp.176-182.

[34] Dawson Christian W,” An Artificial Neural Network Approach to software testing effort estimation”, Information and Communication Technologies, Vol.20, Transaction of the Wessex Institute, UK, 1998.

[35] Xishi Huang, Danny Ho, Jing Ren, Luiz F. Capretz. “Improving the COCOMO model using a neuro-fuzzy approach”, Applied Soft Computing, Vol.7, 2007, pp.29-40.

[36] Pressman, R.S.,”Software engineering: A Practitioner’s Approach”, 6th Ed, India: TMH, 2005.

[37] Abhishek Chintala, Kumar Pavan Veginati, Vitta Harish, Srivastava Ranjan Praveen, “Test Effort Estimation using Neural network”, journal of Software Engineering and Applications, Vol.3 No.4, Scientific Research Publishing, Inc. USA, 2010, pp.331-340.

[38] Srivastava Ranjan Praveen,Singh A.P., Saggar Suresh, Raghurama G.” Optimization of Software Testing Effort using Fuzzy logic”, International journal of Computer Sciences and Engineering Sys-tems, Vol.3, No.3, ISSN 0973-4406, 2009, pp.179-184.

[39] Srivastava Ranjan Praveen, “Estimation of Software Testing Effort: An Intelligent Approach”, Ac-cepted in IEEE ISSRE 2009, Bangalore. (Under Fast Abstract), available in supplementary proceed-ing http://www.issre2009.org/papers/issre2009_179.pdf,

[40] McDaid Kevin and Wilson Simon P, “Deciding How Long to Test Software,” The Statistician, Royal Statistical Society, Part 2, 50, 2001, pp.117-134.

[41] Dalal S.R.and Mallows C.L., “When Should One StopTesting Software?” Journal of the American Statistical Association, Vol.83, No.403, 1988, pp.872-879.

[42] Musa, J.D., and Ackerman, A.F., “Quantifying software validation: when to stop testing?” IEEE Software,Vol.6, Issue 3, 1989, pp.19-27.

[43] Ehrlich, W., Prasanna, B., Stampfel, J., and Wu, J., “Determining the cost of a stop-test decision [software reliability],” IEEE Software, Vol.10, Issue 2, 1993, pp.33-42.

[44] Goel, A.L., and Okumoto, K., “When to stop testing and start using software?” Proc. of ACM, 1981, pp.131-137.

[45] Goel, A.L., and Okumoto, K., “A Time Dependent Error Detection Rate Model for Software Per-formance Assessment with Applications”, Proc. National Computer Conference, RADC-TR-80-179, May, 1980.

[46] Goel, A.L., and Okumoto, K., “A Time Dependent Error Detection Rate Model for Software Reliabil-ity and Other Performance Measures,” IEEE Transactions on ReliabilReliabil-ity, Vol.R-28, No.3, August, 1979, 1979, pp.206-211.

[47] Hongyu Zhang, “On The Distribution Of Software Faults “IEEE Transactions on Software Engineer-ing, Vol.34, No.2, 2008, pp.301-302.

[48] Srivastava Praveen Ranjan, Pareek Deepak, Sati Kailash, Pujari Dinesh C, Raghurama G, “Non -Homogenous Poisson Process Based Cumulative Priority Model for Determining Optimal Software Testing Period,” ACM SIGSOFT Software Engineering Notes, Vol.33, Issue 2, March, 2008.

[49] Srivastava Ranjan Praveen, “Model for Optimizing Software Testing Period using Non Homogenous Poisson Process based on Cumulative Test Case Prioritization,” IEEE TENCON, Hyderabad, India, 18-21 November, 2008.

Praveen Ranjan Srivastava

[50] Srivastava Ranjan Praveen, Gupta Abhishek, Mathur Pulkit, Tiwari Kumar Sushil,”When to stop testing Using Non Homogenous Poisson Process Based Cumulative priority Based Model”, Interna-tional journal of Computer Sciences and Engineering Systems., Vol.3, No.4, ISSN 0973-4406, 2009, pp.345-350.

[51] Srivastava Ranjan Praveen, Mittal Chetan, Rungta Ajay, Malhotra Vaibhav, Raghurama .”Non ho-mogeneous Poisson process model for optimal software testing using fault tolerance”, MIS Review:

An International Journal,Vol.15, No.2, ISSN: 10181393, National Chengchi University & Airiti Press Inc., Tiwan, 2010, pp.77-92.

[52] Srivastava Praveen Ranjan, Pareek Deepak, “Component Prioritization Schema for Achieving Maxi-mum Time and Cost Benefits from Software Testing,” IEEE Region 10 Colloquium and the Third ICIIS, Kharagpur, INDIA December, 8-10, 2008.

[53] Yang, M.C.K.; Chao, A. Reliability-estimation and stopping-rules for software testing, based on re-peated appearances of bugs; IEEE Transactions on Reliability, Vol.44, No.2, 1995, pp.315-21.

[54] Zeleny, M.,”Multiple Criteria Decision Making”, McGraw-Hill, NewYork, 1982.

[55] L. A. Zadeh, “Fuzzy Sets,” in Information and Control, Vol.8. Issue 3, Academic Press, 1965, pp.338-353.

[56] R. E. Bellman and L. A. Zadeh, “Decision-making in a fuzzy environment,” Management Science, Vol.17, 1970, pp.141-164.

[57] Vania Peneva, Ivan Popchev, “Fuzzy Multicriteria Decision Making”, cybernetics and Information technologies 1, Sofia, 2002.

[58] Boehm Barry,”Software Engineering Economics”, USA: Prentice-Hall, 1981.

[59] Somerville Ian, “Software Engineering”, 7th Edition, India: Pearson Education, 2005.

[60] Boehm Barry and Ellis Harrowith,” Software cost estimation with COCOMO II”, Englewood Cliffs:

Prentice-Hall, 2000.

[61] Bennatan, E. M, “so what is the state of software Estimation?” The cutter Edge, 2003.

[62] Kaner Cem, “Exploratory Testing”, Worldwide Annual Software Testing Conference, Florida Insti-tute of Technology, Quality Assurance InstiInsti-tute Orlando, 2006.

[63] Novák, V., Perfilieva, Močkoř, J., “Mathematical principles of fuzzy logic”, Dodrecht/Kluwer Aca-demic press, 1999.

[64] Driankov, D., Hellendoor, H., & Reinfark, M., “an Introduction to Fuzzy Control”, New York:

Springer, 1994.

[65] Peter, B., Stephan, N., Roman, W, “A brief course in Fuzzy logic and Fuzzy Control”, Department of knowledge-based Mathematical systems, 1996.

[66] Srivastava Ranjan Praveen,Jain Puneet,Sing Ajit Pratap,Raghurama G,”Software quality factors evaluation using fuzzy multi-criteria approach”, in 4th Indian International Conference on Artificial Intelligence (IICAI), Bangalore, INDIA, ISBN:978-0-9727412-7-9, 2009, pp.1012-1029.

[67] Srivastava Ranjan Praveen, Kumar Sirish,Singh Ajit Pratap,Raghurama G,”Software Testing Effort:

An Assessment Through fuzzy criteria approach, in Journal of Uncertain Systems, Vol.5, No.3, World Academic Press, UK,ISSN: 1752-8909, 2011, pp.183-201.

[68] Padhy N.P, “Artificial Intelligence and Intelligent System”, oxford press, 2005.

[69] M.Ganesh, “Introduction to Fuzzy sets and Fuzzy logic”, Prentice Hall, 2006.