A Systematic Mapping Study on Software Measurement Programs in SMEs

[1]   P. Cocca and M. Alberti, “A framework to assess performance
measurement systems in SMEs,” International Journal of Productivity and
Performance Management, Vol. 59, No. 2, 2010, pp. 186–200.

[2]   U. Loecher, “Small and medium-sized enterprises – Delimitation and the
European definition in the area of industrial business,” European Business
Review, Vol. 12, No. 5, 2000, pp. 261–264.

[3]   M. Ayyagari, T. Beck, and A. Demirguc-Kunt, “Small and medium
enterprises across the globe,” Small Business Economics, Vol. 29, No. 4,
2007, pp. 415–434.

[4]   M. Khalique, N. Bontis, J. Abdul Nassir bin Shaari, and A. Hassan
Md. Isa, “Intellectual capital in small and medium enterprises in Pakistan,”
Journal of Intellectual Capital, Vol. 16, No. 1, 2015, pp. 224–238.

[5]   N. Fenton and J. Bieman, Software metrics: A rigorous and practical
approach. CRC Press, 2014.

[6]   T. Tahir, G. Rasool, and C. Gencel, “A systematic literature review
on software measurement programs,” Information and Software Technology,
Vol. 73, 2016, pp. 101–121.

[7]   M. Díaz-Ley, F. García, and M. Piattini, “Implementing a software
measurement program in small and medium enterprises: A suitable
framework,” IET Software, Vol. 2, No. 5, 2008, pp. 417–436.

[8]   M. Díaz-Ley, F. García, and M. Piattini, “MIS-PyME software
measurement capability maturity model – Supporting the definition of
software measurement programs and capability determination,” Advances in
Engineering Software, Vol. 41, No. 10, 2010, pp. 1223–1237.

[9]   A.M. Bhatti, H.M. Abdullah, and C. Gencel, “A model for selecting an
optimum set of measures in software organizations,” in European Conference
on Software Process Improvement. Springer, 2009, pp. 44–56.

[10]   M.K. Sharma, R. Bhagwat, and G.S. Dangayach, “Practice of
performance measurement: experience from indian SMEs,” International
Journal of Globalisation and Small Business, Vol. 1, No. 2, 2005, pp.
183–213.

[11]   V. Claudia, M. Mirna, and M. Jezreel, “Characterization of software
processes improvement needs in SMEs,” in International Conference on
Mechatronics, Electronics and Automotive Engineering (ICMEAE. IEEE,
2013, pp. 223–228.

[12]   I. Richardson and C.G. Von Wangenheim, “Guest editors’ introduction:
Why are small software organizations different?” IEEE Software, Vol. 24,
No. 1, 2007, pp. 18–22.

[13]   C.Y. Laporte, S. Alexandre, and R.V. O’Connor, “A software engineering
lifecycle standard for very small enterprises,” Software Process Improvement,
2008, pp. 129–141.

[14]   B. Kitchenham, “What’s up with software metrics? – a preliminary
mapping study,” Journal of Systems and Software, Vol. 83, No. 1, 2010, pp.
37–51.

[15]   O. Gómez, H. Oktaba, M. Piattini, and F. García, “A systematic
review measurement in software engineering: State-of-the-art in measures,”
in International Conference on Software and Data Technologies. Springer,
2006, pp. 165–176.

[16]   C. Catal and B. Diri, “A systematic review of software fault prediction
studies,” Expert Systems with Applications, Vol. 36, No. 4, 2009, pp.
7346–7354.

[17]   R. Malhotra, “A systematic review of machine learning techniques for
software fault prediction,” Applied Soft Computing, Vol. 27, 2015, pp.
504–518.

[18]   D. Radjenović, M. Heričko, R. Torkar, and A. Živkovič, “Software
fault prediction metrics: A systematic literature review,” Information and
Software Technology, Vol. 55, No. 8, 2013, pp. 1397–1418.

[19]   T. Hall, S. Beecham, D. Bowes, D. Gray, and S. Counsell, “A
systematic literature review on fault prediction performance in software

engineering,” IEEE Transactions on Software Engineering, Vol. 38, No. 6,
2012, pp. 1276–1304.

[20]   M. Unterkalmsteiner, T. Gorschek, A.M. Islam, C.K. Cheng, R.B.
Permadi, and R. Feldt, “Evaluation and measurement of software process
improvementóa systematic literature review,” IEEE Transactions on
Software Engineering, Vol. 38, No. 2, 2012, pp. 398–424.

[21]   K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic
mapping studies in software engineering.” in EASE, Vol. 8, 2008, pp. 68–77.

[22]   M. Sulayman and E. Mendes, “A systematic literature review of software
process improvement in small and medium web companies,” Advances in
Software Engineering, 2009, pp. 1–8.

[23]   F.J. Pino, F. García, and M. Piattini, “Software process improvement
in small and medium software enterprises: A systematic review,” Software
Quality Journal, Vol. 16, No. 2, 2008, pp. 237–261.

[24]   A. Ahmad and M.A. Babar, “Software architectures for robotic systems:
A systematic mapping study,” Journal of Systems and Software, Vol. 122,
2016, pp. 16–39.

[25]   K. Petersen, S. Vakkalanka, and L. Kuzniarz, “Guidelines for
conducting systematic mapping studies in software engineering: An update,”
Information and Software Technology, Vol. 64, 2015, pp. 1–18.

[26]   F. García, M.F. Bertoa, C. Calero, A. Vallecillo, F. Ruíz,
M. Piattini, and M. Genero, “Towards a consistent terminology for software
measurement,” Information and Software Technology, Vol. 48, No. 8, 2006,
pp. 631–644.

[27]   S. Keele et al., “Guidelines for performing systematic literature reviews
in software engineering,” in Technical report, Ver. 2.3 EBSE Technical
Report. EBSE. sn, 2007.

[28]   J.W. Creswell, Research design: Qualitative, quantitative, and mixed
methods approaches. Sage Publications, 2013.

[29]   N. Mack, C. Woodsong, K.M. MacQueen, G. Guest, and E. Namey,
“Qualitative research methods: A data collectors field guide.” POPLine, 2005.

[30]   R. Conradi and A.I. Wang, Empirical methods and studies in software
engineering: experiences from ESERNET. Springer, 2003, Vol. 2765.

[31]   N.E. Fenton and M. Neil, “Software metrics: Successes, failures and new
directions,” Journal of Systems and Software, Vol. 47, No. 2, 1999, pp.
149–157.

[32]   G. Tom, Software Metrics. Chartwell-Bratt, 1976.

[33]   R.B. Grady and D.L. Caswell, Software metrics: Establishing a
company-wide program. Prentice Hall, 1987.

[34]   V.R. Basili, G. Caldiera, and H.D. Rombach, “The goal question metric
approach,” in Encyclopedia of Software Engineering. Wiley, 1994, pp.
528–532.

[35]   R.E. Park, W.B. Goethert, and W.A. Florac, “Goal-driven software
measurement. A guidebook,” Carnegie Mellon University, Pittsburgh, PA,
USA, Tech. Rep., 1996.

[36]   L.C. Briand, C.M. Differding, and H.D. Rombach, “Practical
guidelines for measurement-based process improvement,” Software Process
Improvement and Practice, Vol. 2, No. 4, 1996, pp. 253–280.

[37]   Ø. Moen, M. Gavlen, and I. Endresen, “Internationalization of small,
computer software firms: Entry forms and market selection,” European
Journal of Marketing, Vol. 38, No. 9/10, 2004, pp. 1236–1251.

[38]   C. Larman and V.R. Basili, “Iterative and incremental developments. A
brief history,” Computer, Vol. 36, No. 6, 2003, pp. 47–56.

[39]   A. Cockburn, Agile software development. Addison-Wesley Boston, 2002,
Vol. 177.

[40]   A. Boyd, “The goals, questions, indicators, measures (GQIM) approach
to the measurement of customer satisfaction with e-commerce Web sites,” in
Aslib proceedings, Vol. 54. MCB UP Ltd, 2002, pp. 177–187.

[41]   J. Motwani, “Critical factors and performance measures of TQM,” The
TQM magazine, Vol. 13, No. 4, 2001, pp. 292–300.

[42]   A. Abran, J.W. Moore, P. Bourque, and R. Dupuis, Eds., Guide to the
Software Engineering Body of Knowledge (SWEBOK–2004 Version). IEEE
Computer Society, 2004.

[43]   A. Abran, L. Buglione, and A. Sellami, “Software measurement body of
knowledge – initial validation using Vincenti’s classification of engineering
knowledge types,” in Software Measurement Conference, 2004, pp. 1–16.

[44]   S. Alexandre, A. Renault, and N. Habra, “POWPL: A gradual
approach for software process improvement in SMEs,” in 32nd EUROMICRO
Conference on Software Engineering and Advanced Applications. IEEE, 2006,
pp. 328–335.

[45]   A.H. Lee, W.C. Chen, and C.J. Chang, “A fuzzy AHP and BSC approach
for evaluating performance of IT department in the manufacturing industry
in Taiwan,” Expert Systems with Applications, Vol. 34, No. 1, 2008, pp.
96–107.

[46]   P. Garengo, S. Biazzo, and U.S. Bititci, “Performance measurement
systems in SMEs: A review for a research agenda,” International Journal of
Management Reviews, Vol. 7, No. 1, 2005, pp. 25–47.

[47]   O.T. Pusatli, “Software measurement activities in small and medium
enterprises: An empirical assessment,” Acta Polytechnica Hungarica, Vol. 8,
No. 5, 2011, pp. 21–42.

[48]   C. Wang, E. Walker, and J. Redmond, “Explaining the lack of strategic
planning in SMEs: The importance of owner motivation,” International
Journal of Organisational Behaviour, Vol. 12, No. 1, 2007, pp. 1–16.

[49]   J. Chen, “Development of Chinese small and medium-sized enterprises,”
Journal of Small Business and Enterprise Development, Vol. 13, No. 2,
2006, pp. 140–147.

[50]   M. Hudson, A. Smart, and M. Bourne, “Theory and practice in SME
performance measurement systems,” International Journal of Operations &
Production Management, Vol. 21, No. 8, 2001, pp. 1096–1115.

[51]   J. Iversen and L. Mathiassen, “Cultivation and engineering of a software
metrics program,” Information Systems Journal, Vol. 13, No. 1, 2003, pp.
3–19.

[52]   B. Daubner, “Empowering software development environments by
automatic software measurement,” in 11th International Symposium
Software Metrics. IEEE, 2005, p. 3.

[53]   A. Coletta, “An industrial experience in assessing the capability
of non-software processes using ISO/IEC 15504,” Software Process:
Improvement and Practice, Vol. 12, No. 4, 2007, pp. 315–319.

[54]   H. Abushama, M. Ramachandran, and P. Allen, PRISMS: an approach
to software process improvement for small to medium enterprises. UOFK,
2016.

[55]   Systems and software engineering – Measurement process, International
Organization for Standardization Standard ISO/IEC 15939:2007, 2007.

[56]   Systems and software engineering – Systems and
software Quality Requirements and Evaluation (SQuaRE) – Quality measure
elements, International Organization for Standardization Standard ISO/IEC
25021:2012, 2012.

[57]   Product quality – Part 1: Quality model, International Organization for
Standardization Standard ISO/IEC 9126-1:2001, 2001.

[58]   Information Technology – Software Product Evaluation – Parts 1-6,
International Organization for Standardization Standard ISO/IEC 14598,
2001.

[59]   
Systems and software engineering – Vocabulary, International Organization
for Standardization Standard ISO/IEC/IEEE 24765:2010, 2010.

[60]   “Capability maturity model integration (CMMI)
(continuous representation),” Carnegie Mellon University,
Tech. Rep. ICMU/SEI-2002-TR-011, 2002. [Online].
https://resources.sei.cmu.edu/asset_files/TechnicalReport/2002_005_001_14039.pdf

[61]   “Capability maturity model integration (CMMI)

(staged representation),” Carnegie Mellon University,
Tech. Rep. CMU/SEI-2002-TR-012, SEI, 2002. [Online].
https://www.sei.cmu.edu/reports/02tr029.pdf

[62]   Software engineering: Software product quality requirements and
evaluation (square) quality measure elements, International Organization for
Standardization Standard ISO/IEC 2502-1, 2005.

[63]   Product quality – Part 2: Quality model, International Organization for
Standardization Standard ISO/IEC 9126-2:2001, 2001.

[64]   Product quality – Part 3: Quality model, International Organization for
Standardization Standard ISO/IEC 9126-3:2001, 2001.

[65]   Product quality – Part 4: Quality model, International Organization for
Standardization Standard ISO/IEC 9126-4:2001, 2001.

[66]   F.G. Wilkie, D. McFall, and F. McCaffery, “An evaluation of
CMMI process areas for small-to medium-sized software development
organisations,” Software Process: Improvement and Practice, Vol. 10, No. 2,
2005, pp. 189–201.

[67]   J.A. Williams, “The impact of motivating factors on implementation of
ISO 9001:2000 registration process,” Management Research News, Vol. 27,
No. 1/2, 2004, pp. 74–84.

[68]   M. Jørgensen, “A review of studies on expert estimation of software
development effort,” Journal of Systems and Software, Vol. 70, No. 1, 2004,
pp. 37–60.

[69]   T. Tahir and C. Gencel, “A structured goal based measurement
framework enabling traceability and prioritization,” in 6th International
Conference on Emerging Technologies (ICET). IEEE, 2010, pp. 282–286.

[70]   C. Gencel, K. Petersen, A.A. Mughal, and M.I. Iqbal, “A decision
support framework for metrics selection in goal-based measurement
programs: GQM-DSFMS,” Journal of Systems and Software, Vol. 86,
No. 12, 2013, pp. 3091–3108.

[71]   J. Soini, “A survey of metrics use in finnish software companies,”
in International Symposium on Empirical Software Engineering and

Measurement (ESEM). IEEE, 2011, pp. 49–57.

[72]   P. Carbone, L. Buglione, L. Mari, and D. Petri, “A comparison between
foundations of metrology and software measurement,” IEEE Transactions on
Instrumentation and Measurement, Vol. 57, No. 2, 2008, pp. 235–241.

[73]   C. Kaner et al., “Software engineering metrics: What do they measure
and how do we know?” in 10th International Software Metrics Symposium,
METRICS. IEEE Computer Society, 2004.

[74]   A. Meneely, B. Smith, and L. Williams, “Validating software metrics: A
spectrum of philosophies,” ACM Transactions on Software Engineering and
Methodology (TOSEM), Vol. 21, No. 4, 2012, p. 24.

[75]   M. Díaz-Ley, F. García, and M. Piattini, “Implementing software
measurement programs in non mature small settings,” Software Process and
Product Measurement, 2008, pp. 154–167.

[76]   M. Díaz-Ley, F. García, and M. Piattini, “Software measurement
programs in SMEs–defining software indicators: A methodological
framework,” Product-Focused Software Process Improvement, 2007, pp.
247–261.

[77]   M. Diaz-Ley, F. García, and M. Piattini, “MIS-PyME software
measurement maturity model-supporting the definition of software
measurement programs,” Product-Focused Software Process Improvement,
2008, pp. 19–33.

[78]   A. Tosun, A. Bener, and B. Turhan, “Implementation of a software
quality improvement project in an SME: A before and after comparison,”
in 35th Euromicro Conference on Software Engineering and Advanced
Applications. IEEE, 2009, pp. 203–209.

[79]   E. Amrina and S.M. Yusof, “A proposed manufacturing performance
measures for small and medium-sized enterprises (SMEs),” in Proceedings
of the 10th Asia Pacific Industrial Engineering and Management Systems
(APIEMS) Conference, 2009, pp. 623–629.

[80]   J.A.C.M. Villalón, G.C. Agustín, T.S.F. Gilabert, A.D.A. Seco, L.G.
Sánchez, and M.P. Cota, “Experiences in the application of software process
improvement in SMEs,” Software Quality Journal, Vol. 10, No. 3, 2002, pp.
261–273.

[81]   I. Richardson and K. Ryan, “Software process improvements in a very
small company,” Software Quality Professional, Vol. 3, No. 2, 2001, pp.
23–35.

[82]   F. McCaffery, M. Pikkarainen, and I. Richardson, “AHAA–Agile,
hybrid assessment method for automotive, safety critical SMEs,” in
Proceedings of the 30th International Conference on Software Engineering.
ACM, 2008, pp. 551–560.

[83]   F.T. Shah, S. Shamail, and N. Ahmad Akhtar, “Lean quality
improvement model for quality practices in software industry in Pakistan,”
Journal of Software: Evolution and Process, Vol. 27, No. 4, 2015, pp.
237–254.

[84]   S. Bibi, I. Stamelos, G. Gerolimos, and V. Kollias, “BBN based
approach for improving the software development process of an SME –
A case study,” Journal of Software: Evolution and Process, Vol. 22, No. 2,
2010.

[85]   P. Clarke and R.V. OíConnor, “The meaning of success for software
SMEs: An holistic scorecard based approach,” in European Conference on
Software Process Improvement. Springer, 2011, pp. 72–83.

[86]   E. Caballero, J.A. Calvo-Manzano, and T. San Feliu, “Introducing
scrum in a very small enterprise: A productivity and quality analysis,”
Systems, Software and Service Process Improvement, 2011, pp. 215–224.

[87]   C.G. von Wangenheim, T. Punter, and A. Anacleto, “Software
measurement for small and medium enterprises,” in Proceeding 7th
International Conference on Empirical Assessment in Software Engineering
(EASE), 2003.

[88]   M. Sulayman, C. Urquhart, E. Mendes, and S. Seidel, “Software
process improvement success factors for small and medium Web companies:
A qualitative study,” Information and Software Technology, Vol. 54, No. 5,
2012, pp. 479–500.

[89]   N. Ohsugi, K. Fushida, N. Inoguchi, H. Arai, H. Yamanaka, T. Niwa,
M. Fujinuki, M. Tomura, and T. Kitani, “Using trac for empirical data
collection and analysis in developing small and medium-sized enterprise
systems,” in ACM/IEEE International Symposium on Empirical Software

Engineering and Measurement (ESEM). IEEE, 2015, pp. 1–9.

[90]   H.M. Haddad and D.E. Meredith, “Instituting software metrics in small
organizations: A practical approach,” in Eighth International Conference
on Information Technology: New Generations (ITNG). IEEE, 2011, pp.
227–232.

[91]   A. Potter, P. Childerhouse, R. Banomyong,
and N. Supatn, “Developing a supply chain performance tool for smes in
thailand,” Supply Chain Management: An International Journal, Vol. 16,
No. 1, 2011, pp. 20–31.

[92]   A. Janes, V. Lenarduzzi, and A.C. Stan, “A continuous software quality
monitoring approach for small and medium enterprises,” in Proceedings of the
8th ACM/SPEC on International Conference on Performance Engineering
Companion. ACM, 2017, pp. 97–100.

[93]   
H. Ayed, N. Habra, and B. Vanderose, “AM-QuICk: A measurement-based
framework for Agile methods customisation,” in Software Measurement and
the 2013 Eighth International Conference on Software Process and Product
Measurement (IWSM-MENSURA). IEEE, 2013, pp. 71–80.

[94]   S. Suwanya and W. Kurutach, “Applying agility framework in small and
medium enterprises,” Advances in Software Engineering, 2009, pp. 102–110.

[95]   E. Irrazabal, F. Vásquez, R. Díaz, and J. Garzás, “Applying ISO/IEC
12207:2008 with SCRUM and Agile methods,” Software Process Improvement
and Capability Determination, 2011, pp. 169–180.

[96]   M. Díaz, F. García, and M. Piattini, “Defining, performing and
maintaining software measurement programs: State of the art,” in IV
Simposio Internacional de Sistemas de Informacióne, 2006, p. 13.

[97]   J.C. Ruiz, Z.B. Osorio, J. Mejia, M. Muñoz, A.M. Ch, B.A. Olivares
et al., “Definition of a hybrid measurement process for the models ISO/IEC
15504 – ISO/IEC 12207:2008 and CMMI Dev 1.3 in SMEs,” in Electronics,
Robotics and Automotive Mechanics Conference (CERMA). IEEE, 2011, pp.
421–426.

[98]   M. Jezreel, M. Mirna, N. Pablo, O. Edgar, G. Alejandro, and
M. Sandra, “Identifying findings for software process improvement in SMEs:

An experience,” in Ninth Electronics, Robotics and Automotive Mechanics
Conference (CERMA). IEEE, 2012, pp. 141–146.

[99]   F.J. Pino, F. Garcia, and M. Piattini, “Key processes to start software
process improvement in small companies,” in Proceedings of the 2009 ACM
symposium on Applied Computing. ACM, 2009, pp. 509–516.

[100]   R. Chalmeta, S. Palomero, and M. Matilla, “Methodology to develop a
performance measurement system in small and medium-sized enterprises,”
International Journal of Computer Integrated Manufacturing, Vol. 25,
No. 8, 2012, pp. 716–740.

[101]   M. Lepmets and T. McBride, “Process improvement for the small and
agile,” in European Conference on Software Process Improvement. Springer,
2012, pp. 310–318.

[102]   D. Homchuenchom, C. Piyabunditkul, H. Lichter, and T. Anwar,
“SPIALS: A light-weight software process improvement self-assessment
tool,” in 5th Malaysian Conference in Software Engineering (MySEC). IEEE,
2011, pp. 195–199.