practical model- based testing
This page intentionally left blank
practical model- based
testing
a tools approach
Mark Utting
Bruno Legeard
AMSTERDAM • BOSTON • HEIDELBERG • LONDON
SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO
NEW YORK • OXFORD • PARIS • SAN DIEGO
Morgan Kaufmann Publishers is an imprint of Elsevier
Denise E. M. Penrose
George Morrison
Mary E. James
Marilyn E. Rash
Yvo Design
VTeX
Joan M. Flaherty
Carol Leyba
Ted Laux
Sheridan Books
Phoenix Color Corp.
Publisher
Publishing Services Manager
Assistant Editor
Project Manager
Cover Design
Composition and Illustrations
Copyeditor
Proofreader
Indexer
Interior printer
Cover printer
Morgan Kaufmann Publishers is an imprint of Elsevier.
500 Sansome Street, Suite 400, San Francisco, CA 94111
This book is printed on acid-free paper.
© 2007 by Elsevier Inc. All rights reserved.
Designations used by companies to distinguish their products are often claimed as trademarks or
registered trademarks. In all instances in which Morgan Kaufmann Publishers is aware of a claim,
the product names appear in initial capital or all capital letters. Readers, however, should contact
the appropriate companies for more complete information regarding trademarks and registration.
No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any
form or by any means—electronic, mechanical, photocopying, scanning, or otherwise—without
prior written permission of the publisher.
Permissions may be sought directly from Elsevier’s Science & Technology Rights Department in
Oxford, UK: phone: (+44) 1865 843830, fax: (+44) 1865 853333, E-mail: permissions@elsevier.com.
You may also complete your request on-line via the Elsevier homepage http://elsevier.com, by select-
ing “Support & Contact” then “Copyright and Permission” and then “Obtaining Permissions.”
Library of Congress Cataloging-in-Publication Data
Utting, Mark.
Practical model-based testing : a tools approach / Mark Utting,
Bruno Legeard.
p. cm.
Includes bibliographical references and index.
ISBN-13: 978-0-12-372501-1 (alk. paper)
ISBN-10: 0-12-372501-1 (alk. paper)
1. Computer software—Testing. 2. Computer software—Testing—
Automation. I. Legeard, Bruno. II. Title.
QA76.76.T48U98 2006
005.3028’7–dc22
2006034511
ISBN 13: 978-0-12-372501-1
ISBN 10: 0-12-372501-1
For information on all Morgan Kaufmann publications, visit our
Web site at www.mkp.com or www.books.elsevier.com
Printed in the United States of America
06 07 08 09 10
5 4 3 2 1
This book is dedicated to the memory of Julien Orsat,
an enthusiastic practitioner of model-based testing
and valued employee of LEIRIOS Technologies,
whose life was tragically cut short on the icy roads
of Franche-Comté on December 28, 2005.
This page intentionally left blank
contents
xiii
Preface
About the Authors
1 The Challenge
1
xix
1.1 What Do We Mean by Testing? 3
1.2 What Is Model-Based Testing? 6
1.3 A Smart Card Example 10
1.4 Summary
1.5 Further Reading 17
17
2 The Pain and the Gain 19
19
2.1 Classic Testing Processes
35
40
41
vii
20
2.1.1 A Manual Testing Process
2.1.2 A Capture/Replay Testing Process
2.1.3 A Script-Based Testing Process
2.1.4 A Keyword-Driven Automated Testing Process
2.1.5 Solved and Remaining Problems
26
23
22
25
24
2.2 The Model-Based Testing Process
2.3 Models: Build or Borrow?
2.4 Your Maturity Level
33
31
2.4.1 Your Testing Maturity Level
2.4.2 Your Modeling Maturity Level
33
34
2.5 Hypothetical Case: Total Testing Hours
2.5.1 Assumptions 36
2.5.2 Conclusions 38
2.6 Model-Based Testing Experience Reports
2.6.1 Model-Based Testing at IBM 40
2.6.2 Model-Based Testing at Microsoft