logo资料库

《Google软件测试之道》英文文字版 非扫描版 带标签 超清晰.pdf

第1页 / 共314页
第2页 / 共314页
第3页 / 共314页
第4页 / 共314页
第5页 / 共314页
第6页 / 共314页
第7页 / 共314页
第8页 / 共314页
资料共314页,剩余部分请下载后查看
Table of Contents
Foreword
Foreword
Preface
Chapter 1 Introduction to Google Software Testing
Quality ≠ Test
Roles
Organizational Structure
Crawl, Walk, Run
Types of Tests
Chapter 2 The Software Engineer in Test
The Life of an SET
Development and Test Workflow
Who Are These SETs Anyway?
The Early Phase of a Project
Team Structure
Design Docs
Interfaces and Protocols
Automation Planning
Testability
SET Workflow: An Example
Test Execution
Test Size Definitions
Use of Test Sizes in Shared Infrastructure
Benefits of Test Sizes
Test Runtime Requirements
Case 1: Change in Common Library
Test Certified
An Interview with the Founders of the Test Certified Program
Interviewing SETs
An Interview with Tool Developer Ted Mao
An Interview with Web Driver Creator Simon Stewart
Chapter 3 The Test Engineer
A User-Facing Test Role
The Life of a TE
Test Planning
Risk
Life of a Test Case
Life of a Bug
Recruiting TEs
Test Leadership at Google
Maintenance Mode Testing
Quality Bots Experiment
BITE Experiment
Google Test Analytics
Free Testing Workflow
External Vendors
An Interview with Google Docs TE Lindsay Webster
An Interview with YouTube TE Apple Chow
Chapter 4 The Test Engineering Manager
The Life of a TEM
Getting Projects and People
Impact
An Interview with Gmail TEM Ankit Mehta
An Interview with Android TEM Hung Dang
An Interview with Chrome TEM Joel Hynoski
The Test Engineering Director
An Interview with Search and Geo Test Director Shelton Mar
An Interview with Engineering Tools Director Ashish Kumar
An Interview with Google India Test Director Sujay Sahni
An Interview with Engineering Manager Brad Green
An Interview with James Whittaker
Chapter 5 Improving How Google Tests Software
Fatal Flaws in Google’s Process
The Future of the SET
The Future of the TE
The Future of the Test Director and Manager
The Future of Test Infrastructure
In Conclusion
Appendix A: Chrome OS Test Plan
Overview of Themes
Risk Analysis
Per-Build Baseline Testing
Per-LKG Day Testing
Per-Release Testing
Manual Versus Automation
Dev Versus Test Quality Focus
Release Channels
User Input
Test Case Repositories
Test Dashboarding
Virtualization
Performance
Stress, Long-Running, and Stability
Test Execution Framework (Autotest)
OEMs
Hardware Lab
E2E Farm Automation
Testing the Browser AppManager
Browser Testability
Hardware
Timeline
Primary Test Drivers
Relevant Documents
Appendix B: Test Tours for Chrome
The Shopping Tour
The Student Tour
Suggested Areas to Test
The International Calling Tour
Suggested Areas to Test
The Landmark Tour
Suggested Landmarks in Chrome
The All Nighter Tour
Suggested Areas to Test
The Artisan’s Tour
Tools in Chrome
The Bad Neighborhood Tour
Bad Neighborhoods in Chrome OS
The Personalization Tour
Ways to Customize Chrome
Appendix C: Blog Posts on Tools and Code
Take a BITE out of Bugs and Redundant Labor
Unleash the QualityBots
RPF: Google’s Record Playback Framework
Google Test Analytics—Now in Open Source
Comprehensive
Quick
Actionable
Sustained Value
Index
A
B
C
D
E
F
G
H
I
J-K
L
M
N
O
P
Q-R
S
T
U
V
W-X-Y-Z
ptg7759704
Praise for How Google Tests Software “James Whittaker has long had the pulse of the issues that are shaping testing practice. In the decade of the Cloud Transformation, this book is a must read not just for Googlers, but for all testers who want their prac- tices to remain relevant, competitive, and meaningful.” —Sam Guckenheimer, Product Owner, Visual Studio Strategy, Microsoft “Google has consistently been an innovator in the app testing space— whether it’s blending test automation with manual efforts, melding in- house and outsourced resources, or more recently, pioneering the use of in-the-wild testing to complement their in-the-lab efforts. This appetite for innovation has enabled Google to solve new problems and launch better apps. In this book, James Whittaker provides a blueprint for Google’s suc- cess in the rapidly evolving world of app testing.” —Doron Reuveni, CEO and Cofounder, uTest “This book is a game changer, from daily releases to heads-up displays. James Whittaker takes a computer-science approach to testing that will be the standard for software companies in the future. The process and tech- nical innovations we use at Google are described in a factual and enter- taining style. This book is a must read for anyone involved in software development.” —Michael Bachman, Senior Engineering Manager at Google Inc., AdSense/Display “By documenting much of the magic of Google’s test engineering prac- tices, the authors have written the equivalent of the Kama Sutra for mod- ern software testing.” —Alberto Savoia, Engineering Director, Google “If you ship code in the cloud and want to build a strategy for ensuring a quality product with lots of happy customers, you must study and seri- ously consider the methods in this book.” —Phil Waligora, Salesforce.com “James Whittaker is an inspiration and mentor to many people in the field of testing. We wouldn’t have the talent or technology in this field without his contributions. I am consistently in awe of his drive, enthusi- asm, and humor. He’s a giant in the industry and his writing should be required reading for anyone in the IT industry.” —Stewart Noakes, Chairman TCL Group Ltd., United Kingdom
“I worked with James Whittaker during his time at Microsoft, and although I miss having him here at Microsoft, I knew he would do great things at Google. James, Jason Arbon, and Jeff Carollo have packed this book with innovative testing ideas, practical examples, and insights into the Google testing machine. Anyone with an ounce of curiosity about Google’s approach to testing and quality or with the smallest desire to discover a few new ideas in testing will find value in these pages.” —Alan Page, Microsoft Xbox, and Author of HowWe Test Software at Microsoft ptg7759704
How Google Tests Software ptg7759704
This page intentionally left blank ptg7759704
How Google Tests Software James Whittaker Jason Arbon Jeff Carollo Upper Saddle River, NJ • Boston • Indianapolis • San Francisco New York • Toronto • Montreal • London • Munich • Paris • Madrid Capetown • Sydney • Tokyo • Singapore • Mexico City ptg7759704
Publisher Paul Boger Executive Editor Chris Guzikowski Senior Development Editor Chris Zahn Managing Editor Kristy Hart Project Editor Jovana San Nicolas-Shirley Copy Editor Ginny Bess Munroe Indexer Erika Millen Proofreader Mike Henry Editorial Assistant Olivia Basegio Cover Designer Anne Jones Compositor Gloria Schurick Many of the designations used by manufacturers and sellers to distin- guish their products are claimed as trademarks. Where those designa- tions appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals. The authors and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein. The publisher offers excellent discounts on this book when ordered in quantity for bulk purchases or special sales, which may include elec- tronic versions and/or custom covers and content particular to your business, training goals, marketing focus, and branding interests. For more information, please contact: U.S. Corporate and Government Sales (800) 382-3419 corpsales@pearsontechgroup.com For sales outside the United States, please contact: International Sales international@pearson.com Visit us on the Web: informit.com/aw The Library of Congress cataloging-in-publication data is on file. Copyright © 2012 Pearson Education, Inc. All rights reserved. Printed in the United States of America. This pub- lication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, elec- tronic, mechanical, photocopying, recording, or likewise. To obtain permission to use material from this work, please submit a written request to Pearson Education, Inc., Permissions Department, One Lake Street, Upper Saddle River, New Jersey 07458, or you may fax your request to (201) 236-3290. ISBN-13: 978-0-321-80302-3 ISBN-10: 0-321-80302-7 Text printed in the United States on recycled paper at Courier in Westford, Massachusetts. First printing: March 2012 ptg7759704
To all testers at Google, Microsoft, and elsewhere who’ve made me think differently. —James A. Whittaker To my wife Heather and my children Luca, Mateo, Dante, and Odessa who thought I worked at Starbucks all this time. —Jason Arbon To Mom, Dad, Lauren, and Alex. —Jeff Carollo ptg7759704
分享到:
收藏