PCI Express Technology Comprehensive Guide to Generations 1.x, 2.x and 3.0
“MindShare books are critical in the understanding of complex technical topics, such as
PCI Express 3.0 architecture. Many of our customers and industry partners depend on
these books for the success of their projects”
Joe Mendolia - Vice President, LeCroy
PCI EXPRESS
TRAINING
AT www.mindshare.com
LIVE COURSES:
Comprehensive PCI Express
Fundamentals of PCI Express
Intro to PCI Express
eLEARNING COURSES:
Comprehensive PCI Express
Fundamentals of PCI Express
Intro to PCI Express
MindShare
Technology
Series
PCI Express ® 3.0 is the latest generation of the
popular peripheral interface found in virtually
every PC, server, and industrial computer. Its high
bandwidth, low latency, and cost-to-performance
ratio make it a natural choice for many peripheral
devices today. Each new generation of PCI
Express adds more features, capabilities and
bandwidth, which maintains its popularity as a
device interconnect.
MindShare’s books take the hard work out of
deciphering the specs, and this one follows that
tradition. MindShare's PCI Express Technology
book provides a thorough description of the
interface with numerous practical examples that
illustrate the concepts. Written in a tutorial style,
this book is ideal for anyone new to PCI Express.
At the same time, its thorough coverage of the
details makes it an essential resource for
seasoned veterans.
(QoS)
Essential topics covered include:
• PCI Express Origins
• Configuration Space and Access Methods
• Enumeration Process
• Packet Types and Fields
• Transaction Ordering
• Traffic Classes, Virtual Channels and Arbitration
• Flow Control
• ACK/NAK Protocol
• Logical PHY
• Electrical PHY
• Link Training and Initialization
• Interrupt Delivery
• Error Detection and Reporting
• Power Management (for both software and hardware)
• 2.0 and 2.1 Features
,
and Multi-Casting)
• 3.0 Features
• Considerations for High Speed Signaling
(such as Equalization)
(8b/10b, 128b/130b, Scrambling)
(such as 5.0GT/s, TLP Hints
(Legacy, MSI, MSI-X)
(such as 8.0GT/s, and a new encoding scheme)
Mike Jackson is a Senior Staff Engineer with MindShare and
has trained thousands of engineers around the world on the
workings of PCI Express. Mike has developed materials and
taught courses on such topics as PC Architecture, PCI, PCI-X,
and SAS. Mike brings several years of design experience to
MindShare, including both systems integration work and
development of several ASIC designs.
.
2
x
a
n
d
3
0
.
MindShare Technology Series
PCI Express
Technology
For training, visit mindshare.com
Comprehensive Guide to Generations 1.x, 2.x and 3.0
Mike Jackson, Ravi Budruk
MindShare, Inc.
i
C
o
m
p
r
e
h
e
n
s
i
v
e
G
u
d
e
t
o
G
e
n
e
r
a
t
i
o
n
s
1
x
.
,
P
C
I
E
x
p
r
e
s
s
T
e
c
h
n
o
o
g
y
l
MindShare is a world-renowned training and publishing company that
sets a high standard of excellence in training and enables high-tech
companies to adopt, implement, and roll out cutting-edge technologies
quickly and condently. We bring life to knowledge through a wide variety
of exible learning methods and delivery options. MindShare now goes
beyond the classroom to deliver engaging interactive eLearning, both in a
virtual classroom and an online module format. Visit www.mindshare.com
to learn more about our enthusiastic and experienced instructors, courses,
eLearning, books and other training delivery options.
Contact MindShare at training@mindshare.com or 1-800-633-1440
for training on PCI Express or any of our many other topics.
$89.99 USA
Mike Jackson
MindShare, Inc.
MindShare Press
PCIe 3.0.book Page i Sunday, September 2, 2012 11:25 AM
PCI Express
Technology
Comprehensive Guide to Generations 1.x, 2.x, 3.0
MINDSHARE, INC.
Mike Jackson
Ravi Budruk
Technical Edit by Joe Winkles and Don Anderson
Book Ad.fm Page 0 Wednesday, August 29, 2012 5:37 PM
MindShare Live Training and Self-Paced Training
Intel Ivy Bridge Processor
Intel 64 (x86) Architecture
Intel QuickPath Interconnect (QPI)
Computer Architecture
Intel Architecture
•
•
•
•
AMD Architecture
• MD Opteron Processor (Bulldozer)
• MD64 Architecture
Firmware Technology
• UEFI Architecture
•
BIOS Essentials
ARM Architecture
• ARM Architecture
Graphics Architecture
• Graphics Hardware Architecture
Programming
•
•
• OpenCL Programming
X86 Architecture Programming
X86 Assembly Language Basics
Virtualization Technology
•
•
PC Virtualization
IO Virtualization
PCI Express 3.0
SAS Architecture
Serial ATA Architecture
IO Buses
•
• USB 3.0 / 2.0
•
xHCI for USB
Storage Technology
•
•
• NVMe Architecture
Memory Technology
• odern DRAM Architecture
High Speed Design
• High Speed Design
•
Surface-Mount Technology (SMT)
•
•
EMI/EMC
SMT Manufacturing
SMT Testing
Are your company’s technical training needs being addressed in the most effective manner?
MindShare has over 25 years experience in conducting technical training on cutting‐edge technologies.
We understand the challenges companies have when searching for quality, effective training which
reduces the students’ time away from work and provides cost‐effective alternatives. MindShare offers
many flexible solutions to meet those needs. Our courses are taught by highly‐skilled, enthusiastic,
knowledgeable and experienced instructors. We bring life to knowledge through a wide variety of learn‐
ing methods and delivery options.
MindShare offers numerous courses in a self‐paced training format (eLearning). We’ve taken our 25+
years of experience in the technical training industry and made that knowledge available to you at the
click of a mouse.
training@mindshare.com
1‐800‐633‐1440
www.mindshare.com
ARBOR
The Ultimate Tool to View, Edit and Verify
Configuration Settings of a Computer
Apply Standard and
Custom Rule Checks
Decode Data from
Live Systems
Directly Edit Config,
Memory and IO Space
Everything Driven from
Open Format XML
mindshare.com | 800.633.1440 | training@mindshare.com
Feature List
• Scan config space for all PCI-visible
functions in system
• Run standard and custom rule checks
to find errors and non-optimal settings
• Write to any config space location,
memory address or IO address
• View standard and non-standard
structures in a decoded format
• Import raw scan data from other
tools (e.g. lspci) to view in Arbor’s
decoded format
• Decode info included for standard
PCI, PCI-X and PCI Express structures
• Decode info included for some
x86-based structures and device-
specific registers
• Create decode files for structures in
config space, memory address space
and IO space
• Save system scans for viewing later
or on other systems
• All decode files and saved system
scans are XML-based and open-format
COMING SOON
Decoded view of x86 structures
(MSRs, ACPI, Paging, Virtualization, etc.)
BY
ArborAdEnd.fm Page 1 Wednesday, August 29, 2012 8:52 PM
The Ultimate Tool to View,
Edit and Verify Configuration
Settings of a Computer
BY
MindShare Arbor is a computer system debug, validation, analysis and learning tool
that allows the user to read and write any memory, IO or configuration space address.
The data from these address spaces can be viewed in a clean and informative style as
well as checked for configuration errors and non-optimal settings.
View Reference Info
MindShare Arbor is an excellent reference tool to quickly look at standard PCI, PCI-X and PCIe
structures. All the register and field definitions are up-to-date with the PCI Express 3.0.
x86, ACPI and USB reference info will be coming soon as well.
Decoding Standard and Custom Structures from a Live System
MindShare Arbor can perform a scan of the system it is running on to record the config space from
all PCI-visible functions and show it in a clean and intuitive decoded format. In addition to scanning
PCI config space, MindShare Arbor can also be directed to read any memory address space and IO
address space and display the collected data in the same decoded fashion.
Run Rule Checks of Standard and Custom Structures
In addition to capturing and displaying headers and capability structures from PCI config space, Arbor
can also check the settings of each field for errors (e.g. violates the spec) and non-optimal values
(e.g. a PCIe link trained to something less than its max capability). MindShare Arbor has scores of
these checks built in and can be run on any system scan (live or saved). Any errors or warnings are
flagged and displayed for easy evaluation and debugging.
MindShare Arbor allows users to create their own rule checks to be applied to system scans. These
rule checks can be for any structure, or set of structures, in PCI config space, memory space or IO space.
The rule checks are written in JavaScript. (Python support coming soon.)
Write Capability
MindShare Arbor provides a very simple interface to directly edit a register in PCI config space, memory
address space or IO address space. This can be done in the decoded view so you see what the
meaning of each bit, or by simply writing a hex value to the target location.
Saving System Scans (XML)
After a system scan has been performed, MindShare Arbor allows saving of that system's scanned
data (PCI config space, memory space and IO space) all in a single file to be looked at later or sent to
a colleague. The scanned data in these Arbor system scan files (.ARBSYS files) are XML-based and
can be looked at with any text editor or web browser. Even scans performed with other tools can be
easily converted to the Arbor XML format and evaluated with MindShare Arbor.
PCIe 3.0.book Page i Wednesday, August 29, 2012 4:03 PM
PCI Express
Technology
Comprehensive Guide to Generations 1.x, 2.x, 3.0
MINDSHARE, INC.
Mike Jackson
Ravi Budruk
Technical Edit by Joe Winkles and Don Anderson
PCIe 3.0.book Page ii Sunday, September 2, 2012 11:25 AM
Many of the designations used by manufacturers and sellers to distinguish their prod‐
ucts are claimed as trademarks. Where those designators appear in this book, and
MindShare was aware of the trademark claim, the designations have been printed in ini‐
tial capital letters or all capital letters.
The authors and publishers have taken care in preparation of this book, but make no
expressed or implied warranty of any kind and assume no responsibility for errors or
omissions. No liability is assumed for incidental or consequential damages in connec‐
tion with or arising out of the use of the information or programs contained herein.
Library of Congress Cataloging‐in‐Publication Data
Jackson, Mike and Budruk, Ravi
PCI Express Technology / MindShare, Inc., Mike Jackson, Ravi Budruk....[et al.]
Includes index
ISBN: 978‐0‐9836465‐2‐5 (alk. paper)
1. Computer Architecture. 2.0 Microcomputers ‐ buses.
I. Jackson, Mike II. MindShare, Inc. III. Title
Library of Congress Number: 2011921066
ISBN: 978‐0‐9836465‐2‐5
Copyright ©2012 by MindShare, Inc.
All rights reserved. No part of this publication may be reproduced, stored in a retrieval
system, or transmitted, in any form or by any means, electronic, mechanical, photocopy‐
ing, recording, or otherwise, without the prior written permission of the publisher.
Printed in the United States of America.
Editors: Joe Winkles and Don Anderson
Project Manager: Maryanne Daves
Cover Design: Greenhouse Creative and MindShare, Inc.
Set in 10 point Palatino Linotype by MindShare, Inc.
Text printed on recycled and acid‐free paper
First Edition, First Printing, September, 2012
PCIe 3.0.book Page iii Sunday, September 2, 2012 11:25 AM
“This book is dedicated to my sons, Jeremy and Bryan – I love you guys
deeply. Creating a book takes a long time and a team effort, but it’s finally
done and now you hold the results in your hand. It’s a picture of the way
life is sometimes: investing over a long time with your team before you
see the result. You were a gift to us when you were born and we’ve
invested in you for many years, along with a number of people who have
helped us. Now you’ve become fine young men in your own right and it’s
been a joy to become your friend as grown men. What will you invest in
that will become the big achievements in your lives? I can hardly wait to
find out.”