Messages in this thread | | | Date | Wed, 21 May 2014 19:32:58 -0400 | From | Murali Karicheri <> | Subject | Re: [PATCH v1 5/5] pci: keystone: add pcie driver based on designware core driver |
| |
On 5/20/2014 1:02 PM, Jason Gunthorpe wrote: > On Fri, May 16, 2014 at 08:29:56PM +0000, Karicheri, Muralidharan wrote: > >> But pcie_bus_configure_settings just make sure the mrrs for a device >> is not greater than the max payload size. > Not quite, it first scans the network checking the Maximum Payload Size > Supported (MPSS) for each device, and chooses the highest supported by > all as the MPS for all. Why highest? It should be lowest so that all on the bus can handle it?? > > PCI-E requires that an end point support all packets up to the MPS, so > if your bridge can't generate a 512 byte read response packet, then it > must not advertise a MPSS greater than 256 bytes. What is MPSS? Is it the payload size in a message TLP? I read the PCIe spec and find MRSS is the maxumum read request size. So memory reads completion data size is limited to this size, right? So for DMA from EP to RC can't be greater than what RC publishes. Not sure how they are related?
I have checked that root port is advertising 256 bytes for mrrs and 128 bytes for mps in the config space. So keystone pcie bridge is doing as expected.
In Keystone case, what I see is after adding pcie_bus_configure_settings() with pci=pcie_bus_safe, I get following log.
[ 1.988851] pcie_bus_configure_settings, config 1 [ 1.988860] pcie_bus_configure_set [ 1.988879] pcieport 0000:00:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512 [ 1.988887] pcie_bus_configure_set [ 1.988921] pci 0000:01:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512 [ 1.988928] pcie_bus_configure_set [ 1.988961] pci 0000:01:00.1: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512
So it is not limiting MRRS to 256 bytes.
With pci=pcie_bus_perf
[ 1.985777] pcie_bus_configure_settings, config 2 [ 1.985783] pcie_bus_configure_set [ 1.985810] pcieport 0000:00:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 256 [ 1.985818] pcie_bus_configure_set [ 1.985875] pci 0000:01:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 256 [ 1.985882] pcie_bus_configure_set [ 1.985939] pci 0000:01:00.1: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 256
Is this log what you expect?
> > Setting your MPSS to 128, 256, then using the > pcie_bus_configure_settings to run the standard algorithm should > properly limit the readrq to 256 and be able to properly support all > the fun edge cases like hot plug.
> If the config space in your root port bridge is correct and already > declares a MPSS of 256 then you have nothing else to do but make sure > pcie_bus_configure_settings gets calls. > > If it is broken and claims a higher MPSS than it can support then you > need to use a quirk only for the root port bridge or edit the config > reply in the driver only to fix the MPSS If MRSS is clamped to lowest, then this would work with out a quirk, and has to be unconditional (all cases, safe, performance etc).
I would like to go with the quirk approach until this discussion concludes the next step to fix this issue. May be someone can take owner ship of this change at PCI core level?
My quirk can be removed once the fix is accepted into the tree. Is that an acceptable path forward?
Murali > > Jason
| |