Messages in this thread | | | Date | Mon, 27 Apr 2009 12:34:15 -0700 | From | David Hawkins <> | Subject | Re: [PATCH] fsldma: use PCI Read Multiple command |
| |
Hi all,
>> You are assuming the PCI memory space is prefetchable( no side effect) >> for DMA. Is it possible that DMA is from non-prefetchable memory space? > > This should be a safe assumption for this driver. Remember, this > driver just does offload memcpy, from one region to another. So the > PCI memory that you are reading from should be just a buffer of data, > and there should be side-effect of reading it. > > However, I would like to see a comment at the top of the file warning > people that copying from PCI memory will result in prefetched reads. >
Here's a few results from DMA tests between two MPC8349EA boards housed in a CPCI chassis.
1. DMA mode register (DMAMRn) PCI read command (PRC, bits 11:10)
a) DMAMRn[PRC] = 00 = PCI Read
The PCI read command is 6h on the PCI bus. For DMA lengths of less than 1 cache line (32-bytes) the DMA controller will generate a PCI 6h command. However, for lengths of 32-bytes and higher, the DMA controller actually generates a PCI Read Line (Eh) command.
Freescale indicated that this 'change of PCI command code' functionality is an undocumented 'feature', there to improve performance for longer read lengths.
b) DMAMRn[PRC] = 01 = PCI Read Line
Generated the PCI command code for PCI read line (Eh), regardless of DMA length.
c) DMAMRn[PRC] = 10 = PCI Read Multiple
Generated the PCI command code for PCI Read Multiple (Ch), regardless of DMA length.
2. DMA from areas marked as non-prefetchable.
We setup two test cases:
a) Two boards in the same PCI segment with no intervening bridges.
b) Two boards in separate PCI segments with intervening bridges (in this case, there was two bridges on SBS CPCI-to-CPI backplane bridging cards).
The PCI window to the IMMR registers on the boards is marked as non-prefetchable. DMA from that area (reads) appeared on the PCI bus as single 32-bit read transactions, i.e., the target device effectively ignores the PCI read command, and the target returns read data as single reads, i.e., the target acts as as non-prefetchable memory.
We tested with the PCI Read Multiple command, and no data was ever prefetched from the target. The bridges did not prefetch and discard data, eg. we tried 36-bytes, and there were 9 separate 4-byte transactions (we were using a 32-bit PCI host for this test). Hence, at least for this example target device, there are no side effects to using PCI read multiple on the bus master, to a target PCI memory region marked as non-prefetchable.
So even though the bridges were seeing transactions that indicated read multiple, only single read cycles were seen to be used.
Would you like some sort of summary of this info for a commit message?
Would you like us to check any other transaction/register combos?
Cheers, Dave
| |