[lkml]   [2009]   [Jan]   [30]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    Patch in this message
    SubjectRe: 2.6.29-rc3: tg3 dead after resume

    On Fri, 30 Jan 2009, Linus Torvalds wrote:
    > I still think the patch isn't very good. See my previous email.
    > The fact that your machine works again is good, though. But before we let
    > this lie, I'd _really_ like to know what was broken in the legacy PM path,
    > rather than "let's leave it behind". Because a broken legacy path will end
    > up biting us for other drivers, and I think the new PM path will need more
    > work before it's ready for prime-time.

    Ho humm. I have a feeling..

    The legacy resume basically ends up doing just


    in the resume_early path (in pci_pm_default_resume_noirq, which is shared
    with both the legacy and the new PM model).

    The _new_ PM layer does that too (it's shared), but then in the regular
    resume sequence it _also_ does the pci_pm_reenable_device(), and I think
    this is key.


    Look at pci_restore_standard_config(): it restores the PCI config space,
    but it does so _before_ actually turning the device into PCI_D0. And
    that's not actually guaranteed to work at all - if a device is in D3, you
    can still read from config space, but writing to it may or may not
    actually work.

    This may explain why your PCIE bridge works when moving over to the new
    PM: because of the whole pci_pm_reenable_device() thing, we end up
    doing the pci_enable_resources() thing later, and now it's in PCI_D0, so
    now the device actually reacts to it.

    This also explains why we don't care if we save the wrong state or not:
    even if we save state with IO/MEM disabled, we'll re-enable it at
    ->resume() time.

    HOWEVER, that's still buggy, since it's potentially too late, since any
    interrupts that come in before that will see the device without the IO/MEM
    set, leading to the whole "hung interrupt" issue again even if the device
    is now on.

    So we really do want to restore the state to whatever saves state in the
    _early_ resume phase, both for legacy and new PM rules, I think. And we
    want to make sure that we restore state while the device is in D0, because
    otherwise I really think that it possibly could lose our writes.

    (Somebody should check me on that - maybe I remember wrong, and config
    space writes are guaranteed to take effect even when something is in

    So I think we should:

    - make sure that the generic PCI layer saves the right state, for the new
    PM model too. Don't save it if the driver already did (because the
    driver may have turned off the device after saving the state)

    - make sure that the legacy PM layer turns the device on before it
    restores the state, to make sure that it "takes".

    I dunno. I haven't really walked through all the states, but _something_
    like this might do it. Note the change to pci_pm_default_suspend_generic:
    we save the state only if the driver didn't do it already (which is also
    why I ended up having to move all the "dev->state_saved = false" things
    around), and we do not disable the device (because for all we know, the
    low-level drivers will still need access to the IO/MEM space even at the
    suspend_late stage!).


    drivers/pci/pci-driver.c | 20 +++++++++++++-------
    drivers/pci/pci.c | 3 +++
    drivers/pci/pcie/portdrv_pci.c | 14 --------------
    3 files changed, 16 insertions(+), 21 deletions(-)

    diff --git a/drivers/pci/pci-driver.c b/drivers/pci/pci-driver.c
    index 9de07b7..5611f22 100644
    --- a/drivers/pci/pci-driver.c
    +++ b/drivers/pci/pci-driver.c
    @@ -355,8 +355,6 @@ static int pci_legacy_suspend(struct device *dev, pm_message_t state)
    int i = 0;

    if (drv && drv->suspend) {
    - pci_dev->state_saved = false;
    i = drv->suspend(pci_dev, state);
    suspend_report_result(drv->suspend, i);
    if (i)
    @@ -434,13 +432,18 @@ static int pci_pm_default_resume(struct pci_dev *pci_dev)

    static void pci_pm_default_suspend_generic(struct pci_dev *pci_dev)
    - /* If device is enabled at this point, disable it */
    - pci_disable_enabled_device(pci_dev);
    - * Save state with interrupts enabled, because in principle the bus the
    - * device is on may be put into a low power state after this code runs.
    + * If the driver didn't save state, do it here with interrupts enabled,
    + * because in principle the bus the device is on may be put into a
    + * low power state after this code runs.
    - pci_save_state(pci_dev);
    + if (!pci_dev->state_saved)
    + pci_save_state(pci_dev);
    +#if 0 /* Why? */
    + /* If device is enabled at this point, disable it */
    + pci_disable_enabled_device(pci_dev);

    static void pci_pm_default_suspend(struct pci_dev *pci_dev)
    @@ -498,6 +501,7 @@ static int pci_pm_suspend(struct device *dev)
    struct device_driver *drv = dev->driver;
    int error = 0;

    + dev->state_saved = false;
    if (pci_has_legacy_pm_support(pci_dev))
    return pci_legacy_suspend(dev, PMSG_SUSPEND);

    @@ -583,6 +587,7 @@ static int pci_pm_freeze(struct device *dev)
    struct device_driver *drv = dev->driver;
    int error = 0;

    + pci_dev->state_saved = false;
    if (pci_has_legacy_pm_support(pci_dev))
    return pci_legacy_suspend(dev, PMSG_FREEZE);

    @@ -657,6 +662,7 @@ static int pci_pm_poweroff(struct device *dev)
    struct device_driver *drv = dev->driver;
    int error = 0;

    + pci_dev->state_saved = false; /* Do we care? */
    if (pci_has_legacy_pm_support(pci_dev))
    return pci_legacy_suspend(dev, PMSG_HIBERNATE);

    diff --git a/drivers/pci/pci.c b/drivers/pci/pci.c
    index 17bd932..d16af49 100644
    --- a/drivers/pci/pci.c
    +++ b/drivers/pci/pci.c
    @@ -1421,6 +1421,9 @@ int pci_restore_standard_config(struct pci_dev *dev)

    dev->current_state = PCI_D0;

    + /* Restore state _again_, now that the device is actually on */
    + pci_restore_state(dev);
    return 0;

    diff --git a/drivers/pci/pcie/portdrv_pci.c b/drivers/pci/pcie/portdrv_pci.c
    index 99a914a..08a8e3c 100644
    --- a/drivers/pci/pcie/portdrv_pci.c
    +++ b/drivers/pci/pcie/portdrv_pci.c
    @@ -55,16 +55,6 @@ static int pcie_portdrv_suspend(struct pci_dev *dev, pm_message_t state)


    -static int pcie_portdrv_suspend_late(struct pci_dev *dev, pm_message_t state)
    - return pci_save_state(dev);
    -static int pcie_portdrv_resume_early(struct pci_dev *dev)
    - return pci_restore_state(dev);
    static int pcie_portdrv_resume(struct pci_dev *dev)
    @@ -72,8 +62,6 @@ static int pcie_portdrv_resume(struct pci_dev *dev)
    #define pcie_portdrv_suspend NULL
    -#define pcie_portdrv_suspend_late NULL
    -#define pcie_portdrv_resume_early NULL
    #define pcie_portdrv_resume NULL

    @@ -292,8 +280,6 @@ static struct pci_driver pcie_portdriver = {
    .remove = pcie_portdrv_remove,

    .suspend = pcie_portdrv_suspend,
    - .suspend_late = pcie_portdrv_suspend_late,
    - .resume_early = pcie_portdrv_resume_early,
    .resume = pcie_portdrv_resume,

    .err_handler = &pcie_portdrv_err_handler,

     \ /
      Last update: 2009-01-31 03:21    [W:0.029 / U:222.672 seconds]
    ©2003-2017 Jasper Spaans. hosted at Digital OceanAdvertise on this site