lkml.org 
[lkml]   [2020]   [Jun]   [5]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    Patch in this message
    /
    From
    Subject[PATCH v8 16/16] s390/vfio-ap: handle probe/remove not due to host AP config changes
    Date
    AP queue devices are probed or removed for reasons other than changes
    to the host AP configuration:

    * Each queue device associated with a card device will get created and
    probed when the state of the AP adapter represented by the card device
    dynamically changes from standby to online.

    * Each queue device associated with a card device will get removed
    when the state of the AP adapter to which the queue represented by the
    queue device dynamically changes from online to standby.

    * Each queue device associated with a card device will get removed
    when the type of the AP adapter to which the queue represented by the
    queue device dynamically changes.

    * Each queue device associated with a card device will get removed
    when the status of the queue represented by the queue device changes
    from operating to check stop.

    * AP queue devices can be manually bound to or unbound from the vfio_ap
    device driver by a root user via the sysfs bind/unbind attributes of the
    driver.

    In response to a queue device probe or remove that is not the result of a
    change to the host's AP configuration, if a KVM guest is using the matrix
    mdev to which the APQN of the queue device is assigned, the vfio_ap device
    driver must respond accordingly. In an ideal world, the queue corresponding
    to the queue device being probed would be hot plugged into the guest.
    Likewise, the queue corresponding to the queue device being removed would
    be hot unplugged from the guest. Unfortunately, the AP architecture
    precludes plugging or unplugging individual queues, so let's handle
    the probe or remove of an AP queue device as follows:

    Handling Probe
    --------------
    There are two requirements that must be met in order to give a
    guest access to the queue corresponding to the queue device being probed:

    * Each APQN derived from the APID of the queue device and the APQIs of the
    domains already assigned to the guest's AP configuration must reference
    a queue device bound to the vfio_ap device driver.

    * Each APQN derived from the APQI of the queue device and the APIDs of the
    adapters assigned to the guest's AP configuration must reference a queue
    device bound to the vfio_ap device driver.

    If the above conditions are met, the APQN will be assigned to the guest's
    AP configuration and the guest will be given access to the queue.

    Handling Remove
    ---------------
    Since the AP architecture precludes us from taking access to an individual
    queue from a guest, we are left with the choice of taking access away from
    either the adapter or the domain to which the queue is connected. Access to
    the adapter will be taken away because it is likely that most of the time,
    the remove callback will be invoked because the adapter state has
    transitioned from online to standby. In such a case, no queue connected
    to the adapter will be available to access.

    Signed-off-by: Tony Krowiak <akrowiak@linux.ibm.com>
    ---
    drivers/s390/crypto/vfio_ap_ops.c | 38 +++++++++++++++++++++++++++++++
    1 file changed, 38 insertions(+)

    diff --git a/drivers/s390/crypto/vfio_ap_ops.c b/drivers/s390/crypto/vfio_ap_ops.c
    index cfe93ff9cc8c..5ee60dac7ad1 100644
    --- a/drivers/s390/crypto/vfio_ap_ops.c
    +++ b/drivers/s390/crypto/vfio_ap_ops.c
    @@ -1681,6 +1681,15 @@ static void vfio_ap_queue_link_mdev(struct vfio_ap_queue *q)
    }
    }

    +void vfio_ap_mdev_hot_plug_queue(struct vfio_ap_queue *q)
    +{
    + if ((q->matrix_mdev == NULL) || !vfio_ap_mdev_has_crycb(q->matrix_mdev))
    + return;
    +
    + if (vfio_ap_mdev_config_shadow_apcb(q->matrix_mdev))
    + vfio_ap_mdev_commit_shadow_apcb(q->matrix_mdev);
    +}
    +
    int vfio_ap_mdev_probe_queue(struct ap_queue *queue)
    {
    struct vfio_ap_queue *q;
    @@ -1694,11 +1703,35 @@ int vfio_ap_mdev_probe_queue(struct ap_queue *queue)
    q->apqn = queue->qid;
    q->saved_isc = VFIO_AP_ISC_INVALID;
    vfio_ap_queue_link_mdev(q);
    + /* Make sure we're not in the middle of an AP configuration change. */
    + if (!(matrix_dev->flags & AP_MATRIX_CFG_CHG))
    + vfio_ap_mdev_hot_plug_queue(q);
    mutex_unlock(&matrix_dev->lock);

    return 0;
    }

    +void vfio_ap_mdev_hot_unplug_queue(struct vfio_ap_queue *q)
    +{
    + unsigned long apid = AP_QID_CARD(q->apqn);
    + unsigned long apqi = AP_QID_QUEUE(q->apqn);
    +
    + if ((q->matrix_mdev == NULL) || !vfio_ap_mdev_has_crycb(q->matrix_mdev))
    + return;
    +
    + /*
    + * If the APQN is assigned to the guest, then let's
    + * go ahead and unplug the adapter since the
    + * architecture does not provide a means to unplug
    + * an individual queue.
    + */
    + if (test_bit_inv(apid, q->matrix_mdev->shadow_apcb.apm) &&
    + test_bit_inv(apqi, q->matrix_mdev->shadow_apcb.aqm)) {
    + if (vfio_ap_mdev_unassign_guest_apid(q->matrix_mdev, apid))
    + vfio_ap_mdev_commit_shadow_apcb(q->matrix_mdev);
    + }
    +}
    +
    void vfio_ap_mdev_remove_queue(struct ap_queue *queue)
    {
    struct vfio_ap_queue *q;
    @@ -1706,6 +1739,11 @@ void vfio_ap_mdev_remove_queue(struct ap_queue *queue)

    mutex_lock(&matrix_dev->lock);
    q = dev_get_drvdata(&queue->ap_dev.device);
    +
    + /* Make sure we're not in the middle of an AP configuration change. */
    + if (!(matrix_dev->flags & AP_MATRIX_CFG_CHG))
    + vfio_ap_mdev_hot_unplug_queue(q);
    +
    dev_set_drvdata(&queue->ap_dev.device, NULL);
    apid = AP_QID_CARD(q->apqn);
    apqi = AP_QID_QUEUE(q->apqn);
    --
    2.21.1
    \
     
     \ /
      Last update: 2020-06-05 23:43    [W:2.895 / U:0.096 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site