[lkml]   [2012]   [Jan]   [10]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    Subject[PATCH v2 0/3] virtio_net: Better low memory handling.
    The following series applies to net-next.

    The following series changes the low memory paths in virtio_net to not
    disable NAPI while waiting in the allocator in the slow path.

    It attempts to rectify some performance problems we've seen where the
    network performance drops significantly when memory is low. The working
    theory is that the disabling of NAPI while allocations are occuring in
    the slow refill_work() path can in turn cause significant delays in
    processing of the receive queue.

    The observed situation on an unmodified kernel is that a system with low
    memory will in turn quickly stop being being able to refill the rx queue
    with buffers, in turn causing packets to be dropped by the host OS (as
    NAPI polling is disabled) while the driver wait for memory to be
    reclaimed. The way the process-context refill loop works, the memory
    subsystem is effectively polled every half second when things look
    bleak, leading to significant packet loss and congestion window

    The first patch prepares for a batched refill path by splitting the
    receive buffer allocation and enqueue bits into separate functions.

    The second patch introduces the batched refill path itself. As
    implemented, it still disables NAPI completely for the whole refill.

    The third patch then pushed the disabling and enabling of NAPI down into
    the refill loop so that it only covers the actual enqueueing of receive
    buffers on the virtqueue.

    This patchset seems to help the test setups that I'm playing with.
    Example tests include using several bit-torrent clients within a VM and
    watching the network throughputs on the host. Other similar workloads
    (high network traffic, reasonably high disk IO causing memory pressure)
    also appear to have throughput problems alleviated by these changes.

    As a warning, I've only tested this using the "small buffers" and
    "mergeable" buffers paths. I haven't figured out how to force qemu-kvm
    to not support the feature bits that trigger 'mergable' receive buffers.

    - Rewritten to not introduce a spinlock to protect the virtqueue data.


    Mike Waychison (3):
    virtio_net: Split receive buffer alloc/add
    virtio_net: Batch receive buffer filling
    virtio_net: Don't disable NAPI while allocating

    drivers/net/virtio_net.c | 325 ++++++++++++++++++++++++++++++++++++++++------
    1 files changed, 285 insertions(+), 40 deletions(-)

     \ /
      Last update: 2012-01-10 18:43    [W:0.027 / U:3.528 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site