[lkml]   [2009]   [May]   [4]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    SubjectRe: [PATCH] Implementation of the sendgroup() system call

    On Monday 04 May 2009 10:13:10 ext Andi Kleen wrote:
    > Elad Lahav <> writes:
    > > The attached patch contains an implementation of sendgroup(), a system
    > > call that allows a UDP packet to be transmitted efficiently to
    > > multiple recipients. Use cases for this system call include
    > > live-streaming and multi-player online games.
    > > The basic idea is that the caller maintains a group - a list of IP
    > > addresses and UDP ports - and calls sendgroup() with the group list
    > > and a common payload. Optionally, the call allows for per-recipient
    > > data to be prepended or appended to the shared block. The data is
    > > copied once in the kernel into an allocated page, and the
    > > per-recipient socket buffers point to that page. Savings come from
    > > avoiding both the multiple calls and the multiple copies of the data
    > > required with regular socket operations.
    > My guess it's more the copies than the calls? It sounds like
    > you want sendfile() for UDP. I think that would be a cleaner solution
    > than such a specific hack for your application. It would
    > have the advantage of saving the first copy too and be
    > truly zero copy on capable NICs.

    Say you have a fragmented skbuff-capable NIC.

    It is already possible to write() to a pipe, then issue a series of N tee()
    from the pipe for each of N connected sockets, and finally splice() to
    /dev/null. That would be one copy and N+2 system calls. I guess the one
    copy cannot be removed because UDP payloads are not page-sized, so
    vmsplice() won't cut it. As a small optmization, you could replace the last
    tee() with a splice(), so that's N+1 system calls.

    When using a non-connected socket and multiple destination, then you need
    one corked sendmsg() to set the destination, followed by one splice() to
    push the payload. That's at least 2N+1 system calls.

    UDP payload will typically be small, probably 1400 bytes or less. The
    system call overhead might well be higher than the memory copy overhead.

    On top of that, the splice() trick only works if the NIC can cope with
    fragments. The performance might be worse than with normal sendto(). The
    application has no way to check this from the socket. For a reason.
    Depending on the routing table, different destinations could use different
    NICs with different capabilities.

    To sum up, I can see to problems using splice() and friends here, with
    regards to the use case:
    - no support for destination socket addesses,
    - no support for batch tee() operations.

    Whether that justifies a new socket call is not for me to opiniate.
    Personally, I would definitely use it in the RTSP broadcast output of the
    VLC media player once/if it ever hits glibc.

    > Or perhaps simple send to a local multicast group and let
    > some netfilter module turn that into regular UDP.

    Unless netfilter has changed dramatically recentely, it is not usable for
    applications. A monolithic system-wide configuration paradigm is not usable
    for applications, as they cannot know how not to step on another
    application's feet.

    Rémi Denis-Courmont

    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to
    More majordomo info at
    Please read the FAQ at

     \ /
      Last update: 2009-05-04 09:55    [W:0.025 / U:0.408 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site