Messages in this thread | | | Subject | Re: [PATCH net-next] virtio-net: switch to use build_skb() for small buffer | From | Jason Wang <> | Date | Thu, 23 Feb 2017 10:44:27 +0800 |
| |
On 2017年02月23日 01:17, John Fastabend wrote: > On 17-02-21 12:46 AM, Jason Wang wrote: >> This patch switch to use build_skb() for small buffer which can have >> better performance for both TCP and XDP (since we can work at page >> before skb creation). It also remove lots of XDP codes since both >> mergeable and small buffer use page frag during refill now. >> >> Before | After >> XDP_DROP(xdp1) 64B : 11.1Mpps | 14.4Mpps >> >> Tested with xdp1/xdp2/xdp_ip_tx_tunnel and netperf. > When you do the xdp tests are you generating packets with pktgen on the > corresponding tap devices?
Yes, pktgen on the tap directly.
> > Also another thought, have you looked at using some of the buffer recycling > techniques used in the hardware drivers such as ixgbe and with Eric's latest > patches mlx? I have seen significant performance increases for some > workloads doing this. I wanted to try something like this out on virtio > but haven't had time yet.
Yes, this is in TODO list. Will pick some time to do this.
Thanks
> >> Signed-off-by: Jason Wang <jasowang@redhat.com> >> --- > [...] > >> static int add_recvbuf_small(struct virtnet_info *vi, struct receive_queue *rq, >> gfp_t gfp) >> { >> - int headroom = GOOD_PACKET_LEN + virtnet_get_headroom(vi); >> + struct page_frag *alloc_frag = &rq->alloc_frag; >> + char *buf; >> unsigned int xdp_headroom = virtnet_get_headroom(vi); >> - struct sk_buff *skb; >> - struct virtio_net_hdr_mrg_rxbuf *hdr; >> + int len = vi->hdr_len + VIRTNET_RX_PAD + GOOD_PACKET_LEN + xdp_headroom; >> int err; >> >> - skb = __netdev_alloc_skb_ip_align(vi->dev, headroom, gfp); >> - if (unlikely(!skb)) >> + len = SKB_DATA_ALIGN(len) + >> + SKB_DATA_ALIGN(sizeof(struct skb_shared_info)); >> + if (unlikely(!skb_page_frag_refill(len, alloc_frag, gfp))) >> return -ENOMEM; >> >> - skb_put(skb, headroom); >> - >> - hdr = skb_vnet_hdr(skb); >> - sg_init_table(rq->sg, 2); >> - sg_set_buf(rq->sg, hdr, vi->hdr_len); >> - skb_to_sgvec(skb, rq->sg + 1, xdp_headroom, skb->len - xdp_headroom); >> - >> - err = virtqueue_add_inbuf(rq->vq, rq->sg, 2, skb, gfp); >> + buf = (char *)page_address(alloc_frag->page) + alloc_frag->offset; >> + get_page(alloc_frag->page); >> + alloc_frag->offset += len; >> + sg_init_one(rq->sg, buf + VIRTNET_RX_PAD + xdp_headroom, >> + vi->hdr_len + GOOD_PACKET_LEN); >> + err = virtqueue_add_inbuf(rq->vq, rq->sg, 1, buf, gfp); > Nice this cleans up a lot of the branching code. Thanks. > > Acked-by: John Fastabend <john.r.fastabend@intel.com>
| |