lkml.org 
[lkml]   [2018]   [Jan]   [23]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    From
    Subject[PATCH RFC 00/16] A new RCU implementation based on a fast consensus protocol
    Date
    From: Lihao Liang <lianglihao@huawei.com>

    Dear Paul,

    This patch set implements a preemptive version of RCU (PRCU) based on the following paper:

    Fast Consensus Using Bounded Staleness for Scalable Read-mostly Synchronization.
    Haibo Chen, Heng Zhang, Ran Liu, Binyu Zang, and Haibing Guan.
    IEEE Transactions on Parallel and Distributed Systems (TPDS), 2016.
    https://dl.acm.org/citation.cfm?id=3024114.3024143

    We have also added preliminary callback-handling support. Thus, the current version
    provides APIs prcu_read_lock(), prcu_read_unlock(), synchronize_prcu(), call_prcu(),
    and prcu_barrier().

    This is an experimental patch, so it would be good to have some feedback.

    Known shortcoming is that the grace-period version is incremented in synchronize_prcu().
    If call_prcu() or prcu_barrier() is called but there is no synchronized_prcu() invoked,
    callbacks cannot be invoked. Later version should address this issue, e.g. adding a
    grace-period expedition mechanism. Others include to use a a hierarchical structure,
    taking into account the NUMA topology, to send IPI in synchronize_prcu().

    We have tested the implementation using rcutorture on both an x86 and ARM64 machine.
    PRCU passed 1h and 3h tests on all the newly added config files except PRCU07 reported BUG
    in a 1h run.

    [ 1593.604201] ---[ end trace b3bae911bec86152 ]---
    [ 1594.629450] prcu-torture:torture_onoff task: offlining 14
    [ 1594.755553] smpboot: CPU 14 is now offline
    [ 1594.757732] prcu-torture:torture_onoff task: offlined 14
    [ 1597.765149] prcu-torture:torture_onoff task: onlining 11
    [ 1597.766795] smpboot: Booting Node 0 Processor 11 APIC 0xb
    [ 1597.804102] prcu-torture:torture_onoff task: onlined 11
    [ 1599.365098] prcu-torture: rtc: ffffffffb0277b90 ver: 66358 tfle: 0 rta: 66358 rtaf: 0
    rtf: 66349 rtmbe: 0 rtbe: 1 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 2233418
    onoff: 191/191:199/199 34,199:59,5102 10403:0 (HZ=1000) barrier: 188/189:1 cbflood: 225
    [ 1599.367946] prcu-torture: !!!
    [ 1599.367966] ------------[ cut here ]------------


    We have also compared PRCU with TREE RCU using rcuperf with gp_exp set to true, that is
    synchronize_rcu_expedited was tested.

    The rcuperf results are as follows (average grace-period duration in ms of ten 10min runs):

    16*Intel Xeon CPU@2.4GHz, 16GB memory, Ubuntu Linux 3.13.0-47-generic

    CPUs 2 4 8 12 15 16
    PRCU 0.14 1.07 4.15 8.02 10.79 15.16
    TREE 49.30 104.75 277.55 390.82 620.82 1381.54

    64*Cortex-A72 CPU@2.4GHz, 130GB memory, Ubuntu Linux 4.10.0-21.23-generic

    CPUs 2 4 8 16 32 48 63 64
    PRCU 0.23 19.69 38.28 63.21 95.41 167.18 252.01 1841.44
    TREE 416.73 901.89 1060.86 743.00 920.66 1325.21 1646.20 23806.27

    Best wishes,
    Lihao.


    Lihao Liang (15):
    rcutorture: Add PRCU rcu_torture_ops
    rcutorture: Add PRCU test config files
    rcuperf: Add PRCU rcu_perf_ops
    rcuperf: Add PRCU test config files
    rcuperf: Set gp_exp to true for tests to run
    prcu: Implement call_prcu() API
    prcu: Implement PRCU callback processing
    prcu: Implement prcu_barrier() API
    rcutorture: Test call_prcu() and prcu_barrier()
    rcutorture: Add basic ARM64 support to run scripts
    prcu: Add PRCU Kconfig parameter
    prcu: Comment source code
    rcuperf: Add config files with various CONFIG_NR_CPUS
    rcutorture: Add scripts to run experiments
    Add GPLv2 license

    Heng Zhang (1):
    prcu: Add PRCU implementation

    include/linux/interrupt.h | 3 +
    include/linux/prcu.h | 122 +++++
    include/linux/rcupdate.h | 1 +
    init/Kconfig | 7 +
    init/main.c | 2 +
    kernel/rcu/Makefile | 1 +
    kernel/rcu/prcu.c | 497 +++++++++++++++++++++
    kernel/rcu/rcuperf.c | 33 +-
    kernel/rcu/rcutorture.c | 40 +-
    kernel/rcu/tree.c | 1 +
    kernel/sched/core.c | 2 +
    kernel/time/timer.c | 2 +
    kvm.sh | 452 +++++++++++++++++++
    run-rcuperf.sh | 26 ++
    .../testing/selftests/rcutorture/bin/functions.sh | 17 +-
    .../selftests/rcutorture/configs/rcu/CFLIST | 5 +
    .../selftests/rcutorture/configs/rcu/PRCU02 | 27 ++
    .../selftests/rcutorture/configs/rcu/PRCU02.boot | 1 +
    .../selftests/rcutorture/configs/rcu/PRCU03 | 23 +
    .../selftests/rcutorture/configs/rcu/PRCU03.boot | 2 +
    .../selftests/rcutorture/configs/rcu/PRCU06 | 26 ++
    .../selftests/rcutorture/configs/rcu/PRCU06.boot | 5 +
    .../selftests/rcutorture/configs/rcu/PRCU07 | 25 ++
    .../selftests/rcutorture/configs/rcu/PRCU07.boot | 2 +
    .../selftests/rcutorture/configs/rcu/PRCU09 | 19 +
    .../selftests/rcutorture/configs/rcu/PRCU09.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/CFLIST | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU | 20 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-12 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-12.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-14 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-14.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-15 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-15.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-16 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-16.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-2 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-2.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-32 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-32.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-4 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-4.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-48 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-48.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-56 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-56.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-60 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-60.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-62 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-62.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-64 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-64.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU-8 | 21 +
    .../rcutorture/configs/rcuperf/PRCU-8.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/PRCU.boot | 1 +
    .../selftests/rcutorture/configs/rcuperf/TREE-12 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-14 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-15 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-16 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-2 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-32 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-4 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-48 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-56 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-60 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-62 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-64 | 21 +
    .../selftests/rcutorture/configs/rcuperf/TREE-8 | 21 +
    68 files changed, 1918 insertions(+), 5 deletions(-)
    create mode 100644 include/linux/prcu.h
    create mode 100644 kernel/rcu/prcu.c
    create mode 100755 kvm.sh
    create mode 100755 run-rcuperf.sh
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU02
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU02.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU03
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU03.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU06
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU06.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU07
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU07.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU09
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcu/PRCU09.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-12
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-12.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-14
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-14.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-15
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-15.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-16
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-16.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-2
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-2.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-32
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-32.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-4
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-4.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-48
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-48.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-56
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-56.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-60
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-60.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-62
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-62.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-64
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-64.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-8
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU-8.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/PRCU.boot
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-12
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-14
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-15
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-16
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-2
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-32
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-4
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-48
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-56
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-60
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-62
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-64
    create mode 100644 tools/testing/selftests/rcutorture/configs/rcuperf/TREE-8

    --
    2.14.1.729.g59c0ea183

    \
     
     \ /
      Last update: 2018-01-23 09:13    [W:4.071 / U:0.052 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site