Messages in this thread | | | Date | Fri, 8 Aug 2008 18:23:52 -0700 (PDT) | From | David Witbrodt <> | Subject | Re: HPET regression in 2.6.26 versus 2.6.25 -- RCU problem |
| |
I have tracked the regression down to an RCU problem.
I added some printk()'s to the function inet_register_protosw() in net/ipv4/af_inet.c, as seen in this diff:
===== BEGIN DIFF ========== * non-permanent entry. This means that when we remove this entry, the * system automatically returns to the old behavior. */ + printk (" Adding new protocol\n"); list_add_rcu(&p->list, last_perm); + out: + printk (" Unlocking spinlock\n"); spin_unlock_bh(&inetsw_lock); + printk (" Calling synchronize_net()\n"); synchronize_net(); return; ===== END DIFF ==========
A kernel built with these changes freezes with "Calling synchronize_net()" as the last printed line.
I located the function synchronize_net() in net/core/dev.c, and it was easy to add some printk()'s there:
===== BEGIN DIFF ========== void synchronize_net(void) { + printk (" synchronize_net(): calling might_sleep()\n"); might_sleep(); + + printk (" synchronize_net(): calling synchronize_rcu()\n"); synchronize_rcu(); } ===== END DIFF ==========
The kernel built with these changes froze with "synchronize_net(): calling synchronize_rcu()" as the last line on the screen.
After reading some documentation in Documentation/RCU/, it looks like something is misusing RCU -- and, according to the Documentation, those kinds of mistakes are easy to make. Maybe necessary calls to rcu_read_lock() rcu_read_unlock()
are missing, and something about my hardware is triggering a freeze that doesn't occur on most hardware.
For some reason, turning off the HPET by booting with "hpet=disabled" keeps the freeze from happening. Just reading a couple of those docs about RCU made me dizzy, so I hope someone familiar with RCU issues will take a look at the code in the files I've listed. Surely you guys can take it from here now?!
If not, just give me some experimental code changes to make to get my 2.6.26 and 2.6.27 kernels working again without disabling HPET!!!
Thanks, Dave Witbrodt
| |