[lkml]   [2012]   [Apr]   [23]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
SubjectRe: Possible integer overflow in mach-bcmring with FPGA11107
On 4/23/2012 5:43 AM, Christian Dietrich wrote:
> This seems totally innocent, but when doing the caluculation for
> rate_hz by hand (or python) the result is slighly bigger than
> 2^32-1. Therfore an integer overflow should occur and the rate_hz rate
> will be far too low. It may be that there is a sanity check in
> hardware, but i don't know the used hardware at all.
Hi Christian,

Yes. This is a problem. I will cleanup fpga11107 code including this soon.


 \ /
  Last update: 2012-04-23 22:21    [W:0.027 / U:28.252 seconds]
©2003-2018 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site