[lkml]   [2012]   [Apr]   [23]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
Messages in this thread
    SubjectRe: Possible integer overflow in mach-bcmring with FPGA11107
    On 4/23/2012 5:43 AM, Christian Dietrich wrote:
    > This seems totally innocent, but when doing the caluculation for
    > rate_hz by hand (or python) the result is slighly bigger than
    > 2^32-1. Therfore an integer overflow should occur and the rate_hz rate
    > will be far too low. It may be that there is a sanity check in
    > hardware, but i don't know the used hardware at all.
    Hi Christian,

    Yes. This is a problem. I will cleanup fpga11107 code including this soon.


     \ /
      Last update: 2012-04-23 22:21    [W:0.044 / U:14.356 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site