lkml.org 
[lkml]   [2012]   [Apr]   [23]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    Date
    From
    SubjectRe: Possible integer overflow in mach-bcmring with FPGA11107
    On 4/23/2012 5:43 AM, Christian Dietrich wrote:
    >
    > This seems totally innocent, but when doing the caluculation for
    > rate_hz by hand (or python) the result is slighly bigger than
    > 2^32-1. Therfore an integer overflow should occur and the rate_hz rate
    > will be far too low. It may be that there is a sanity check in
    > hardware, but i don't know the used hardware at all.
    >
    Hi Christian,

    Yes. This is a problem. I will cleanup fpga11107 code including this soon.

    Thanks,
    JD



    \
     
     \ /
      Last update: 2012-04-23 22:21    [W:0.022 / U:123.016 seconds]
    ©2003-2016 Jasper Spaans. hosted at Digital OceanAdvertise on this site