lkml.org 
[lkml]   [2012]   [Oct]   [26]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Date
From
SubjectRe: [PATCH 01/16] math128: Introduce various 128bit primitives
On Fri, 26 Oct 2012, Steven Rostedt wrote:

> On Fri, 2012-10-26 at 11:12 -0700, Juri Lelli wrote:
>
> > - scale down (right by 10) incoming parameters as to do internal
> > math with ~1us resolution (and scale up outgoing params)
>
> Would scaling down by 9 be sufficient? That way the resolution is still
> just less than 1us.

You have to do rounding anyway. So it does not matter whether you
chose 10 or 9.


\
 
 \ /
  Last update: 2012-10-26 21:01    [W:0.257 / U:0.776 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site