 Check out the bookstore at IRBS.com |
|
|
|
|||||
|
||||||
Subject: Re: GreatCircle Calculations - precision
From: Jared Sherman (jared.sherman@XXX.XXX)
Date: Wed Oct 02 2002 - 18:05:21 EDT
Rino-
I'm no mathematician, and won't even play one on TV.<G>
<why do I see these differences?> Obvious first thought is whether you are seeing rounding errors or other math errors caused by the way your programming language is doing the math? I remember hearing about single/vs/double precision integer math and other limits and problems from long ago, I suspect those problems still exist to some extent in all programming languages or operating systems. At least, that's a first area to eliminate.
|