hello
some time ago I wrote some basic mp arithmetic routines in FreeBasic and it works ok though not very fast, now I am trying to convert the code to PB and for the most part it works but for the fpinv function which calculates 1/x via newton-raphson
perhaps the problem is due to no unsigned integer type?
baffled by wrong result
baffled by wrong result
Last edited by jack on Sun May 22, 2022 1:06 am, edited 2 times in total.
Re: baffled by wrong result
what's the result supposed to be?
You can use a quad for longs and mask off with $FFFFFFFF to get unsigned when you need it.
You can use a quad for longs and mask off with $FFFFFFFF to get unsigned when you need it.