Pathological floating point problems: Difference between revisions

m
Line 92:
series:=Series.drop(100).value;</lang>
We'll use the convenient formula given in the referenced paper to create a fraction with big ints
<lang zkl>var BN=Import("zklBigNum"), digits=BN(10).pow(3264);
fcn u(n){ // use formula to create a fraction of big ints
const b=-3, y=4;
Anonymous user