Anonymous user
Talk:Kahan summation: Difference between revisions
→Task: R is using FP.
(→Task: I wonder...) |
(→Task: R is using FP.) |
||
Line 48:
::::Hi I wonder if you might bring this up in your R language community and ask about the perplexing result? Maybe the setting of precision only affects output precision and internally a higher precision is used for values? --[[User:Paddy3118|Paddy3118]] ([[User talk:Paddy3118|talk]]) 18:41, 12 December 2014 (UTC)
::::Yep. I found this: https://stat.ethz.ch/pipermail/r-help/2010-January/226016.html, which leads me to believe that R is using its full, floating point, for arithmetic and you are only limiting the digits in the output - not even calculating in decimal arithmatic. --[[User:Paddy3118|Paddy3118]] ([[User talk:Paddy3118|talk]]) 18:48, 12 December 2014 (UTC)
| |||