issues in float division a/b

Thanks Mats,


Looks like the register can not hold a decimal, right? Decimal is larger than 64-bit. :-)

Quote:

---

Originally Posted by matsp

Actually, x87 registers are 80-bit, so even intermediate results in 64-bit (double) would potentially have further precision[1], SSE registers are 64- or 32-bit. (In Windows-64, you'd be using SSE, not x87 for math).

[1] Although I think Windows defaults the x87 settings to "round to 64-bit on intermediate results".
--
Mats

---

regards,
George

Quote:

---

Originally Posted by George2

Thanks Mats,


Looks like the register can not hold a decimal, right? Decimal is larger than 64-bit. :-)




regards,
George

---

I had a look at the specification of "decimal", and it seems like it's not implemented using the FPU - not quite sure how it's actually implemented. It's also stated that its a 128 bit value, so no, you can't use FPU registers to hold such a value.

--
Mats

Thanks for your great answers, Mats!


You are so knowledgable and nice, all of my questions are answered in this thread. Cool!! :-)

Quote:

---

Originally Posted by matsp

I had a look at the specification of "decimal", and it seems like it's not implemented using the FPU - not quite sure how it's actually implemented. It's also stated that its a 128 bit value, so no, you can't use FPU registers to hold such a value.

--
Mats

---

regards,
George