system 1.7 and decimals

[mrmusolf]

I was doing some very simple subtraction with my Nspire while
balancing a checkbook and my calculator would only show one decimal
place. I checked the settings and it was set to float 6. Has anyone
else had any problems with this? If so, how did you address it.
Thanks

[John Hanna]

Were the results more than one decimal place? "Float 6" means it only
displays as many decimal places as necessary, up to 6, so a value like
34.20000005 would display as 34.2. For two places always, try 'Fix 2'.



Sail Upwind,
John Hanna
T3 . Teachers Teaching with Technology
973.398.3815
jeh...@optonline.net
www.johnhanna.us
"the contact between the acute angle of a triangle and a circle has no less
effect than that of God's finger touching Adam's in Michelangelo." - Wassily
Kandinsky

[mrmusolf]

I'm sorry. I meant to include that the decimals should have shown two
places. .29 was displayed as .3. I know that I can change the
settings for the fixed places. That's why I'm trying to figure out
what's going on with it.

Thanks

On 8 Nov, 08:55, John Hanna <johneha...@gmail.com> wrote:
> Were the results more than one decimal place? "Float 6" means it only
> displays as many decimal places as necessary, up to 6, so a value like
> 34.20000005 would display as 34.2. For two places always, try 'Fix 2'.
>
> Sail Upwind,
>     John Hanna
>     T3 . Teachers Teaching with Technology
>     973.398.3815

>     jeha...@optonline.net

>    www.johnhanna.us
> "the contact between the acute angle of a triangle and a circle has no less
> effect than that of God's finger touching Adam's in Michelangelo." - Wassily
> Kandinsky
>
>
>
> -----Original Message-----
> From: tins...@googlegroups.com [mailto:tins...@googlegroups.com] On Behalf
>
> Of mrmusolf
> Sent: Sunday, November 08, 2009 8:28 AM
> To: tinspire
> Subject: [tinspire] system 1.7 and decimals
>
> I was doing some very simple subtraction with my Nspire while
> balancing a checkbook and my calculator would only show one decimal
> place.  I checked the settings and it was set to float 6.  Has anyone
> else had any problems with this?  If so, how did you address it.

> Thanks- Hide quoted text -
>
> - Show quoted text -

[Andy Kemp]

I had a little explore and the problem seems to be that Float6 displays the answer to something like 6 significant figures although not quite...

If the answer includes a decimal part this is often rounded or ignored in the displayed answer:

if you do the following calculations you can see more clearly what is happening:
123456789-0 = 123456789
1.23456789-0 = 1.234567 (dropped the 89)
123456.789 - 0 = 123457

What I suspect happened for you is something like:
123456.78-111111 = 12345.8

Which will have rounded the display - The correct answer is always stored however - press up and enter and the full result will be copied down on the the display line...  Alternatively pick a higher Float value i.e. float12 or try one of the fix values...

It is a little inconsistent in that integer solutions are never rounded but anything else is rounded to 6 significant figures...

Hope that helps a little

Cheers
Andy

[Nelson Sousa]

you can select a floating number of decimals or a fixed one on the
Documents Settings or System Settings (to make it default for new
documents). Go to the Home menu and select option 8. There you can set
the definitions for Document and System. The number of decimal places
can be chosen as Float, Float 1, Float2, ... or Fix 1, Fix 2, etc.

Nelson

[mrmusolf]

I will try a higher float value. That makes sense since I was using
six figures. Thanks.

On 9 Nov, 07:52, Andy Kemp <a...@1kemp.co.uk> wrote:
> I had a little explore and the problem seems to be that Float6 displays the
> answer to something like 6 significant figures although not quite...
>
> If the answer includes a decimal part this is often rounded or ignored in
> the displayed answer:
>
> if you do the following calculations you can see more clearly what is
> happening:
> 123456789-0 = 123456789
> 1.23456789-0 = 1.234567 (dropped the 89)
> 123456.789 - 0 = 123457
>
> What I suspect happened for you is something like:
> 123456.78-111111 = 12345.8
>
> Which will have rounded the display - The correct answer is always stored
> however - press up and enter and the full result will be copied down on the
> the display line...  Alternatively pick a higher Float value i.e. float12 or
> try one of the fix values...
>
> It is a little inconsistent in that integer solutions are never rounded but
> anything else is rounded to 6 significant figures...
>
> Hope that helps a little
>
> Cheers
> Andy
>

> > > - Show quoted text -- Hide quoted text -