in Advanced Guestbook the smilies you see on the form are hard coded in to the entry.php template file. You will only see the new ones if you click the link to see the rest of the smileys.
If you refresh after posting a form (or vote) then every browser will resend the information it's just sent. They will usually ask if you want to do this though. If you have the ip tables turned on this should not incrememnt the vote.
Before anything make a back up of your current guestbook files.
Download the guestbook from the Free Scripts link on left. Extract files from the zip file. download a copy of the config.inc.php file on your server. Copy the database information from the config.inc.php file you just downloaded to the config/inc.php file in the files you just extracted. Upload the extracted files to replace the files on your server. Visit misc/update_db.php (or is it db_update.php) in your web browser.