TinyPortal

Development => Support => Topic started by: slamulous on July 01, 2008, 08:04:35 PM

Title: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 01, 2008, 08:04:35 PM
Link to my site: http://www.raidguru.net
SMF version: SMF 1.12
TP version: TP 1.05
Theme name and version: Invasion
Mods installed: No Mods
Related Error messages: � shows up after double spaces and certain line breaks.

I think this may be an issue with Character Sets, but I really have no clue.  If anyone can figure out why �'s keep on popping up please let me know whatever you can about it and how to fix it. 
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: Crip on July 01, 2008, 08:23:07 PM
Screenshot?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 01, 2008, 08:32:58 PM
(https://www.tinyportal.net/proxy.php?request=http%3A%2F%2Fimg357.imageshack.us%2Fimg357%2F8053%2Fsquaresyr8.jpg&hash=903368bf9131a6cd6709d7d2eeb1bb488f0a9d6e) (http://imageshack.us)
(https://www.tinyportal.net/proxy.php?request=http%3A%2F%2Fimg357.imageshack.us%2Fimg357%2F8053%2Fsquaresyr8.ec85cbcb51.jpg&hash=8a74cb67496dce1d25d17f2f8819ac81eefe7fc4) (http://g.imageshack.us/g.php?h=357&i=squaresyr8.jpg)
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 01, 2008, 08:53:43 PM
When I change my view to Western European encoding, the boxes poof. . . So I guess the next step is how to set the defaul to Western European.  Any suggestions?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: IchBin on July 01, 2008, 08:56:54 PM
What language is your forum set to? And what language files are you using?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 01, 2008, 08:57:33 PM
I have no language packs installed and my forums are set to UTF-8 I beleive.
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue
Post by: G6Cad on July 01, 2008, 09:06:53 PM
If you have utf8 for your forum, you will have to use utf8 for the tinyportal aswell.
Dont know if this will help though as you seem to have the text showing in your TP admin panel ? but download the english utf8 package from our downloadsection, extract the files to your local PC and then through ftp, upload the extracted files to your forum/themes/default/languages folder and see if the text will be better.
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 01, 2008, 11:34:17 PM
Nope, no luck on it.  When I manually click on view in IE and go to encoding and switch that to Western European/Windows, it fixes it, but this is a manual change not a permanent one. 
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: JPDeni on July 01, 2008, 11:38:16 PM
I don't know enough about encoding to be able to really help, but I did notice that it looks to be the non-breaking space -- & nbsp ; -- that is showing up as the square. Maybe that might give a clue?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue
Post by: Dazed on July 02, 2008, 03:34:45 AM
Just an odd request but it seems to be version 1.1.2 SMF. Would that make a difference as we are some versions ahead of that?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 02, 2008, 05:25:34 AM
Quote from: THE__Drifter on July 02, 2008, 03:34:45 AM
Just an odd request but it seems to be version 1.1.2 SMF. Would that make a difference as we are some versions ahead of that?
more than likely it would not as it seems i need to change my default character set perhaps.  any suggestions on how to go about that?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: IchBin on July 02, 2008, 03:57:46 PM
You're probably better off asking these questions at SMF.
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 04, 2008, 10:14:25 PM
Quote from: IchBin™ on July 02, 2008, 03:57:46 PM
You're probably better off asking these questions at SMF.

I tried over there as well and they noticed a collation issue with tables for TP being encoded in latin instead of UTF-8.  I changed all of that and still have the issue.  As well, this issue ONLY APPLIES TO TINY PORTAL, not to my SMF boards.  The issue stems from a non breaking line space back to back i.e. &nbsp;&nbsp.  The squares ALSO seem to appear after divisions <div> and I am not sure about that as well.  If anyone knows anything about this, please do share, or else I will have to modify every article I have with this anomoly and then manually change the intro text toggle through databases as that isn't working as well.

Edit: If you are using Firefox, the errors will show up as question marks instead of squares.  Theres another tidbit to the mystery.
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue
Post by: Smoky on July 04, 2008, 11:41:59 PM
possible, with the version difference and then too, if you did as G6 said with the "If you have utf8 for your forum, you will have to use utf8 for the tinyportal as well", you need to make sure that you are up to date.. this will at least help with trying to solve this..


it is important to keep up to date with your site, as several security updates has happened, and perhaps laungage updates as well. that was it is easier to keep on top of happenings, and fixes to your site  :D

post back if you did, and what the effects are ;)
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: IchBin on July 05, 2008, 12:45:13 PM
Ok, so after all that. What are your tables set at? What is your forum set at?
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 05, 2008, 06:01:40 PM
I have everything set to UTF8_general_CI.  I manually changed a bunch of individual tables within table sets as well so that everything is the same encoding.  Here is the list of tables from Phpmyadmin:

smf_attachments        3 MyISAM utf8_general_ci 4.1 KiB -
smf_ban_groups        0 MyISAM utf8_general_ci 1.0 KiB -
smf_ban_items        0 MyISAM utf8_general_ci 1.0 KiB -
smf_boards        87 MyISAM utf8_general_ci 12.0 KiB -
smf_board_permissions        88 MyISAM utf8_general_ci 5.8 KiB -
smf_calendar        0 MyISAM utf8_general_ci 1.0 KiB -
smf_calendar_holidays        167 MyISAM utf8_general_ci 11.0 KiB -
smf_categories        10 MyISAM utf8_general_ci 2.2 KiB -
smf_collapsed_categories        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_actions        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_activity        24 MyISAM utf8_general_ci 4.4 KiB -
smf_log_banned        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_boards        93 MyISAM utf8_general_ci 4.9 KiB -
smf_log_errors        1,620 MyISAM utf8_general_ci 392.6 KiB -
smf_log_floodcontrol        1 MyISAM utf8_general_ci 2.1 KiB -
smf_log_karma        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_mark_read        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_notify        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_online        1 MyISAM utf8_general_ci 4.6 KiB 408 B 
smf_log_polls        6 MyISAM utf8_general_ci 2.0 KiB -
smf_log_search_messages        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_search_results        2,490 MyISAM utf8_general_ci 62.6 KiB -
smf_log_search_subjects        50 MyISAM utf8_general_ci 4.0 KiB -
smf_log_search_topics        0 MyISAM utf8_general_ci 1.0 KiB -
smf_log_topics        78 MyISAM utf8_general_ci 3.8 KiB -
smf_membergroups        11 MyISAM utf8_general_ci 3.4 KiB -
smf_members        108 MyISAM utf8_general_ci 33.7 KiB -
smf_messages        257 MyISAM utf8_general_ci 911.8 KiB -
smf_message_icons        12 MyISAM utf8_general_ci 3.3 KiB -
smf_moderators        0 MyISAM utf8_general_ci 1.0 KiB -
smf_package_servers        1 MyISAM utf8_general_ci 2.1 KiB -
smf_permissions        56 MyISAM utf8_general_ci 5.3 KiB -
smf_personal_messages        16 MyISAM utf8_general_ci 11.5 KiB -
smf_pm_recipients        26 MyISAM utf8_general_ci 3.5 KiB -
smf_polls        1 MyISAM utf8_general_ci 2.1 KiB -
smf_poll_choices        9 MyISAM utf8_general_ci 2.2 KiB -
smf_sessions        3 MyISAM utf8_general_ci 231.2 KiB 209.6 KiB 
smf_settings        171 MyISAM utf8_general_ci 12.0 KiB -
smf_smileys        19 MyISAM utf8_general_ci 2.6 KiB -
smf_themes        94 MyISAM utf8_general_ci 7.8 KiB -
smf_topics        172 MyISAM utf8_general_ci 27.5 KiB -
smf_tp_articles        35 MyISAM utf8_general_ci 636.4 KiB -
smf_tp_blocks        12 MyISAM utf8_general_ci 9.9 KiB -
smf_tp_data        103 MyISAM utf8_general_ci 5.6 KiB -
smf_tp_dlmanager        1 MyISAM utf8_general_ci 2.0 KiB -
smf_tp_modules        0 MyISAM utf8_general_ci 1.0 KiB -
smf_tp_settings        108 MyISAM utf8_general_ci 5.2 KiB -
smf_tp_variables        12 MyISAM utf8_general_ci 3.4 KiB

As well, I did install the language pack a while ago for English UTF8, but I don't think it's neccessarily showing up or working right as I still can only select English as my forum language from the Admin panel.  Regardless, I have the English language files unpacked within the proper language folders. 
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: IchBin on July 07, 2008, 02:21:14 PM
Not knowing much about UTF8 I can only assume you would need to use UTF8 english files for SMF and TP. Setting your forum to use the UTF8 files would be necessary.
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: slamulous on July 07, 2008, 10:26:26 PM
There doesn't seem to be any solution for the display problem really, the only thing I can do is remove all instances of a non-breaking line space, which while not convienient isnt the end of the world.  You can consider this one resolved for now as it won't go much past this point.  On to my new issue though, it seems there is a max allowance on posting characters, or the database entry table for posts within TP regarding articles.  This makes it so some of my articles get cut off early, I am starting my search on this topic now.
Title: Re: � Appears after line breaks and double spaces. Possible Character Set Issue?
Post by: IchBin on July 08, 2008, 12:28:49 AM
The row for the article body was changed in TP 1.x I believe to fix that issue.