Commit Graph

165 Commits

Author SHA1 Message Date
juha
1568077381 LazUtils: Clean UTF8WrapText function in LazUTF8.
git-svn-id: trunk@49148 -
2015-05-23 14:13:04 +00:00
juha
37ae3c0f43 LazUtils: New UTF8WrapText function for LazUTF8. Issue #28001, patch from Antônio Galvão.
git-svn-id: trunk@48924 -
2015-05-03 10:02:15 +00:00
juha
8250ced275 LazUtils: Use cwstring always with UTF8 RTL on Unix. Does not work without it.
git-svn-id: trunk@48776 -
2015-04-18 10:21:58 +00:00
mattias
222321addf lazutils: simplify enableutf8rtl by only using lazutf8
git-svn-id: trunk@47915 -
2015-02-20 14:28:49 +00:00
mattias
e1e00306cf lazutf8: GetFormatSettingsUTF8: map common multibyte chars to ASCII
git-svn-id: trunk@47890 -
2015-02-18 19:51:28 +00:00
mattias
2979c97a9a lazutils: fixed compilation on win64
git-svn-id: trunk@47879 -
2015-02-18 16:52:32 +00:00
mattias
69edc4d8c0 lazutils: moved ReplaceSubString to LazUTF8, added UTF8QuotedStr
git-svn-id: trunk@47748 -
2015-02-13 20:34:21 +00:00
mattias
814cf1a717 lazutils: FindInvalidUTF8Character: check for wrong mapped codes, changed default to report gaps
git-svn-id: trunk@47172 -
2014-12-10 14:26:18 +00:00
mattias
4a8e3ccc51 lazutils: replaced utf8string with string
git-svn-id: trunk@47139 -
2014-12-08 15:50:31 +00:00
mattias
574751850e lazutf8: in utf8 mode: override widestringmanager Ansi procs
git-svn-id: trunk@47108 -
2014-12-04 20:19:50 +00:00
mattias
e2c1838d3d lazutils: sanity check macros
git-svn-id: trunk@47105 -
2014-12-04 18:11:56 +00:00
mattias
2a848a5c8c lazutils: GetEnvironmentStringUTF8 for FPC_RTL_UNICODE
git-svn-id: trunk@47090 -
2014-12-04 14:28:35 +00:00
mattias
1b03376550 lazutils: paswstring: one string less in Wide2AnsiMove and Ansi2WideMove
git-svn-id: trunk@47086 -
2014-12-04 13:44:15 +00:00
mattias
21c8dad40d lazutils: on force CP_UTF8: set argv and formatsettings
git-svn-id: trunk@46997 -
2014-11-26 22:12:50 +00:00
juha
a570fc82eb LazUtils: Override SysToUTF8 and UTF8ToSys with FormatSettings param. Issue #26937, patch from wp.
git-svn-id: trunk@46981 -
2014-11-24 12:17:15 +00:00
mattias
5885982aca lazutils: added WinCPToUTF8 and UTF8ToWinCP
git-svn-id: trunk@46904 -
2014-11-20 15:26:28 +00:00
mattias
9928fb1647 lazutf8: docs
git-svn-id: trunk@46780 -
2014-11-07 16:12:32 +00:00
mattias
5992cb80f4 lazutils: fixed UTF8FindNearestCharStart for 64bit long strings
git-svn-id: trunk@45053 -
2014-05-17 12:05:05 +00:00
bart
2eb279e6e1 LazUtf8: implement Utf8 versions of LeftStr and RightStr.
git-svn-id: trunk@43348 -
2013-11-01 17:40:11 +00:00
mattias
a4a4e4c791 lazutils: small optimization
git-svn-id: trunk@42885 -
2013-09-19 18:36:23 +00:00
bart
7e9930404c LazUtils: better implementation of Utf8StringOfChar. The previously uses conversion to Utf16
only worked if the codepoint was UCS2.

git-svn-id: trunk@42855 -
2013-09-18 10:26:09 +00:00
mattias
37aeda8f7b lazutils: added UTF8StringReplace, feature 22148
git-svn-id: trunk@42707 -
2013-09-09 23:40:04 +00:00
mattias
63ec3d92ee lazutils: clean up
git-svn-id: trunk@42589 -
2013-09-04 09:19:37 +00:00
bart
276a50bbd4 LazUtf8: Utf8StringOfChar: fix compilation error on Darwin.
git-svn-id: trunk@42577 -
2013-09-03 15:18:19 +00:00
bart
eebd3d2f93 LazUtf8: Add routines for padding UTF8 strings:
- Utf8StringOfChar
- Utf8AddChar
- Utf8AddCharR
- Utf8PadLeft
- Utf8PadRight
- Utf8PadCenter

Issue #0024319

git-svn-id: trunk@42575 -
2013-09-03 12:10:41 +00:00
mattias
04ad21f805 lazutils: notes about thread safety
git-svn-id: trunk@41945 -
2013-06-29 17:12:53 +00:00
bart
555ede86aa LazUtils: Move SysErrorMessageUTF8 to LazUtf8 (and inline it in FileUtil).
Part of the ongoing restructuring of LazUtils.

git-svn-id: trunk@41588 -
2013-06-08 14:54:15 +00:00
bart
bcea8662ff LazUtils: Move ConsoleToUTF8, UTF8ToConsole, ParamStrUTF8,
GetEnvironmentStringUTF8 and GetEnvironmentVariableUTF8 to LazUtf8 (and inline them in FileUtil).
Part of the ongoing restructuring of LazUtils.

git-svn-id: trunk@41587 -
2013-06-08 14:41:16 +00:00
juha
ecd140c985 Improve license headers in sources, part 2. Refer to details about license, not copyright. Remove jargon about lack of warranty, it is covered in license already.
git-svn-id: trunk@41389 -
2013-05-25 09:22:25 +00:00
mattias
6b9529ec0a lazutf8: faster FindInvalidUTF8Character
git-svn-id: trunk@40673 -
2013-03-31 17:19:46 +00:00
mattias
b4a29891b3 lazutils: clean up
git-svn-id: trunk@40238 -
2013-02-10 12:06:24 +00:00
mattias
043dd66828 lazutils: added UTF8CompareStrCollated
git-svn-id: trunk@40228 -
2013-02-09 20:45:24 +00:00
mattias
067cab64c4 lazutils: UTF8LowerCase: small optimization
git-svn-id: trunk@39450 -
2012-12-06 15:03:10 +00:00
sekelsenmat
bdff370210 Attempt to fix bug #23428
git-svn-id: trunk@39437 -
2012-12-04 13:12:15 +00:00
mattias
8e3f146300 lazutils: less notes
git-svn-id: trunk@38398 -
2012-08-27 10:47:02 +00:00
mattias
b240df36a1 lazutils: UTF8CompareStr: made 64bit safe, added fast PChar versions
git-svn-id: trunk@38103 -
2012-08-01 10:50:19 +00:00
mattias
a355912beb lazutils: inlined UTF8CompareStr
git-svn-id: trunk@37754 -
2012-06-24 06:58:59 +00:00
mattias
593c7fdb94 lazutils: utf8pos: added optional parameter StartPos
git-svn-id: trunk@37703 -
2012-06-20 12:11:42 +00:00
mattias
f0f090fb65 lazutf8: added overloaded UTF8FixBroken(var string)
git-svn-id: trunk@36319 -
2012-03-25 16:24:14 +00:00
mattias
9bb0b8ea71 lazutf8: utf8trim: trim no break spaces
git-svn-id: trunk@35903 -
2012-03-12 19:42:05 +00:00
mattias
3fff6d9bba lazutf8: added stringlist sort function
git-svn-id: trunk@35888 -
2012-03-11 15:13:55 +00:00
mattias
4386e8fec8 lazutils: less hints
git-svn-id: trunk@35803 -
2012-03-07 12:02:09 +00:00
mattias
587a1ef0fd lazutils: fixed NeedRTLAnsi under non Windows
git-svn-id: trunk@35423 -
2012-02-17 15:10:57 +00:00
mattias
17e624f523 lazutf8: added UTF8Trim
git-svn-id: trunk@35420 -
2012-02-17 14:53:48 +00:00
paul
76b34a64d8 lazutf8: prevent string codepage change
git-svn-id: trunk@35408 -
2012-02-17 06:14:40 +00:00
mattias
9985ff718d LCL: added inline version of UnicodeToUTF8
git-svn-id: trunk@35109 -
2012-02-02 23:01:03 +00:00
mattias
64e2cd6b98 lazutils: UTF8CharacterToUnicode: check for intersecting ranges
git-svn-id: trunk@35038 -
2012-01-30 10:46:07 +00:00
mattias
28fbd2b34c lazutils: UTF8FixBroken: check for ascci as multi byte
git-svn-id: trunk@35036 -
2012-01-30 09:34:18 +00:00
mattias
3c0edd81fd lazutils: UTF8CharacterToUnicode: check for invalid ascii as multi byte chars, bug #21186
git-svn-id: trunk@35031 -
2012-01-30 09:22:29 +00:00
sekelsenmat
b106f80cb9 Android: Starts improving the key input. Now it gets real unicode chars instead of the key name
git-svn-id: trunk@34509 -
2011-12-29 23:12:21 +00:00
mattias
b7e59c0f5b lazutils: optimized UTF8CStringToUTF8String
git-svn-id: trunk@34218 -
2011-12-16 01:16:04 +00:00
mattias
4b8a579110 lazutils: optimized UTF8CStringToUTF8String
git-svn-id: trunk@34216 -
2011-12-16 00:59:31 +00:00
mattias
afb21705e9 lazutils: fixed uninitialized access
git-svn-id: trunk@33415 -
2011-11-08 11:53:09 +00:00
sekelsenmat
121b0d4e52 Renames some utf8strings to strings as a temporary workaround for fpc 2.7 until the Unicode RTL encoding is decided
git-svn-id: trunk@33288 -
2011-11-04 10:26:09 +00:00
sekelsenmat
b3f587b60f First steps of a major move of code from lclproc to lazutf8
git-svn-id: trunk@32986 -
2011-10-19 19:16:31 +00:00
sekelsenmat
29e7449f18 Disables the new widestring manager for fpc 2.7 and moves some comented routines to proper place
git-svn-id: trunk@32982 -
2011-10-19 14:44:14 +00:00
sekelsenmat
172b031906 Adds a new unit to hold eventually utf16-based routines. Might be useful to speed up WideLowerCase for example in the future.
git-svn-id: trunk@32980 -
2011-10-19 12:14:14 +00:00
sekelsenmat
3ffd9d2af9 Moves lconvencoding.pas from the LCL to LazUtils
git-svn-id: trunk@32942 -
2011-10-17 11:36:24 +00:00
sekelsenmat
810795ad1f Adds more uppercase support and tests, removes lowercase2
git-svn-id: trunk@32924 -
2011-10-16 15:18:12 +00:00
sekelsenmat
45ad603666 More tests and more lower/uppercase support
git-svn-id: trunk@32915 -
2011-10-15 21:20:11 +00:00
sekelsenmat
a8bff35bc7 More tests and more uppercase support
git-svn-id: trunk@32912 -
2011-10-15 18:38:52 +00:00
sekelsenmat
99b3c0f6bb New lower/upper tests, implements uppercase till 01FF, improves the description of the routines and fixes the identifier for Turkish and adds Azeri support
git-svn-id: trunk@32910 -
2011-10-15 17:48:16 +00:00
sekelsenmat
d0231069b3 More uppercase fixes
git-svn-id: trunk@32898 -
2011-10-15 06:11:17 +00:00
sekelsenmat
42fd5872b6 UpperCase fixes
git-svn-id: trunk@32896 -
2011-10-15 05:45:32 +00:00
sekelsenmat
7e93706129 Some fixes for paswstrings
git-svn-id: trunk@32893 -
2011-10-14 20:47:34 +00:00
sekelsenmat
26e38aa25c Adds paswstring to lazutils, it is feature complete now, although parts might need rethinking specially for fpc 2.7
git-svn-id: trunk@32889 -
2011-10-14 19:09:04 +00:00
sekelsenmat
8672da1501 Minor UpperCase fix and more UpperCase tests
git-svn-id: trunk@32885 -
2011-10-14 16:22:39 +00:00
sekelsenmat
eb9d587fcf Minor comment
git-svn-id: trunk@32884 -
2011-10-14 13:07:05 +00:00
sekelsenmat
1aa512e535 Finishes all characters for LowerCase
git-svn-id: trunk@32883 -
2011-10-14 12:34:48 +00:00
sekelsenmat
947c02677b Adds more unicode tests
git-svn-id: trunk@32882 -
2011-10-14 11:22:43 +00:00
sekelsenmat
d6cddfc645 Completes lowercase up to codepoint 1EFF and adds many tests
git-svn-id: trunk@32880 -
2011-10-14 09:53:23 +00:00
sekelsenmat
d7e57fa8ee More lowercase tests and fixes
git-svn-id: trunk@32871 -
2011-10-13 15:41:29 +00:00
sekelsenmat
7ee3255580 Lowercase: Adds large new tests and reworks parts of the latin lowercase implementation
git-svn-id: trunk@32870 -
2011-10-13 15:23:26 +00:00
martin
3be1e68746 LazUtf8: clean up unused var
git-svn-id: trunk@32869 -
2011-10-13 10:05:58 +00:00
sekelsenmat
7d8796f113 Adds a further performance optimization to lowercase by moving the new_c1 to only where needed
git-svn-id: trunk@32865 -
2011-10-13 06:22:44 +00:00
sekelsenmat
0071c56828 Enhances the fast initial parse of lowercase
git-svn-id: trunk@32864 -
2011-10-12 19:23:46 +00:00
martin
524c46d2cc LazUtf8: fix 2nd loop
git-svn-id: trunk@32863 -
2011-10-12 17:00:14 +00:00
sekelsenmat
50f1667209 Some more attempted changes
git-svn-id: trunk@32862 -
2011-10-12 16:57:28 +00:00
sekelsenmat
7914ea9804 Large overhaul to simplify the lowercase1 code
git-svn-id: trunk@32861 -
2011-10-12 16:38:56 +00:00
martin
443e4b5478 LazUtf8: clean up
git-svn-id: trunk@32860 -
2011-10-12 15:23:34 +00:00
martin
ee9c29ab04 LazUtf8: georgian
git-svn-id: trunk@32859 -
2011-10-12 15:00:48 +00:00
martin
c36cc8f766 LazUtf8: attempt to fix the last merge.
git-svn-id: trunk@32856 -
2011-10-12 14:39:07 +00:00
martin
fffd54b8bd another utf8lower
git-svn-id: trunk@32855 -
2011-10-12 14:17:28 +00:00
sekelsenmat
5d79eb6782 Lowercase: Adds Georgian support
git-svn-id: trunk@32854 -
2011-10-12 13:51:33 +00:00
sekelsenmat
dc435d6380 lowercase: Fixes disalligned chars for
git-svn-id: trunk@32852 -
2011-10-12 12:50:38 +00:00
sekelsenmat
2640733df3 Goes back to a new martin2 based LowerCase to avoid code duplication
git-svn-id: trunk@32851 -
2011-10-12 12:33:55 +00:00
martin
d708813957 Fixed new utf8lower
git-svn-id: trunk@32845 -
2011-10-12 11:27:28 +00:00
sekelsenmat
21f584b765 Adds initial support in utf8lowercase for archaic and non-slavic cyrillic
git-svn-id: trunk@32837 -
2011-10-12 06:57:15 +00:00
sekelsenmat
dd582c9852 Removes my original LowerCase and now uses Martins version as the default one
git-svn-id: trunk@32836 -
2011-10-12 06:30:35 +00:00
sekelsenmat
2371688c04 Kills martin 2, adds more commenting to martin 1, removes the table usage from martin 1
git-svn-id: trunk@32834 -
2011-10-12 06:21:49 +00:00
sekelsenmat
3208d981ee Fixes a bug in cyrillic conversion from martin lowercase
git-svn-id: trunk@32833 -
2011-10-12 05:55:07 +00:00
sekelsenmat
36e4b9b936 Adds more comments for martin utf-8 lowercase
git-svn-id: trunk@32832 -
2011-10-12 05:54:38 +00:00
martin
910873ae42 LazUtf8, another candidate for lower-casing
git-svn-id: trunk@32765 -
2011-10-08 09:54:55 +00:00
martin
5a9700b57c LazUtf8, another candidate for lower-casing
git-svn-id: trunk@32764 -
2011-10-08 09:39:26 +00:00
martin
6132be7d61 LazUtf8, another candidate for lower-casing
git-svn-id: trunk@32763 -
2011-10-08 08:46:27 +00:00
martin
7802657a97 LazUtf8, another candidate for lower-casing
git-svn-id: trunk@32760 -
2011-10-07 21:58:21 +00:00
sekelsenmat
dfcfb425d4 Speed optimization for lowercase ASCII
git-svn-id: trunk@32757 -
2011-10-07 14:52:07 +00:00
mattias
1e24d21f65 lazutf8: some optimizations for UTF8LowerCaseMattias
git-svn-id: trunk@32756 -
2011-10-07 14:49:27 +00:00
sekelsenmat
ad5324754e Extends the speed improvements to UpperCase
git-svn-id: trunk@32754 -
2011-10-07 14:40:17 +00:00
sekelsenmat
e1b8857eae Fixes pointer error for turkish
git-svn-id: trunk@32753 -
2011-10-07 14:20:38 +00:00