forked from dankogai/p5-encode
-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathChanges
2354 lines (2223 loc) · 85.7 KB
/
Changes
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
# Revision history for Perl extension Encode.
#
# $Id: Changes,v 2.55 2013/09/14 07:51:59 dankogai Exp dankogai $
#
$Revision: 2.55 $ $Date: 2013/09/14 07:51:59 $
! Encode.pm
Makefile.PL
Unicode/Unicode.pm
lib/Encode/Alias.pm
lib/Encode/CN/HZ.pm
lib/Encode/Encoder.pm
lib/Encode/Encoding.pm
lib/Encode/GSM0338.pm
lib/Encode/Guess.pm
lib/Encode/JP/JIS7.pm
lib/Encode/KR/2022_KR.pm
lib/Encode/MIME/Header.pm
lib/Encode/MIME/Header/ISO_2022_JP.pm
lib/Encode/Unicode/UTF7.pm
t/Encoder.t
replaced 'use base' with 'use parent'
base.pm is an heavy module for what it is used for.
Fortunately it has a tiny replacement, parent.pm
that is on CPAN but also in perl core since 5.10.1.
https://github.com/dankogai/p5-encode/pull/15
2.54 2013/08/29 16:47:39
! Encode.xs
+ t/cow.t
Addressed: COW breakage with _utf8_on()
https://rt.cpan.org/Ticket/Display.html?id=88230
! Encode.pm
Reverted the document accordingly to #11
https://github.com/dankogai/p5-encode/pull/10
+ t/decode.t
Unit test for decoding behavior change in #11
https://github.com/dankogai/p5-encode/pull/12
2.53 2013/08/29 15:20:31
! Encode.pm
Merged: Do not short-circuit decode_utf8 with utf8 flags
https://github.com/dankogai/p5-encode/pull/11
Merged: document decode_utf8 behaviour more precise
https://github.com/dankogai/p5-encode/pull/10
! Makefile.PL
Added repository cpan metadata
https://github.com/dankogai/p5-encode/pull/9
2.52 2013/08/14 02:29:54
! ucm/*.ucm
Addressed:
Unicode Mappping tables are missing Unicode Inc. license notification
All files including "as long as this notice remains attached" now
have that notice attached in the comment section. (cp* and mac*
do not since their source files do not include that notice)
https://rt.cpan.org/Ticket/Display.html?id=87340
! lib/Encode/MIME/Header.pm
t/mime-header.t
Addressed: encoding "0" with MIME-Headers gets a blank string
https://rt.cpan.org/Ticket/Display.html?id=87831
! Encode.pm
Addressed: Documentation buglet
https://rt.cpan.org/Ticket/Display.html?id=84992
! Byte/Makefile.PL CN/Makefile.PL EBCDIC/Makefile.PL
Encode/Makefile_PL.e2x JP/Makefile.PL KR/Makefile.PL
Symbol/Makefile.PL TW/Makefile.PL
Applied: Patch to output #includes in deterministic order
https://rt.cpan.org/Ticket/Display.html?id=86974
2.51 2013/04/29 22:19:11
! Encode.xs
Addressed: Encode.xs doesn't compile with Microsoft C compiler
https://rt.cpan.org/Public/Bug/Display.html?id=84920
! MANIFEST
Addressed: t/taint.t missing
https://rt.cpan.org/Public/Bug/Display.html?id=84919
2.50 2013/04/26 18:30:46
! Encode.xs Unicode/Unicode.xs
lib/Encode/Unicode/UTF7.pm lib/CN/HZ.pm lib/Encode/GSM0338.pm
t/taint.t
Addressed: Encode::encode and Encode::decode
gratuitously launders tainted data
Taintedness now propagates as it should.
https://rt.cpan.org/Ticket/Display.html?id=84879
! encoding.pm
Addressed: 5.18 deprecation
https://rt.cpan.org/Ticket/Display.html?id=84709
! bin/piconv
Applied: Update piconv documentation
https://rt.cpan.org/Ticket/Display.html?id=84695
2.49 2013/03/05 03:12:49
! Encode.xs
Addressed: Encoding objects leak memory if decoding fails
https://github.com/dankogai/p5-encode/issues/8
2.48 2013/02/18 02:23:56
! encoding.pm
t/Mod_EUCJP.pm t/enc_data.t t/enc_eucjp.t t/enc_module.t t/enc_utf8.t
t/encoding.t t/jperl.t
[PATCH] Deprecate encoding.pm
https://rt.cpan.org/Ticket/Display.html?id=81255
! Encode/Supported.pod
Fixed: Pod errors
https://rt.cpan.org/Ticket/Display.html?id=81426
! Encode.pm t/Encode.t
[PATCH] Fix for shared hash key scalars
https://rt.cpan.org/Ticket/Display.html?id=80608
! Encode.pm
Fixed: Uninitialized value warning from Encode->encodings()
https://rt.cpan.org/Ticket/Display.html?id=80181
! Makefile.PL
Install to 'site' instead of 'perl' when perl version is 5.11+
https://rt.cpan.org/Ticket/Display.html?id=78917
! Encode/Makefile_PL.e2x
find enc2xs.bat if it works on windows.
https://github.com/dankogai/p5-encode/pull/7
! t/piconv.t
Fix finding piconv in t/piconv.t
https://github.com/dankogai/p5-encode/pull/6
2.47 2012/08/15 05:36:16
! Encode.pm
POD Fixes: Copyright and mail address
! Makefile.PL
Added LICENSE => 'perl'
! lib/Encode/GSM0338.pm t/gsm0338.t
REALLY fixed RT#75670: Wrong decoding for GSM 3.38 character \x09
ucm/gsm0338.ucm is dropped from MANIFEST since 2.25
but I was fixing the wrong file!
https://rt.cpan.org/Ticket/Display.html?id=75670
! 2.46 2012/08/12 05:49:30
! Encode.pm
Fixed: RT#78917 for I18N-Charset: Fails with Encode 2.45
To be more exact, 2.45 broke Encode->encodings(':all')
https://rt.cpan.org/Ticket/Display.html?id=78917
2.45 2012/08/05 23:08:49
! lib/Encode/Alias.pm
Addressed RT#78125: Missed Mac Alias x-mac-ce
https://rt.cpan.org/Ticket/Display.html?id=78125
! lib/Encode/Unicode/UTF7.pm
Applied the patch in RT#76711
https://rt.cpan.org/Ticket/Display.html?id=76711
! ucm/gsm0338.ucm
Addressed RT#75670: Wrong decoding for GSM 3.38 character \x09
https://rt.cpan.org/Ticket/Display.html?id=75670
! Encode.pm
Applied the patch in RT#72519
https://rt.cpan.org/Ticket/Display.html?id=72519
! Unicode/Unicode.xs
t/Unicode.t
Bug fixes in Unicode.xs by chansen
https://github.com/dankogai/p5-encode/pull/5
! Encode.pm
various POD improvements by daxim
https://github.com/dankogai/p5-encode/pull/4
2.44 2011/08/09 07:49:44
! Unicode/Unicode.xs
Addressed the following:
Date: Fri, 22 Jul 2011 13:58:43 +0200
From: Robert Zacek <[email protected]>
Subject: Unicode.xs!decode_xs n-byte heap-overflow
! Encode.pm encoding.pm
! lib/Encode/Alias.pm lib/Encode/Encoder.pm lib/Encode/Guess.pm
Applied: RT#69735: patch for use constant DEBUG =>
https://rt.cpan.org/Ticket/Update.html?id=69735
2.43 2011/05/21 23:14:43
! lib/Encode/Alias.pm
Addressed RT#68361: Encode::Bytes x-mac-... aliases missing
https://rt.cpan.org/Ticket/Display.html?id=68361
! Encode.pm
Applied the 0001-Fix-typo-in-pod.patch
https://rt.cpan.org/Ticket/Update.html?id=64381
Addressed RT#65796 Deep recursion error finding invalid charset
https://rt.cpan.org/Ticket/Update.html?id=65796
Applied a jumbo doc patch by Tom Christiansen
Message-Id: <14795.1304618434@chthon>
2.42 2010/12/31 22:48:48
! Encode.xs
! Unicode/Unicode.xs
Applied: RT#64371: Update for 5.14 API changes
http://rt.cpan.org/Ticket/Display.html?id=64371
2.41 2010/12/23 11:05:58
! lib/Encode/MIME/Header.pm
Applied: RT#63387 encode of MIME-Header inserts too much whitespace
http://rt.cpan.org/Ticket/Display.html?id=63387
! t/Aliases.t lib/Encode/Alias.pm
Applied: RT#63286: Various Encode::Alias improvements
http://rt.cpan.org/Ticket/Display.html?id=63286
2.40 2010/09/18 18:39:51
! Encode.pm Encode.xs
+ t/utf8ref.t
Addressed: RT#59981: find_encoding("UTF-8")->encode crashes
decode_utf8() is now a little faster, too.
http://rt.cpan.org/Ticket/Display.html?id=59981
http://rt.cpan.org/Ticket/Display.html?id=58541
! lib/Encode/Unicode/UTF7.pm
Addressed: RT#56443 utf-8 flag is not turned off after calling
Encode::encode('UTF-7', $string) to encode an ascii string
http://rt.cpan.org/Ticket/Display.html?id=56443
! t/utf8strict.t
Addressed: RT#57799
http://rt.cpan.org/Ticket/Display.html?id=57799
! lib/Encode/Guess.pm
Addressed: RT#46080: guess_encoding documentation
http://rt.cpan.org/Ticket/Display.html?id=46080
! ucm/nextstep.ucm
Addressed: RT#59668: nextstep encoding is broken - missing ASCII characters
http://rt.cpan.org/Ticket/Display.html?id=59668
! lib/Encode/MIME/Header.pm t/mime-header.t
Addressed: RT#52103: Encode::MIME::Header encoded words not separated by
white space
http://rt.cpan.org/Ticket/Display.html?id=52103
! t/guess.t lib/Encode/Guess.pm
Addressed: Encode: silenced a warning by from_to(..., 'Guess', ...)
http://coderepos.org/share/changeset/37731
2.39 2009/11/26 09:23:59
! Encode.xs t/fallback.t
$utf8 = decode('utf8', $malformed, sub{ ... }) # now works!
http://rt.cpan.org/Ticket/Display.html?id=51204
! t/CJKT.t t/guess.t t/perlio.t
$ENV{'PERL_CORE'} tricks removed since they are no longer necessary.
Message-Id: <[email protected]>
2.38 2009/11/16 14:08:13
! Encode.xs
Addressed: Encode memory corruption [perl #70528]
Message-Id: <[email protected]>
! t/Unicode.t Unicode/Unicode.xs
Patched: #51263: set magic is not applied when modifying encode arguments
http://rt.cpan.org/Ticket/Display.html?id=51263
! Encode.xs
Patched: #51204: Callback CHECK not supported for UTF-8 decoder/encoder
http://rt.cpan.org/Ticket/Display.html?id=51204
! Byte/Byte.pm CN/CN.pm Changes JP/JP.pm KR/KR.pm TW/TW.pm
Unicode/Unicode.pm bin/enc2xs lib/Encode/Supported.pod
Fix URLs
http://rt.cpan.org/Ticket/Display.html?id=49776
! t/CJKT.t t/guess.t t/perlio.t t/piconv.t
$PERL_CORE trick is now off for perl 5.11 or better.
Message-Id: <[email protected]>
Message-Id: <[email protected]>
Message-Id: <[email protected]>
Message-Id: <[email protected]>
2.37 2009/09/06 14:32:21
! Encode.xs
fixed: compilation failure on compilers not supporting C99
http://rt.cpan.org/Ticket/Display.html?id=49466
2.36 2009/09/06 09:03:07
! Encode.xs
fixed: 'find_encoding("utf8")->decode(undef)' causes segmentation fault
http://rt.cpan.org/Ticket/Display.html?id=49462
2.35 2009/07/13 02:06:30
! lib/Encode/MIME/Header.pm
Addressed RT #40027:
decode of MIME-Header removes too much whitespace
http://rt.cpan.org/Ticket/Display.html?id=40027
http://rt.cpan.org/Ticket/Display.html?id=42902
! t/piconv.t
Addressed by CSJEWELL: t/piconv.t loops infinitely on Win32
http://rt.cpan.org/Ticket/Display.html?id=47760
2.34 2009/07/08 13:34:15
! bin/piconv
duplicate-BOM problem now fixed.
Message-Id: <[email protected]>
! bin/piconv
+ t/piconv.t
patches and tests by SREZIC
Message-Id: <[email protected]>
! Makefile.PL
man* removed on behalf of blead
Message-Id: <[email protected]>
2.33 2009/03/25 07:55:57
! lib/Encode/MIME/Header.pm
Decontaminated $& which sneaked in on 2.31.
Message-Id: <67FC9F3A39C746DA95AAB6BB01539099@robmhp>
Message-Id: <[email protected]>
http://coderepos.org/share/changeset/31542
2.32 2009/03/07 07:32:37
! lib/Encode/Alias.pm t/Alias.t
Encode now resolves 'en_US.UTF-8' to utf-8-strict like 'ja_JP.euc'
Those who set locale on their shells should be happier now.
! AUTHORS
added tokuhirom
! Encode.pm
"encode(undef, 'str') should die earlier"
http://coderepos.org/share/changeset/30790
2.31 2009/02/16 06:18:09
! lib/Encode/MIME/Header.pm
"Revert [29767] and [29771] since it breaks perl 5.8" by miyagawa
http://coderepos.org/share/changeset/30111
2.30 2009/02/15 17:44:13
! encoding.pm
fixed regexes, et cetera. by drry
http://coderepos.org/share/changeset/29767
! lib/Encode/MIME/Header.pm
Addressed: Encode::MIME::Header::decode should respect CHECK
http://rt.cpan.org/Ticket/Display.html?id=43204
http://coderepos.org/share/changeset/29767
2.29 2009/02/01 13:14:37
! Encode.pm
VERSION++ just to make PAUSE happy
Message-Id: <[email protected]>
2.28 Date: 2009/02/01 12:30:18
! Unicode/Unicode.xs
Latest refactoring broke the backward compatibility
w/ Perl 5.8.6 and before now restored
Message-Id: <[email protected]>
Message-Id: <[email protected]>
! lib/Encode/MIME/Header.pm
Addressed: Split header lines are joined incorrectly
http://rt.cpan.org/Ticket/Display.html?id=42902
2.27 2009/01/21 22:55:07
! lib/Encode/MIME/Header.pm t/mime-header.t
Addressed: Encode::MIME::Header MIME-Q encoding truncates
trailing zeros in some circumstances
http://rt.cpan.org/Ticket/Display.html?id=42627
! lib/Encode/Alias.pm
Added alias: unicode-1-1-utf-7
http://rt.cpan.org/Ticket/Display.html?id=38558
! Encode.pm
Documented: _utf8_on() does not work for tainted values
http://rt.cpan.org/Ticket/Display.html?id=41163
! bin/enc2xs
s[oss.software.ibm.com/icu][www.icu-project.org]g
http://rt.cpan.org/Ticket/Display.html?id=40245
! lib/Encode/Guess.pm t/guess.t
Addressed:Empty file should produce an error message
http://rt.cpan.org/Ticket/Display.html?id=38652
! Unicode/Unicode.xs AUTHORS
Refactored by Alex Davies
http://www.xray.mpe.mpg.de/mailing-lists/perl5-porters/2007-10/msg00745.html
Message-Id: <7637669B2E3D46B187591747DA27F4C8@Amelie>
2.26 2008/07/01 20:56:17
! Encode.pm
Absense of Encode::ConfigLocal no longer carps no matter what.
http://bugzilla.redhat.com/show_bug.cgi?id=435505#c2
http://rt.cpan.org/Ticket/Display.html?id=28638
http://rt.cpan.org/Ticket/Display.html?id=11511
! lib/Encode/JIS7.pm
use encoding 'utf8' and 'iso-2022-jp' glitches on perl 5.10
Thanks, MIYAGAWA
Message-Id: <[email protected]>
! lib/Encode/Alias.pm t/Aliases.t
macintosh' not recognize as MacRoman
http://rt.cpan.org/Ticket/Display.html?id=36326
! Makefile.PL
s{INC => "-I./Encode"}
{INC => '-I' . File::Spec->catfile( '.', 'Encode' )}
To prevent some platforms from forgetting to include Encode/encode.h.
http://rt.cpan.org/Ticket/Display.html?id=36348
2.25 2008/05/07 20:56:05
! Encode.pm
added ':default' to Exporter option.
! lib/Encode/GSM0338.pm
GSM0338 now handles coderef in CHECK
http://rt.cpan.org/Ticket/Display.html?id=31335
! Makefile.PL
Perl 5.10/Encode 2.24: Tiny typo in Encode's Makefile.PL arg processing
Message-Id: <[email protected]>
! lib/Encode/Alias.pm
"This fix for Encode::Alias should make Solaris happy:"
Message-ID: <[email protected]>
2.24 2008/03/12 09:51:11
! lib/Encode/Config.pm
adds and fixes also adds cp858 support.
! Encode.pm encoding.pm lib/Encode/Alias.pm ucm/cp858.ucm
Merged perl@33486.
> Change 33486 by rgs@scipion on 2008/03/12 08:50:11
An unfortunate side-effect of Encode and Encode::Alias use'ing each
other, and Encode::Alias exporting functions into Encode for it to use
as methods, broke the loading of the find_alias() Encode method in some
cases since 5.10. Breaking the recursive inheritance fixes it.
Message-Id: <[email protected]>
! Encode.pm
POD fix by tels
Message-Id: <[email protected]>
! bin/ucmlint
Fix by MIYAGAWA via CodeRepos
http://coderepos.org/share/changeset/1791
! encoding.pm t/mime_header_iso2022jp.t
ported back from Perl 5.10-RC1
2.23 2007/05/29 18:15:32
! Encode.xs
got rid of global fallback_cb; encode_method() now takes one more
argument which is a coderef to fallback. This should make
encode_method() thread-safe.
! Encode.pm
Added perluniintro, perlunifaq, and perlunitut to POD
! Encode.xs
Plug a memory leak in Encode -- by rgs
Message-Id: <[email protected]>
! Unicode/Unicode.pm
POD fixes on UTF-16LE
http://aspn.activestate.com/ASPN/Mail/Message/perl5-porters/3486118
! Makefile.PL
man page generation is now conditional; yes by default but no if $PERL_CORE
Message-Id: <[email protected]>
2.22 2007/05/29 07:35:27
! Encode.pm
from_to() does not honor the check while decoding. That's a feature.
To make sure it is a feature it is mentioned in the POD.
http://rt.cpan.org/NoAuth/Bug.html?id=27277
! Makefile.pl
Encode used to suppress man page generation. Now it does.
http://rt.cpan.org/NoAuth/Bug.html?id=27200
! Encode.pm Encode.xs t/fallback.t
Addressed: (de|en)code("ascii", "\x{3000}", sub{ $_[0] }) segfaults
Reported by MIYAGAWA
2.21 2007/05/12 06:42:19
+ lib/Encode/MIME/Name.pm t/mime-name.t
! Encode.pm Encode.xs lib/Encode/Encoding.pm
new method: mime_name()
inspired by: MIYAGAWA
! t/encoding.t
Subject: Re: Compress::Zlib, pack "C" and utf-8 [PATCH]
From: Marc Lehmann <[email protected]>
Date: Thu, 12 Apr 2007 08:41:53 +0200
Message-ID: <[email protected]>
http://public.activestate.com/cgi-bin/perlbrowse/p/31194
! Unicode/Unicode.pm
POD fix.
Message-Id: <[email protected]>
2.20 2007/04/22 14:56:12
! Encode.pm
Pod fixes. Now find_encoding() is explained more in details.
+ lib/Encode/GSM0338.pm
- ucm/gsm0338.ucm
! lib/Encode/Supported.pod lib/Encode/Config.pm Bytes/Makefile.PL t/gsm0338.t
ESTI GSM 03.38 support is relocated from Encode::Byte to Encode::GSM0338.
This encoding is so kaputt it is unfit for Encode::XS!
Though it was okay for general cases and escape sequences,
'\0' => '@' IFF '\0\0' => '\0' had gliches.
So kaputt even t/gsm0338 wrongly interpreted that.
ref. http://www.csoft.co.uk/sms/character_sets/gsm.htm
! encoding.pm t/Aliases.t
Imported from bleedperl #31015
2.19 2007/04/06 12:53:41
! lib/Encode/JP/JIS7.pm
+ t/jis7-fallback.t
encode('iso-2022-jp') fallback support added by MIYAGAWA++
decode()'s fallback remains unchanged (FB_PERLQQ) since UTF-8
contains all characters in iso-2022-jp so there's no need for fancy stuff.
Message-Id: <[email protected]>
! Encode.pm
#25216 ([PATCH] Encode.pm: postpone the load of Encode::Encoding)
http://rt.cpan.org/NoAuth/Bug.html?id=25216
! lib/Encode/MIME/Header.pm t/mime-header.t
#24418 (Encode::MIME::Header: wrong encoding with latin1 characters)
http://rt.cpan.org/NoAuth/Bug.html?id=24418
! Encode.pm
#23876 (Add documentation for LEAVE_SRC)
http://rt.cpan.org/NoAuth/Bug.html?id=23876
! lib/Encode/Alias.pm t/Aliases.t
#20781: Thai encoding needs alias for tis-620
http://rt.cpan.org/NoAuth/Bug.html?id=20781
! bin/piconv AUTHORS
#20344: piconv: wrong conversion of utf-16le encoded files (with PATCH)
http://rt.cpan.org/NoAuth/Bug.html?id=20344
! Encode.pm Encode.xs bin/enc2xs encoding.pm t/Aliases.t t/utf8strict.t
Imported from bleedperl's 2.18_01
2.18 2006/06/03 20:28:48
! bin/enc2xs
overhauled the -C option
- added ascii-ctrl', 'null', 'utf-8-strict' to core
- auto-generated Encode::ConfigLocal no longer use v-string for version
- now searches modules via File::Find so Encode/JP/Mobile is happy
! Byte/Byte.pm CN/CN.pm EBCDIC/EBCDIC.pm JP/JP.pm KR/KR.pm Symbol/Symbol.pm
use strict added; though all they do is load XS, it's
still better a practice
! *.pm
use warnings added to all of them for better practices' sake.
2.17 2006/05/09 17:10:09
! encode.pm
'chin' =~ /^zh_CN|chin(?:a|ese)?$/i is true
but chin is not china or chinese.
http://d.hatena.ne.jp/jankogai/20060508/1147090316
! Encode.xs
Integrated maintperl change (27824|27824) which I overlooked
-- sorry, Nicholas and Coverity Scan.
Message-Id: <[email protected]>
Message-Id: <[email protected]>
2.16 2006/05/03 18:24:10
! bin/piconv
--xmlcref and --htmlcref added.
! Encode.pm
Copyright Notice Added.
http://rt.cpan.org/NoAuth/Bug.html?id=19056
! *
Replaced remaining ^\t with q( ) x 4. -- Perl Best Practice pp. 20
And all .pm's are now perltidy-ed.
2.15 2006/04/06 15:44:11
! Unicode/Unicode.xs
Addressed: UTF-16, UTF-32, UCS, UTF-7 decoders mishandle illegal characters
http://rt.cpan.org/NoAuth/Bug.html?id=18556
! Encode.pm
added str2bytes() as an alias to encode() and bytes2str() as an alias
to decode()
http://rt.cpan.org/NoAuth/Bug.html?id=17103
! Encode.xs
Change 26922: Avoid warning with MS Visual C compiler.
Message-Id: <[email protected]>
! t/perlio.t
Change 26067: As using -C to turn on utf8 IO is equivalent to the open pragma
Message-Id: <[email protected]>
2.14 2006/01/15 15:43:36
! Makefile.PL
Change 26295: Don't build manpages for Encode and Unicode::Normalize
Message-Id: <[email protected]>
! Encode.pm
Change 26081: Pod nit in Encode.pm, found by Marc Lehmann in RT #36949.
Message-Id: <[email protected]>
! Encode.xs Encode/encode.h bin/enc2xs encengine.c
Change 25821: Mark more static Encode data structures as const.
Change 25823: use more 'const' in the Encode data structures.
Message-Id: <[email protected]>
Message-Id: <[email protected]>
2.13 2006/01/15 15:06:36
! AUTHORS
Miyagawa's mail address updated
Message-Id: <[email protected]>
! lib/Encode/MIME/Header.pm
#16413: Encode::MIME::Headers patch to solve what is probably someone else's bug
http://rt.cpan.org/NoAuth/Bug.html?id=16413
! lib/Encode/MIME/Header.pm t/mime-header.t
Applied: RT #16258: Support for RFC 2184 language tag
http://rt.cpan.org/NoAuth/Bug.html?id=16258
! Encode.pm
Fixed RT #14559: fix for #8872 introduces new "bug"
http://rt.cpan.org/NoAuth/Bug.html?id=14559
! Encode.pm
+ t/from_to.t
from_to() now makes use of $check more naturally.
Message-Id: <[email protected]>
2.12 2005/09/08 14:17:17
! Encode.xs Encode.pm t/fallback.t
Now accepts coderef for CHECK!
! ucm/8859-7.ucm
Updated to newer version at unicode.org
http://rt.cpan.org/NoAuth/Bug.html?id=14222
! lib/Encode/Supported.pod
More POD typo fixed.
! encoding.pm
More POD typo leftover fixed.
Message-Id: <[email protected]>
2.11 2005/08/05 10:58:25
! AUTHORS CHANGES
To reflect changes below
! Encode.pm encoding.pm
lib/Encode/Alias.pm lib/Encode/PerlIO.pod lib/Encode/Supported.pod
Typo fixed by Piotr Fusik in Change 25261 & 25266
Message-ID: <001401c595bd$dccb5d80$0bd34dd5@piec>
! Encode.xs
Addresses "BUG REPORT: panic in Encode.xs".
Message-Id: <[email protected]>
+ lib/Encode/MIME/Header/ISO_2022_JP.pm mime_header_iso2022jp.t
! lib/Encode/MIME/Header.pm lib/Encode/Config.pm
Encoding 'MIME-Header-ISO_2022_JP' is introduced by Makamaka
Message-Id: <[email protected]>
! Encode/encode.h Encode.pm Encode.xs
PerlIO's "encoding(utf-8-strict)" got a problem w/ partial character.
Found and addressed by KONNO Hiroharu <[email protected]>
See also ext/PerlIO/encoding/encoding.pm
Message-Id: <[email protected]>
2.10 2005/05/16 18:46:36
! Encode.pm
fixed decode_utf8() accordingly to RT#8872
http://rt.cpan.org/NoAuth/Bug.html?id=8872
! Encode.xs AUTHORS
s/SvIVX/SvIV_set/ by Steve Peters.
Message-Id: <[email protected]>
! AUTHORS
GAAS was missing!
! Encode.pm
New Pod section: "UTF-8 vs utf8"; explains utf-8-strict
+ t/utf8strict.t
Tests utf-8-strict, accordingly to
UTF-8 decoder capability and stress test" by Markus Kuhn
http://smontagu.damowmow.com/utf8test.html
Note that malformed and overlong sequences are not test here
because perl already does that for you, utf-8-strict or not.
! Encode.pm Encode/encode.h t/fallback.t
Addressed "encode(..., Encode::LEAVE_SRC) does not work".
Now FB_(PERLQQ|HTMLCREF|XMLCREF) implies LEAVE_SRC so
you can (en|de)code constant strings with these fallbacks.
http://rt.cpan.org/NoAuth/Bug.html?id=8736
! Encode.pm Encode.xs lib/Encode/Alias.pm t/Aliases.t
Make Encode.pm support the real UTF-8, by GAAS
Message-Id: <[email protected]>
Message-Id: <[email protected]>
! Encode.pm Encode.xs
post-2.09 comment patches from GAAS applied.
Message-Id: <[email protected]>
Message-Id: <[email protected]>
2.09 2004/12/03 19:16:53
! Encode.pm Encode.xs
Addressed " :encoding(utf8) broken in perl-5.8.6".
Message-Id: <[email protected]>
! Encode.pm
Addressed "(de|en)code($valid_encoding, undef) does not warn".
http://rt.cpan.org/NoAuth/Bug.html?id=8723
! Encode.pm t/Encode.t
Addressed "Can't encode URI". When a reference is fed to (en|de)code,
Encode now stringifies instead of returning undef.
http://rt.cpan.org/NoAuth/Bug.html?id=8725
! Encode.xs t/fallback.t
Addressed "FB_HTMLCREF and FB_XMLCREF for the UTF-8 decoder".
http://rt.cpan.org/NoAuth/Bug.html?id=8694
! Encode.pm
Addressed "s/digit/number/".
http://rt.cpan.org/NoAuth/Bug.html?id=8695
! Encode.pm
Addressed "while (defined(read )) { ... } is an infinite loop".
http://rt.cpan.org/NoAuth/Bug.html?id=8696
! Encode.pm
Addressed "What the heck is UCM?".
Document fixed so that it no longer contains "UCM-Based Encodings".
http://rt.cpan.org/NoAuth/Bug.html?id=8697
2.08 2004/10/24 13:00:29
! Encode.xs lib/Encode/Encoding.pm Unicode/Unicode.{pm,xs}
Resolved the issue that was raised by 2.07 -- Encode::utf8 fallbacks
that was introduce messed up PerlIO::encoding.
* To do so, ->renew() is renewed and ->renewed() was introduced to
tell whether the caller is PerlIO or not.
Message-Id: <[email protected]>
2.07 2004/10/22 19:35:52
! lib/Encode/Encoding.pm
"Remove Carp from warnings.pm" that influences Encode, by Tels.
Message-Id: <[email protected]>
! Encode.xs AUTHORS t/fallback.t
Now Encode::utf8's fallbacks are compliant to Encode standard.
Thank Bjoern Hoehrmann for persistently convincing me.
Message-Id: <[email protected]>
! Encode.pm
POD further revised.
2.06 2004/10/22 06:23:11
! ucm/mac*
RT #8083 reports that MacThai mapping was obsolete
Updated all mac* encodings accordingly to the URI below.
One remaining mystery is that MacRomanian vs. MacRumanian.
MacRumanian is not found in unicode.org...
http://www.unicode.org/Public/MAPPINGS/VENDORS/APPLE/
! Encode.pm t/Encode.t
Fixed RT #8081: "decode(..., bless{},'x') segfault"
Two more tests added to test that.
http://rt.cpan.org/NoAuth/Bug.html?id=8081
! Encode.pm
POD revised accordingly to RT #7966
http://rt.cpan.org/NoAuth/Bug.html?id=7966
! Unicode/Unicode.pm
POD updated explaining why Encode::Unicode always croaks on error
rather than giving users choices.
http://rt.cpan.org/NoAuth/Bug.html?id=7892
2.05 2004/10/19 04:55:01
! encoding.pm
"unnuke" jhi's patch in bleedperl, with minor correction by dankogai.
Message-ID: <[email protected]>
Message-ID: <20041018233442.7418113f@r2d2>
Message-Id: <[email protected]>
2.04 2004/10/16 21:22:44
! Makefle.PL
From: [email protected]
Subject: [PATCH ext/Encode/Makefile.PL] make Encode.c dependency explicit
Message-Id: <[email protected]>
2.03 2004/10/06 05:07:20
! lib/Encode/Alias.pm
Resolved some alias case sensitivity glitches reported via RT.
http://rt.cpan.org/NoAuth/Bug.html?id=7835
! bin/piconv
Resolved Win32 glitches reported via RT.
(Fixed by dankogai and tested by Steve Hay)
http://rt.cpan.org/Ticket/Display.html?id=7831
! JP/JP.pm lib/Encode/Alias.pm lib/Encode/Supported.pod AUTHORS
/\bwindows-31j$/i is now an alias of CP932, by Steve Hay.
http://rt.cpan.org/NoAuth/Bug.html?id=6695
2.02 2004/08/31 10:55:34
! ucm/big5-hkscs.ucm AUTHORS t/big5-hkscs.enc t/big5-hkscs.utf
New map submitted by Deng Liu and Autrijus. Test data needed
to be upgrade as well, done by dankogai
Message-Id: <[email protected]>
! bin/ucmsort
Now works for characters U+10000 and above. This fix was needed
to "tidy" the original map that was submitted.
! bin/enc2xs
"ucmsort" now mentioned in pod
2.01 2004/05/25 16:27:14
! bin/enc2xs AUTHORS
From: [email protected]
Subject: [PATCH] Correct statistics from enc2xs
! lib/Encode/Alias.pm
Addressed "False [] range "\s-" in regex;" in Encode::Alias.pm
2.01 2004/05/25 16:27:14
! lib/Encode/CN/HZ.pm lib/Encode/Unicode/UTF7.pm
"If someone thinks utf8::upgrade($1) should be croaked like
chom?p($1),please try the following patch for Encode.pm."
-- sadahiro-san
2.0 2004/05/16 20:55:15
* version updated to 2.00
-- sorry, no big feature change. I just hate version 1.100 :)
! lib/Encode/Guess.pm
Unicode/Unicode.pm
addressed UTF-(8|32LE) + BOM misguessing
https://rt.cpan.org/Ticket/Display.html?id=6279
! Encode.pm
s/is_utif8/is_utf8/ in POD
! Encode/lib/Encode/CN/HZ.pm
Fixes "make test" failure after the patch to pp_hot.c
by Sadahiro-san
Message-Id: <[email protected]>
! bin/piconv
From: [email protected]
Subject: [PATCH] "piconv -C 512" badly broken
Message-Id: <1072870210.769.5.camel@localhost>
1.99 2003/12/29 02:47:16
! Unicode/Unicode.xs
find_encoding("UTF-16BE")->encode("abc") now null terminates
http://www.xray.mpe.mpg.de/mailing-lists/perl5-porters/2003-10/threads.html#00258
! Encode.pm
prototype bug in decode_utf8() fixed
Message-Id: <[email protected]>
! Encode.pm /MANIFEST encoding.pm lib/Encode/Supported.pod
t/at-cn.t t/at-tw.t t/gsm0338.t ucm/gsm0338.ucm
+ t/gsm0338.t
Merged from maintperl@21987
1.98 2003/08/20 11:15:31
! lib/Encode/MIME/Header.pm AUTHORS t/mime-header.t
Dave Evans has found and corrected a bug in Encode::MIME::Header.
Test suite added by Dan Kogai.
Message-Id: <[email protected]>
! encoding.pm
Typo fixes rolled back in from bleedperl
! t/at-cn.t t/at-tw.t
v-strings, now depreciated in perl 5.8.1, is replaced by sadahiro
Message-Id: <[email protected]>
! bin/enc2xs
argv case nit for VMS by Craig
Message-ID: <[email protected]>
! t/enc_eucjp.t t/enc_utf8.t AUTHORS
Encode test fixes for VMS by Peter Prymmer
Message-ID: <OFBD4A7559.D7CF9517-ON85256D6B.00534853-85256D6B.00538131@factset.com>
! lib/Encode/Alias.pm t/Aliases.t
koi-8 aliases bug detected and patched by sadahiro.
Further fix and test suite by dankogai
Message-Id: <[email protected]>
1.97 2003/07/08 21:52:14
! encoding.pm lib/Encode/Guess.pm lib/Encode/Alias.pm
lib/Encode/JP/JIS7.pm lib/Encode/Encoder.pm Encode.pm
$DEBUG replaced with DEBUG() so perl optimizes better,
by Rafael with further fixes by dankogai
Message-Id: <[email protected]>
! lib/Encode/Aliases.pm
Was: define_alias( qr/\bGB[-_ ]?2312(?:\D.*$|$)/i => '"euc-cn"' );
Now: define_alias( qr/\bGB[-_ ]?2312(?!-?raw)/i => '"euc-cn"' );
So new hash seeding introduced in bleedperl works.
Message-Id: <[email protected]>
! lib/Encode/Guess.pm
$Encode::Guess::NoUTFAutoGuess is added so you can turn off
automatic utf(8|16|32) guessing -- originally by Autrijus
Message-Id: <[email protected]>
! Encode.pm
Addressed the following;
Subject: [perl #22835] FB_QUIET doesn't work with Encode::encode
Message-Id: <[email protected]>
1.96 2003/06/18 09:29:02
! lib/Encode/JP/JP.pm t/guess.t
m/(...)/ in void context then $1 is considered a Bad Thing
Message-Id: <[email protected]>
! Encode.pm
Mentions in POD that as of perl 5.8.1 utf8::is_utf8() is
also available.
! encengine.c
More typecast from maintperl@19739
Message-Id: <[email protected]>
! t/perlio.t
Tests 37 & 38 failed on Win32 -- yet another CRLF issue
Message-Id: <[email protected]>
! t/Encode.t
Now skips for EBCDIC platform.
Message-Id: <[email protected]>
! t/perlio.t
Craig's patch applied that addresses "Many systems (DOS, VMS) cannot
have more than one C<.> in their filenames." -- perlport.
Message-Id: <[email protected]>
! bin/piconv
Found and fixed the back that -p,--perlqq does not work.
Induced by the change from Getopt::Std to Getopt::Long.
! encoding.pm
Addressed [cpan #2629] Wrong assumption in numeric comparison
Message-Id: <[email protected]>
! Encode.pm Encode.xs Unicode/Unicode.pm Unicode/Unicode.xs
lib/Encode/Encoding.pm t/perlio.t
! API Change: ->new_sequence() => ->renew()
+ Encode::Unicode makes use of it so it can handle BOM on PerlIO
+ Encode::XS and Encode::utf8 now supports ->renew()
+ Encode::Encoding now documents this with examples
- Non-XS (en|de)code stripped out of Encode::Unicode
Message-Id: <[email protected]>
1.95 2003/05/21 08:41:11
! ucm/8859-*.ucm
Since bogus entries were found in iso-8859-6, all entries are
re-generated once again out of
http://www.unicode.org/Public/MAPPINGS/ISO8859/8859-*.TXT
Thank David Graff <[email protected]> for the discovery
Message-Id: <[email protected]>
+ lib/Encode/Unicode/UTF7.pm
! lib/Encode/Config.pm lib/Encode/Alias.pm Unicode/Unicode.pm t/Unicode.t
lib/Encode/Supported.pod
UTF-7 support is now added. With this Encode now has all transcoding
methods in Unicode::String.
1.94 2003/05/10 18:13:59
! lib/Encode/MIME/Header.pm
A more sophisticated solution for double-encoding by dankogai
! lib/Encode/MIME/Header.pm AUTHORS
Two bugs fixed by Bjoern Jacke
* "Double Encoding" was not possible
i.e. encode("MIME-B" => "=?UTF-8?B?w4RwZmVs?=")
* encode("MIME-Q") had UTF-8 flag on
Message-Id: <[email protected]>
! lib/Encode/MIME/Header.pm AUTHORS
Two occurances of "croak ()" fixed as "croak qq()".
Simon Cozens is added to AUTHORS as a result.
Message-Id: <[email protected]>
! bin/piconv
POD fixes that reflect enhancements by jhi
! bin/piconv
Two enhancements by jhi.
+ Now uses Getopt::Long so it accepts long name options
(--from for -f, for example)
+ New option: -r,--resolve
Message-Id: <[email protected]>
! MANIFEST META.yml
META.yml added upon request of Schwern
Message-Id: <[email protected]>
! AUTHORS
Enache Adrian removed upon request -- to live longer than Encode
and/or FreeBSD (toy-)?thread :)
Message-Id: <[email protected]>
! t/enc_module.t
"close STDOUT unless $^O eq 'freebsd';" once again relocated
to keep VMS happy in which case "$^O eq 'freebsd'" is required
to keep FreeBSD+thread happy. Sigh.
Message-Id: <[email protected]>
1.93 2003/04/24 17:43:16
! t/enc_eucjp.t
added "no warnings 'pack'" in for loop to keep bleedperl from
complaining "Character in 'C' format wrapped in pack".
! Makefile.PL
More elegant perl core detection inspired by Ilya Zakharevich
(but further elaborated for general cases).
! lib/Encode/Encoding.pm lib/Encode/PerlIO.pod
POD fixes.
! t/euc-jp.ucm
like cp9??, \x80-\x9F (control + 0x80) are zapped so they
are less likely to be confused w/ ISO-8859-*
! t/CJKT.t
RT tests added (vendor encodings are exemplified)
-- that successfully found a flaw on iso-2022-kr before the patch.
! lib/Encode/CJKConstants.pm lib/Encode/KR/2022_KR.pm
decode("ISO-2022-KR") has been buggy but no one ever sited
that since no one seems to be using it. Bugs discovered by
SADAHIRO-san
Message-Id: <[email protected]>
! lib/Encode/CN/HZ.pm t/perlio.t
HZ is now perlio_ok, thanks to SADAHIRO-san. perlio.t modified
so it adds test for HZ.
Message-Id: <[email protected]>
! lib/Encode/Guess.pm
Now guesses UTF-(16|32)(BE|LE) when the string contains \x00.
So long as the string contains \x{00}-\x{ff} it does not fail.
See perldoc for details.
Message-Id: <[email protected]>
1.92 2003/03/31 03:27:27
! ucm/big5-eten.ucm ucm/big5-hkscs.ucm
Extraneous single-byte chars in range \x80-\xA0 and \xFA-\xFF
removed. FYI, IBM's ICU has none of these for java-Big5-1.3_P.ucm
but glibc-BIG5-2.1.2.ucm does.
Message-Id: <[email protected]>
! ucm/cp932.ucm ucm/cp936.ucm ucm/cp949.ucm ucm/cp950.ucm
Maps regenerated again but this time based upon
http://oss.software.ibm.com/cvs/icu/charset/data/ucm/
(But where is THE DOCUMENT by MICROSOFT?)
! t/enc_module.t AUTHORS
failure with threaded Perl on FreeBSD addressed.
Enache Adrian <[email protected]> is added to AUTHORS for this.
Message-Id: <[email protected]>
! lib/Encode/Guess.pm
Some POD fixes.
! t/CJKT.t
Change 18989: Make the :bytes conditional on PerlIO.
further Modified by Dan Kogai
! t/enc_module.t
Chnage 18966: another fix for failing test on windows ("use encoding"
puts STDIN in :raw mode, so chomp() wasn't stripping the CR), by gsar
Message-Id: <[email protected]>
! t/CJKT.t
Change 18970: Hopefully this works also in Win32, by jhi
Message-Id: <[email protected]>
Change 18965: fix CJKT.t failures on windows due to incorrect
binmode(), by gsar
Message-Id: <[email protected]>
1.91 2003/03/09 20:07:37
! encoding.pm
even more proofread by jhi.
Message-Id: <[email protected]>
! t/enc_module.t
-use lib 't';
+use lib qw(t ext/Encode/t ../ext/Encode/t);
Message-Id: <[email protected]>
! AUTHORS
s/Hirohito/Hiroto/ig; Sorry, Hiroto-san.
Message-Id: <[email protected]>
! encoding.pm
s/logner/longer/
Message-Id: <[email protected]>
1.90 2003/03/09 17:32:43
! encoding.pm
+ t/enc_data.t
Inaba-san has added a patch for perl 5.8.1 or later that makes
encoding.pm work for <DATA> filehandle. t/enc_data.t is to test
that. POD is further revised.
Message-Id: <[email protected]>
! encoding.pm t/enc_module.t
encoding vs. ${^UNICODE} resolved. POD revised accordingly.
Message-Id: <[email protected]>
1.89 2003/02/28
! Encode.xs
signed vs. unsigned issue discovered by Craig on OpenVM
Message-Id: <a05200f12ba81fe9d6298@[172.16.52.1]>
! encoding.pm AUTHORS
+ t/Mod_EUCJP.pm t/enc_module.enc t/enc_module.t
Because binmode() stacks layers instead of overwrite, you have to
":raw :encoding()" in encoding.pm or your are in trouble when you
call encoding.pm multiple times. There are several workarounds