-
Notifications
You must be signed in to change notification settings - Fork 1
/
change.log
220 lines (157 loc) · 7.13 KB
/
change.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
===============================================================================
version 3.2.6 2013/12/20-
Features:
1. add 'func' support for field format
E.g. <func args="0;2">substr</func>
2. add mapsplit expType
3. add mapKeys and notMapKeys for 'map' output
mapKeys: only key in mapKeys is allowed
notMapKeys: if key not in mapKeys, it's allowed
4. in field format, add 'strip', 'stripLower', 'stripUpper' data type
Bugs:
1. merging directly not right when set start time in xml
#TODO
2. merge not right for some points when using bandwidth analyser
#TODO
3. cannot dump for multiple times when map output
#TODO
workaround: set the min sample num to 1000
4. no originLine for other log parsers expect LogParser
5. for regexformat, when parsing expection, the variable value is not init
===============================================================================
version 3.2.5 2013/12/11
Features:
1. add model debug level control in the code
add debug levels: debug, info, warning, error, critical
2. add support to merge from 'tmp/' directory directly
3. add 'split' and 'findAll' in regular parsing, including formatter and regexparser
Bugs:
1. fmtName is like 'CACHE_MISS' in map's output will make merge failed
FIX: replace split '_' to ':'
2. merge fails when map output has child average output
RC: parse map head fails
3. invalid file header of the map output's child output when it's the last log field of the log line
RC: log line doesn't get stripped before parsing when using multiple cores
4. sometimes processes exit before merging
#defensive fix
using feature 2: merge from 'tmp/' directly, since the 'tmp/' is complete even the bug happens
5. RawOutputHelper cannot support merge
6. only needs list the log files not walk all files recursively in log directory
7. one more out lines in output file when pace is -1
RC: when is empty, the sampler flush still
FIX: no flush_cb when is empty
8. for XactRateAnalyser, no anly_negative_pace function when pace is -1
9. when merging directly from tmp/, if may not sort right when the analyser has no inter-count
FIX: add anlyId support to identy each analyser by sequence
10. merge not work for RawOutputHelper
11. [FATAL] in sampler, when flush the second list, it is always empty
RC: wrong assignment to set the second sample count to the current list
FIX: give the right assignment
12. in XactRateAnalyser, it's wrong when using multiple processes optimization
RC: forget to multiple the pace when decoding
FIX: multiple the pace
13. the logparser cannot work after the debug level feature
RC: old version python does not support funcname in log format
14. merging directly from tmp/ fails when using different core numbers
===============================================================================
version 3.2.4 2013/12/03
Features:
1. add block value support, like ifblock
2. add filters support for the conditions of the ifblock
3. add support sorting for map output, when the pace is -1
4. add 'lowercase' and 'uppercase' type in the field in the formatter
Bugs:
1. try first parse the file time from the file name in case the disorder of the translog
2. fmtName is like 'CACHE_MISS' in map's output will make merge failed
#TODO
===============================================================================
version 3.2.3 2013/10/18
Features:
1. add filter analyser support
only output the results into stdout
2. add common format support
3. support re-format the log fields
with the <formatter> element
4. support regex log type
by setting the log regex format and with the help of the feature 3, we can parse any type of logs now
5. support regex format the log fields
in the <formatter>, we can use the regex to retrieve any part of the log fields and set them as the new fields with the given fmtNames
Bugs:
1. fix the bug that parsing failure for webengine abr
2. fix the bug that parsing failure when there are spaces in the fields
convert the spaces in the fields to '|'
3. fix the bug that it fails to give the regex format as argument directly
add support for short name format file as '-s' option
4. the joint point values are not correct for the average helper in merging
output the count meantime so it can recover the original total value
5. merge activeSessions wrong
defencive fix: disable optimization for merging
6. bandwidth and activeSessions not acurate
for bandwidth, modify the standord bandwidth analyser, which is ok now. But for the customized timeAverage, it cannot be modified based on current framework;
for activeSessions, it's acurate, no need to change
7. fix the bug that the sampler flush from the 1969 year when merging
===============================================================================
version 3.2.2
Bugs:
1. merge point value not right for bandwidth analyser with pace 10
RC: minTime control in the sampler should be aligned to the pace
===============================================================================
version 3.2.1
Enhancements:
1. using multiple processes to optimize the merge procedure
Bugs:
1. when the seg output file size is 0, it may crash
2. fix some problems when running in python 2.4
3. crash when there is only one output in the outputs element
4. crash when running in python 2.4 without set the <num cores>
===============================================================================
version 3.2
Features:
1. add outPath element in config file
2. reconstruct the AnalyserHelper code, support all analyser types to be realized with output
3. support not singleType value in output
4. support sub-outputs in map output
5. optimize tool running speed with multiple processes
Bugs:
1. some tokens of webengine have not been defined with the right parse functions
2. error output file not closed
3. error output file no need to be created when there is no errorlog
===============================================================================
version 3.1, 2013/09/10
Features:
1. support python 2.4 and above
2. support read lines from stdin
Bugs:
1. remove time seconds in bandwidth and activeSessions output file
===============================================================================
version 3.0.2
Features:
1. add derived tokens for %C
2. add 'max' and 'min' output types
3. add insertValue for output
4. add RawOutputHelper support
5. always output the head string for multiple outputs
Bugs:
1. sample start time not init for sorted logs
===============================================================================
version 3.0.1
Features:
1. add sort control for the sorted logs, like errorlog
===============================================================================
version 3.0
Features:
1. add output support
2. add translog support for: service-monitor, content-mgt, wmt, fms, movie-streaming
===============================================================================
version 2.3.7
Features:
1. add support for service router translog
Bugs:
1. no output error when pace is -1
===============================================================================
version 2.3.6
Features:
1. add support to parse errorlog
Bugs:
1. useless end line with big time of the output file
2. remove toAdd for sample time to output