-
Notifications
You must be signed in to change notification settings - Fork 5
/
Copy pathTODO
33 lines (31 loc) · 1.38 KB
/
TODO
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
JCP - Java Conformal Prediction framework
-----------------------------------------
TODO
* Verify the computation of p-values.
-> Seems ok, or nearly so.
* Add class conditional conformal classification.
-> Done for ICC and TCC now.
* Add/integrate inductive conformal regression.
* More non-conformity functions.
* Proper support for multi-class classification.
* Framework for predictive performance metrics.
-> Some have been added.
* Add support for explicitly giving the training and calibration set for ICC,
rather than randomly partition the supplied set.
-> Partially done.
* Add support for cross-validation.
* Improve memory utilization for TCP
* Small pool of (n+1)-sized training sets for use by worker threads.
* Specialized matrix API to share training instances between training set
copies when that is possible.
* Use OpenMP and http://www.csie.ntu.edu.tw/~cjlin/libsvm/faq.html#f432
to parallelize libsvm internally too.
-> Done, but not committed yet.
KNOWN BUGS
* Most parts only marginally tested -> more bugs to come..
* Memory leaks in the JCP code for matrix manipulation in the libsvm binding.
-> Should be fixed now, but needs further testing.
* Memory leaks in OpenCV code for matrix manipulation in the OpenCV bindings.
-> TCC, in particular, might run out of memory.
* Saved TCC models include the training set in a rather space inefficient
encoding.