详细描述

multiclass one vs rest strategy used to train generic multiclass machines for K-class problems with building ensemble of K binary classifiers

multiclass probabilistic outputs can be obtained by using the heuristics described in [1]

[1] J. Milgram, M. Cheriet, R.Sabourin, "One Against One" or "One Against One": Which One is Better for Handwriting Recognition with SVMs?

在文件 MulticlassOneVsRestStrategy.h 第 33 行定义.

类 CMulticlassOneVsRestStrategy 继承关系图:

[图例]

Public 成员函数
	CMulticlassOneVsRestStrategy ()

	CMulticlassOneVsRestStrategy (EProbHeuristicType prob_heuris)

virtual	~CMulticlassOneVsRestStrategy ()

virtual void	train_start (CMulticlassLabels orig_labels, CBinaryLabels train_labels)

virtual bool	train_has_more ()

virtual SGVector< int32_t >	train_prepare_next ()

virtual int32_t	decide_label (SGVector< float64_t > outputs)

virtual SGVector< index_t >	decide_label_multiple_output (SGVector< float64_t > outputs, int32_t n_outputs)

virtual int32_t	get_num_machines ()

virtual const char *	get_name () const

virtual void	rescale_outputs (SGVector< float64_t > outputs)

virtual void	rescale_outputs (SGVector< float64_t > outputs, const SGVector< float64_t > As, const SGVector< float64_t > Bs)

void	set_num_classes (int32_t num_classes)

int32_t	get_num_classes () const

CRejectionStrategy *	get_rejection_strategy ()

void	set_rejection_strategy (CRejectionStrategy *rejection_strategy)

virtual void	train_stop ()

EProbHeuristicType	get_prob_heuris_type ()

void	set_prob_heuris_type (EProbHeuristicType prob_heuris)

virtual CSGObject *	shallow_copy () const

virtual CSGObject *	deep_copy () const

virtual bool	is_generic (EPrimitiveType *generic) const

template<class T >
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

template<>
void	set_generic ()

void	unset_generic ()

virtual void	print_serializable (const char *prefix="")

virtual bool	save_serializable (CSerializableFile file, const char prefix="")

virtual bool	load_serializable (CSerializableFile file, const char prefix="")

void	set_global_io (SGIO *io)

SGIO *	get_global_io ()

void	set_global_parallel (Parallel *parallel)

Parallel *	get_global_parallel ()

void	set_global_version (Version *version)

Version *	get_global_version ()

SGStringList< char >	get_modelsel_names ()

void	print_modsel_params ()

char *	get_modsel_param_descr (const char *param_name)

index_t	get_modsel_param_index (const char *param_name)

void	build_gradient_parameter_dictionary (CMap< TParameter , CSGObject > *dict)

virtual void	update_parameter_hash ()

virtual bool	parameter_hash_changed ()

virtual bool	equals (CSGObject *other, float64_t accuracy=0.0, bool tolerant=false)

virtual CSGObject *	clone ()

Public 属性
SGIO *	io

Parallel *	parallel

Version *	version

Parameter *	m_parameters

Parameter *	m_model_selection_parameters

Parameter *	m_gradient_parameters

uint32_t	m_hash

Protected 成员函数
void	rescale_heuris_norm (SGVector< float64_t > outputs)

void	rescale_heuris_softmax (SGVector< float64_t > outputs, const SGVector< float64_t > As, const SGVector< float64_t > Bs)

virtual void	load_serializable_pre () throw (ShogunException)

virtual void	load_serializable_post () throw (ShogunException)

virtual void	save_serializable_pre () throw (ShogunException)

virtual void	save_serializable_post () throw (ShogunException)

Protected 属性
CRejectionStrategy *	m_rejection_strategy
	rejection strategy 更多...

CBinaryLabels *	m_train_labels
	labels used to train the submachines 更多...

CMulticlassLabels *	m_orig_labels
	original multiclass labels 更多...

int32_t	m_train_iter
	index of current iterations 更多...

int32_t	m_num_classes
	number of classes in this problem 更多...

EProbHeuristicType	m_prob_heuris
	prob output heuristic 更多...

构造及析构函数说明

CMulticlassOneVsRestStrategy ( )

constructor

在文件 MulticlassOneVsRestStrategy.cpp 第 18 行定义.

CMulticlassOneVsRestStrategy ( EProbHeuristicType prob_heuris )

constructor

参数

prob_heuris probability estimation heuristic

在文件 MulticlassOneVsRestStrategy.cpp 第 23 行定义.

virtual ~CMulticlassOneVsRestStrategy ( )

virtual

destructor

在文件 MulticlassOneVsRestStrategy.h 第 45 行定义.

成员函数说明

void build_gradient_parameter_dictionary ( CMap< TParameter *, CSGObject * > * dict )

inherited

Builds a dictionary of all parameters in SGObject as well of those of SGObjects that are parameters of this object. Dictionary maps parameters to the objects that own them.

参数

dict	dictionary of parameters to be built.

在文件 SGObject.cpp 第 597 行定义.

CSGObject * clone ( )

virtualinherited

Creates a clone of the current object. This is done via recursively traversing all parameters, which corresponds to a deep copy. Calling equals on the cloned object always returns true although none of the memory of both objects overlaps.

返回: an identical copy of the given object, which is disjoint in memory. NULL if the clone fails. Note that the returned object is SG_REF'ed

在文件 SGObject.cpp 第 714 行定义.

int32_t decide_label ( SGVector< float64_t > outputs )

virtual

decide the final label.

参数

outputs a vector of output from each machine (in that order)

实现了 CMulticlassStrategy.

在文件 MulticlassOneVsRestStrategy.cpp 第 44 行定义.

SGVector< index_t > decide_label_multiple_output	(	SGVector< float64_t >	outputs,
		int32_t	n_outputs
	)

virtual

decide the final label.

参数

outputs	a vector of output from each machine (in that order)
n_outputs	number of outputs

重载 CMulticlassStrategy .

在文件 MulticlassOneVsRestStrategy.cpp 第 52 行定义.

CSGObject * deep_copy ( ) const

virtualinherited

A deep copy. All the instance variables will also be copied.

在文件 SGObject.cpp 第 198 行定义.

bool equals	(	CSGObject *	other,
		float64_t	accuracy = `0.0`,
		bool	tolerant = `false`
	)

virtualinherited

Recursively compares the current SGObject to another one. Compares all registered numerical parameters, recursion upon complex (SGObject) parameters. Does not compare pointers!

May be overwritten but please do with care! Should not be necessary in most cases.

参数

other	object to compare with
accuracy	accuracy to use for comparison (optional)
tolerant	allows linient check on float equality (within accuracy)

返回: true if all parameters were equal, false if not

在文件 SGObject.cpp 第 618 行定义.

SGIO * get_global_io ( )

inherited

get the io object

返回: io object

在文件 SGObject.cpp 第 235 行定义.

Parallel * get_global_parallel ( )

inherited

get the parallel object

返回: parallel object

在文件 SGObject.cpp 第 277 行定义.

Version * get_global_version ( )

inherited

get the version object

返回: version object

在文件 SGObject.cpp 第 290 行定义.

SGStringList< char > get_modelsel_names ( )

inherited

返回: vector of names of all parameters which are registered for model selection

在文件 SGObject.cpp 第 498 行定义.

char * get_modsel_param_descr ( const char * param_name )

inherited

Returns description of a given parameter string, if it exists. SG_ERROR otherwise

参数

param_name name of the parameter

返回: description of the parameter

在文件 SGObject.cpp 第 522 行定义.

index_t get_modsel_param_index ( const char * param_name )

inherited

Returns index of model selection parameter with provided index

参数

param_name name of model selection parameter

返回: index of model selection parameter with provided name, -1 if there is no such

在文件 SGObject.cpp 第 535 行定义.

virtual const char* get_name ( ) const

virtual

get name

重载 CMulticlassStrategy .

在文件 MulticlassOneVsRestStrategy.h 第 83 行定义.

int32_t get_num_classes ( ) const

inherited

get number of classes

在文件 MulticlassStrategy.h 第 76 行定义.

virtual int32_t get_num_machines ( )

virtual

get number of machines used in this strategy.

实现了 CMulticlassStrategy.

在文件 MulticlassOneVsRestStrategy.h 第 77 行定义.

EProbHeuristicType get_prob_heuris_type ( )

inherited

get prob output heuristic type

在文件 MulticlassStrategy.h 第 130 行定义.

CRejectionStrategy* get_rejection_strategy ( )

inherited

get rejection strategy

在文件 MulticlassStrategy.h 第 82 行定义.

bool is_generic ( EPrimitiveType * generic ) const

virtualinherited

If the SGSerializable is a class template then TRUE will be returned and GENERIC is set to the type of the generic.

参数

generic set to the type of the generic if returning TRUE

返回: TRUE if a class template.

在文件 SGObject.cpp 第 296 行定义.

bool load_serializable	(	CSerializableFile *	file,
		const char *	prefix = `""`
	)

virtualinherited

Load this object from file. If it will fail (returning FALSE) then this object will contain inconsistent data and should not be used!

参数

file	where to load from
prefix	prefix for members

返回: TRUE if done, otherwise FALSE

在文件 SGObject.cpp 第 369 行定义.

void load_serializable_post	(		)
throw	(	ShogunException
	)

protectedvirtualinherited

Can (optionally) be overridden to post-initialize some member variables which are not PARAMETER::ADD'ed. Make sure that at first the overridden method BASE_CLASS::LOAD_SERIALIZABLE_POST is called.

异常

ShogunException will be thrown if an error occurs.

被 CKernel, CWeightedDegreePositionStringKernel, CList, CAlphabet, CLinearHMM, CGaussianKernel, CInverseMultiQuadricKernel, CCircularKernel , 以及 CExponentialKernel 重载.

在文件 SGObject.cpp 第 426 行定义.

void load_serializable_pre	(		)
throw	(	ShogunException
	)

protectedvirtualinherited

Can (optionally) be overridden to pre-initialize some member variables which are not PARAMETER::ADD'ed. Make sure that at first the overridden method BASE_CLASS::LOAD_SERIALIZABLE_PRE is called.

异常

ShogunException will be thrown if an error occurs.

被 CDynamicArray< T >, CDynamicArray< float64_t >, CDynamicArray< float32_t >, CDynamicArray< int32_t >, CDynamicArray< char >, CDynamicArray< bool > , 以及 CDynamicObjectArray 重载.

在文件 SGObject.cpp 第 421 行定义.

bool parameter_hash_changed ( )

virtualinherited

返回: whether parameter combination has changed since last update

在文件 SGObject.cpp 第 262 行定义.

void print_modsel_params ( )

inherited

prints all parameter registered for model selection and their type

在文件 SGObject.cpp 第 474 行定义.

void print_serializable ( const char * prefix = "" )

virtualinherited

prints registered parameters out

参数

prefix prefix for members

在文件 SGObject.cpp 第 308 行定义.

void rescale_heuris_norm ( SGVector< float64_t > outputs )

protected

OVA normalization heuristic

参数

outputs a vector of output from each machine (in that order)

在文件 MulticlassOneVsRestStrategy.cpp 第 97 行定义.

void rescale_heuris_softmax	(	SGVector< float64_t >	outputs,
		const SGVector< float64_t >	As,
		const SGVector< float64_t >	Bs
	)

protected

OVA softmax heuristic

参数

outputs	a vector of output from each machine (in that order)
As	fitted sigmoid parameters a one for each machine
Bs	fitted sigmoid parameters b one for each machine

在文件 MulticlassOneVsRestStrategy.cpp 第 111 行定义.

void rescale_outputs ( SGVector< float64_t > outputs )

virtual

rescale multiclass outputs according to the selected heuristic

参数

outputs a vector of output from each machine (in that order)

重载 CMulticlassStrategy .

在文件 MulticlassOneVsRestStrategy.cpp 第 70 行定义.

void rescale_outputs	(	SGVector< float64_t >	outputs,
		const SGVector< float64_t >	As,
		const SGVector< float64_t >	Bs
	)

virtual

rescale multiclass outputs according to the selected heuristic this function only being called with OVA_SOFTMAX heuristic

参数

outputs	a vector of output from each machine (in that order)
As	fitted sigmoid parameters a one for each machine
Bs	fitted sigmoid parameters b one for each machine

重载 CMulticlassStrategy .

在文件 MulticlassOneVsRestStrategy.cpp 第 88 行定义.

bool save_serializable	(	CSerializableFile *	file,
		const char *	prefix = `""`
	)

virtualinherited

Save this object to file.

参数

file	where to save the object; will be closed during returning if PREFIX is an empty string.
prefix	prefix for members

返回: TRUE if done, otherwise FALSE

在文件 SGObject.cpp 第 314 行定义.

void save_serializable_post	(		)
throw	(	ShogunException
	)

protectedvirtualinherited

Can (optionally) be overridden to post-initialize some member variables which are not PARAMETER::ADD'ed. Make sure that at first the overridden method BASE_CLASS::SAVE_SERIALIZABLE_POST is called.

异常

ShogunException will be thrown if an error occurs.

被 CKernel 重载.

在文件 SGObject.cpp 第 436 行定义.

void save_serializable_pre	(		)
throw	(	ShogunException
	)

protectedvirtualinherited

Can (optionally) be overridden to pre-initialize some member variables which are not PARAMETER::ADD'ed. Make sure that at first the overridden method BASE_CLASS::SAVE_SERIALIZABLE_PRE is called.

异常

ShogunException will be thrown if an error occurs.

被 CKernel, CDynamicArray< T >, CDynamicArray< float64_t >, CDynamicArray< float32_t >, CDynamicArray< int32_t >, CDynamicArray< char >, CDynamicArray< bool > , 以及 CDynamicObjectArray 重载.

在文件 SGObject.cpp 第 431 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 41 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 46 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 51 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 56 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 61 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 66 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 71 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 76 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 81 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 86 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 91 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 96 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 101 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 106 行定义.

void set_generic ( )

inherited

在文件 SGObject.cpp 第 111 行定义.

void set_generic ( )

inherited

set generic type to T

void set_global_io ( SGIO * io )

inherited

set the io object

参数

io	io object to use

在文件 SGObject.cpp 第 228 行定义.

void set_global_parallel ( Parallel * parallel )

inherited

set the parallel object

参数

parallel parallel object to use

在文件 SGObject.cpp 第 241 行定义.

void set_global_version ( Version * version )

inherited

set the version object

参数

version version object to use

在文件 SGObject.cpp 第 283 行定义.

void set_num_classes ( int32_t num_classes )

inherited

set number of classes

在文件 MulticlassStrategy.h 第 70 行定义.

void set_prob_heuris_type ( EProbHeuristicType prob_heuris )

inherited

set prob output heuristic type

参数

prob_heuris type of probability heuristic

在文件 MulticlassStrategy.h 第 138 行定义.

void set_rejection_strategy ( CRejectionStrategy * rejection_strategy )

inherited

set rejection strategy

在文件 MulticlassStrategy.h 第 89 行定义.

CSGObject * shallow_copy ( ) const

virtualinherited

A shallow copy. All the SGObject instance variables will be simply assigned and SG_REF-ed.

被 CGaussianKernel 重载.

在文件 SGObject.cpp 第 192 行定义.

virtual bool train_has_more ( )

virtual

has more training phase

实现了 CMulticlassStrategy.

在文件 MulticlassOneVsRestStrategy.h 第 54 行定义.

SGVector< int32_t > train_prepare_next ( )

virtual

prepare for the next training phase.

返回: NULL, since no subset is needed in one-vs-rest strategy

重载 CMulticlassStrategy .

在文件 MulticlassOneVsRestStrategy.cpp 第 28 行定义.

virtual void train_start	(	CMulticlassLabels *	orig_labels,
		CBinaryLabels *	train_labels
	)

virtual

start training

重载 CMulticlassStrategy .

在文件 MulticlassOneVsRestStrategy.h 第 48 行定义.

void train_stop ( )

virtualinherited

finish training, release resources

在文件 MulticlassStrategy.cpp 第 63 行定义.

void unset_generic ( )

inherited

unset generic type

this has to be called in classes specializing a template class

在文件 SGObject.cpp 第 303 行定义.

void update_parameter_hash ( )

virtualinherited

Updates the hash of current parameter combination

在文件 SGObject.cpp 第 248 行定义.

类成员变量说明

SGIO* io

inherited

io

在文件 SGObject.h 第 369 行定义.

Parameter* m_gradient_parameters

inherited

parameters wrt which we can compute gradients

在文件 SGObject.h 第 384 行定义.

uint32_t m_hash

inherited

Hash of parameter values

在文件 SGObject.h 第 387 行定义.

Parameter* m_model_selection_parameters

inherited

model selection parameters

在文件 SGObject.h 第 381 行定义.

int32_t m_num_classes

protectedinherited

number of classes in this problem

在文件 MulticlassStrategy.h 第 176 行定义.

CMulticlassLabels* m_orig_labels

protectedinherited

original multiclass labels

在文件 MulticlassStrategy.h 第 174 行定义.

Parameter* m_parameters

inherited

parameters

在文件 SGObject.h 第 378 行定义.

EProbHeuristicType m_prob_heuris

protectedinherited

prob output heuristic

在文件 MulticlassStrategy.h 第 177 行定义.

CRejectionStrategy* m_rejection_strategy

protectedinherited

rejection strategy

在文件 MulticlassStrategy.h 第 172 行定义.

int32_t m_train_iter

protectedinherited

index of current iterations

在文件 MulticlassStrategy.h 第 175 行定义.

CBinaryLabels* m_train_labels

protectedinherited

labels used to train the submachines

在文件 MulticlassStrategy.h 第 173 行定义.

Parallel* parallel

inherited

parallel

在文件 SGObject.h 第 372 行定义.

Version* version

inherited

version

在文件 SGObject.h 第 375 行定义.

该类的文档由以下文件生成:

详细描述

Public 成员函数

Public 属性

Protected 成员函数

Protected 属性

构造及析构函数说明

成员函数说明

类成员变量说明