Package org.carrot2.text.vsm

Class VectorSpaceModelContext

java.lang.Object

org.carrot2.text.vsm.VectorSpaceModelContext

public class VectorSpaceModelContext
extends Object

Stores data related to the Vector Space Model of the processed documents.

Field Summary

Fields

Modifier and Type	Field	Description
PreprocessingContext	preprocessingContext	Preprocessing context for the underlying documents.
com.carrotsearch.hppc.IntIntHashMap	stemToRowIndex	Stem index to row index mapping for the tdMatrix.
org.carrot2.math.mahout.matrix.DoubleMatrix2D	termDocumentMatrix	Term-document matrix.
org.carrot2.math.mahout.matrix.DoubleMatrix2D	termPhraseMatrix	Term-document-like matrix for phrases from PreprocessingContext.AllLabels.

Constructor Summary

Constructors

Constructor	Description
VectorSpaceModelContext(PreprocessingContext preprocessingContext)	Creates a vector space model context with the provided preprocessing context.

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

preprocessingContext

public final PreprocessingContext preprocessingContext

Preprocessing context for the underlying documents.

termDocumentMatrix

public org.carrot2.math.mahout.matrix.DoubleMatrix2D termDocumentMatrix

Term-document matrix. Rows of the matrix correspond to word stems, columns correspond to the processed documents. For mapping between rows of this matrix and PreprocessingContext.AllStems, see stemToRowIndex.

This matrix is produced by TermDocumentMatrixBuilder.buildTermDocumentMatrix(VectorSpaceModelContext).

termPhraseMatrix

public org.carrot2.math.mahout.matrix.DoubleMatrix2D termPhraseMatrix

Term-document-like matrix for phrases from PreprocessingContext.AllLabels. If there are no phrases in PreprocessingContext.AllLabels, phrase matrix is null. For mapping between rows of this matrix and PreprocessingContext.AllStems, see stemToRowIndex.

This matrix is produced by TermDocumentMatrixBuilder.buildTermPhraseMatrix(VectorSpaceModelContext).

stemToRowIndex

public com.carrotsearch.hppc.IntIntHashMap stemToRowIndex

Stem index to row index mapping for the tdMatrix. Keys in this map are indices of entries in PreprocessingContext.AllStems arrays, values are the indices of tdMatrix rows corresponding to the stems. Please note that depending on the limit on the size of the matrix, some stems may not have their corresponding matrix rows.

This object is produced by TermDocumentMatrixBuilder.buildTermDocumentMatrix(VectorSpaceModelContext).

Constructor Details

VectorSpaceModelContext

public VectorSpaceModelContext(PreprocessingContext preprocessingContext)

Creates a vector space model context with the provided preprocessing context.