Token class for the Finder indexer package.
Located in /administrator/components/com_finder/helpers/indexer/token.php (line 19)
If the token is a common term, the weight is adjusted to compensate for the higher frequency of the term in relation to other terms.
The simple language identifier for the token.
The length is used to calculate the weight of the token.
If the token is numeric, it is likely to be short and uncommon so the weight is adjusted to compensate for that situation.
Flag for phrase tokens.
The stem is used to match the root term and produce more potential matches when searching the index.
This is the term that will be referenced in the terms table and the mapping tables.
The weight is calculated based on token size and whether the token is considered a common term.
Documentation generated on Tue, 19 Nov 2013 15:15:48 +0100 by phpDocumentor 1.4.3