Module org.apache.lucene.analysis.nori

Package org.apache.lucene.analysis.ko.dict

Class BinaryDictionary

java.lang.Object

org.apache.lucene.analysis.ko.dict.BinaryDictionary

All Implemented Interfaces:

Dictionary

Direct Known Subclasses:

TokenInfoDictionary, UnknownDictionary

public abstract class BinaryDictionary
extends Object
implements Dictionary

Base class for a binary-encoded in-memory dictionary.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	BinaryDictionary.ResourceScheme	Deprecated, for removal: This API element is subject to removal in a future version.

Nested classes/interfaces inherited from interface org.apache.lucene.analysis.ko.dict.Dictionary

Dictionary.Morpheme

Field Summary

Fields

Modifier and Type	Field	Description
private final ByteBuffer	buffer
static final String	DICT_FILENAME_SUFFIX
static final String	DICT_HEADER
static final int	HAS_READING	flag that the entry has reading data.
static final int	HAS_SINGLE_POS	flag that the entry has a single part of speech (leftPOS)
private final POS.Tag[]	posDict
static final String	POSDICT_FILENAME_SUFFIX
static final String	POSDICT_HEADER
private final int[]	targetMap
static final String	TARGETMAP_FILENAME_SUFFIX
static final String	TARGETMAP_HEADER
private final int[]	targetMapOffsets
static final int	VERSION

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BinaryDictionary(IOSupplier<InputStream> targetMapResource, IOSupplier<InputStream> posResource, IOSupplier<InputStream> dictResource)

Method Summary

Modifier and Type	Method	Description
int	getLeftId(int wordId)	Get left id of specified word
POS.Tag	getLeftPOS(int wordId)	Get the left POS.Tag of specfied word.
Dictionary.Morpheme[]	getMorphemes(int wordId, char[] surfaceForm, int off, int len)	Get the morphemes of specified word (e.g.
POS.Type	getPOSType(int wordId)	Get the POS.Type of specified word (morpheme, compound, inflect or pre-analysis)
String	getReading(int wordId)	Get the reading of specified word (mainly used for Hanja to Hangul conversion).
static final InputStream	getResource(BinaryDictionary.ResourceScheme scheme, String path)	Deprecated, for removal: This API element is subject to removal in a future version.
int	getRightId(int wordId)	Get right id of specified word
POS.Tag	getRightPOS(int wordId)	Get the right POS.Tag of specfied word.
int	getWordCost(int wordId)	Get word cost of specified word
private boolean	hasReadingData(int wordId)
private boolean	hasSinglePOS(int wordId)
void	lookupWordIds(int sourceId, IntsRef ref)
private static void	populateTargetMap(DataInput in, int[] targetMap, int[] targetMapOffsets)
private String	readString(int offset)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

TARGETMAP_FILENAME_SUFFIX

public static final String TARGETMAP_FILENAME_SUFFIX

See Also:

• Constant Field Values

DICT_FILENAME_SUFFIX

public static final String DICT_FILENAME_SUFFIX

See Also:

• Constant Field Values

POSDICT_FILENAME_SUFFIX

public static final String POSDICT_FILENAME_SUFFIX

See Also:

• Constant Field Values

DICT_HEADER

public static final String DICT_HEADER

See Also:

• Constant Field Values

TARGETMAP_HEADER

public static final String TARGETMAP_HEADER

See Also:

• Constant Field Values

POSDICT_HEADER

public static final String POSDICT_HEADER

See Also:

• Constant Field Values

VERSION

public static final int VERSION

See Also:

• Constant Field Values

buffer

private final ByteBuffer buffer

targetMapOffsets

private final int[] targetMapOffsets

targetMap

private final int[] targetMap

posDict

private final POS.Tag[] posDict

HAS_SINGLE_POS

public static final int HAS_SINGLE_POS

flag that the entry has a single part of speech (leftPOS)

See Also:

• Constant Field Values

HAS_READING

public static final int HAS_READING

flag that the entry has reading data. otherwise reading is surface form

See Also:

• Constant Field Values

Constructor Details

BinaryDictionary

protected BinaryDictionary(IOSupplier<InputStream> targetMapResource,
 IOSupplier<InputStream> posResource,
 IOSupplier<InputStream> dictResource)
                    throws IOException

Throws:

IOException

Method Details

populateTargetMap

private static void populateTargetMap(DataInput in,
 int[] targetMap,
 int[] targetMapOffsets)
                               throws IOException

Throws:

IOException

getResource

@Deprecated(forRemoval=true,
            since="9.1")
public static final InputStream getResource(BinaryDictionary.ResourceScheme scheme,
 String path)
                                     throws IOException

Deprecated, for removal: This API element is subject to removal in a future version.

Throws:

IOException

lookupWordIds

public void lookupWordIds(int sourceId,
 IntsRef ref)

getLeftId

public int getLeftId(int wordId)

Description copied from interface: Dictionary

Get left id of specified word

Specified by:

getLeftId in interface Dictionary

getRightId

public int getRightId(int wordId)

Description copied from interface: Dictionary

Get right id of specified word

Specified by:

getRightId in interface Dictionary

getWordCost

public int getWordCost(int wordId)

Description copied from interface: Dictionary

Get word cost of specified word

Specified by:

getWordCost in interface Dictionary

getPOSType

public POS.Type getPOSType(int wordId)

Description copied from interface: Dictionary

Get the POS.Type of specified word (morpheme, compound, inflect or pre-analysis)

Specified by:

getPOSType in interface Dictionary

getLeftPOS

public POS.Tag getLeftPOS(int wordId)

Description copied from interface: Dictionary

Get the left POS.Tag of specfied word.

For POS.Type.MORPHEME and POS.Type.COMPOUND the left and right POS are the same.

Specified by:

getLeftPOS in interface Dictionary

getRightPOS

public POS.Tag getRightPOS(int wordId)

Description copied from interface: Dictionary

Get the right POS.Tag of specfied word.

For POS.Type.MORPHEME and POS.Type.COMPOUND the left and right POS are the same.

Specified by:

getRightPOS in interface Dictionary

getReading

public String getReading(int wordId)

Description copied from interface: Dictionary

Get the reading of specified word (mainly used for Hanja to Hangul conversion).

Specified by:

getReading in interface Dictionary

getMorphemes

public Dictionary.Morpheme[] getMorphemes(int wordId,
 char[] surfaceForm,
 int off,
 int len)

Description copied from interface: Dictionary

Get the morphemes of specified word (e.g. 가깝으나: 가깝 + 으나).

Specified by:

getMorphemes in interface Dictionary

readString

private String readString(int offset)

hasSinglePOS

private boolean hasSinglePOS(int wordId)

hasReadingData

private boolean hasReadingData(int wordId)