bug: Should raise error for using custom dict with unsupported word tokenization engine

[new5558]

Description

Should raise an error when custom_dict is passed into word_tokenizer function but the selected engine is not supported custom_dict

Expected results

Should either:

1. Raise NotImplementedError if the user passed in custom_dict to unsupported tokenizer engines
   or
2. Raise a warning

Current results

The current code completely ignores custom dict behavior when its engine not supported

pythainlp/pythainlp/tokenize/core.py

Lines 228 to 235 in 3aa57c6

	elif engine == "newmm-safe":
	from pythainlp.tokenize.newmm import segment
	segments = segment(text, custom_dict, safe_mode=True)
	elif engine == "attacut":
	from pythainlp.tokenize.attacut import segment
	segments = segment(text)

Steps to reproduce

from pythainlp.tokenize import word_tokenize
from pythainlp.util import dict_trie


custom_dict = dict_trie(set(['tsts']))
word_tokenize('tstshel', custom_dict=custom_dict, engine = 'attacut')

PyThaiNLP version

Commit hash 3aa57c6

Python version

all

Operating system and version

all

More info

No response

Possible solution

No response

Files

No response