开发者

sqlite-fts3: custom tokenizer?

开发者 https://www.devze.com 2023-01-15 16:49 出处:网络
Does anyone here have experience with writing custom FT开发者_开发问答S3 (the full-text-search extension) tokenizers? I\'m looking for a tokenizer that will ignore HTML tags.

Does anyone here have experience with writing custom FT开发者_开发问答S3 (the full-text-search extension) tokenizers? I'm looking for a tokenizer that will ignore HTML tags.

Thanks.


I have no direct experience, but by doing a web search with "sqlite3 registerTokenizer" I found two tokenizers that can be used as a basis: a snowball tokenizer and a MeCab tokenizer.

0

精彩评论

暂无评论...
验证码 换一张
取 消