php-tokenizer

Here are 3 public repositories matching this topic...

lionsoul2014 / friso

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other programs, like: MySQL, PostgreSQL, PHP, etc.

c tokenizer full-text-search chinese-word-segmentation chinese-tokenizer php-tokenizer korean-tokenizer japanese-tokenizer cjk-tokenizer

Updated Oct 29, 2023
C

soiqualang / php_token

Star

php_token

php-tokenizer

Updated May 6, 2019
PHP

baygin / php-simple-lexer

Star

The Lexer layer of Compiler/Interpreter

interpreter tokenizer lexer php-interpreter php-tokenizer php-programming-language php-lexer interpreter-basic

Updated Sep 12, 2022
PHP

Add this topic to your repo

To associate your repository with the php-tokenizer topic, visit your repo's landing page and select "manage topics."

Learn more