Module tokenizer
orinium_
browser
0.1.0
Module tokenizer
Module Items
Structs
Enums
In orinium_
browser::
engine::
html
orinium_browser
::
engine
::
html
Module
tokenizer
Copy item path
Source
Expand description
HTML tokenizer. Converts raw HTML input into token stream.
Structs
§
Attribute
Represents a single HTML attribute
Tokenizer
HTML tokenizer implementation
Enums
§
Token
HTML tokens emitted by the tokenizer
Tokenizer
State
Represents the internal state of the tokenizer