### Run XML tokenizer with an example XML file

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Execute the simple_xml_tokenizer.rs script using cargo-script, redirecting content from example.xml to stdin.

```bash
cargo script simple_xml_tokenizer.rs < example.xml
```

--------------------------------

### Install cargo-script

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Install cargo-script, a tool for running Rust scripts, using cargo.

```bash
cargo install cargo-script
```

--------------------------------

### Main function for XML Tokenizer Example

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Set up the SimpleTokenPrinter, read input from stdin into a ByteTendril, reinterpret it as StrTendril, and tokenize it using XmlTokenizer.

```rust
fn main() {
    let sink = SimpleTokenPrinter;

    // We need a ByteTendril to read a file
    let mut input = ByteTendril::new();
    // Using SliceExt.read_to_tendril we read stdin
    io::stdin().read_to_tendril(&mut input).unwrap();
    // For xml5ever we need StrTendril, so we reinterpret it
    // into StrTendril.
    //
    // You might wonder, how does `try_reinterpret` know we
    // need StrTendril and the answer is type inference based
    // on `tokenize_xml_to` signature.
    let input = input.try_reinterpret().unwrap();
    // Here we create and run tokenizer
    let mut tok = XmlTokenizer::new(sink, Default::default());
    // We pass input to parsed.
    tok.feed(input);

    // tok.end must be invoked for final bytes to be processed.
    tok.end();
}
```

--------------------------------

### Unhelpful Macro Error

Source: https://github.com/servo/html5ever/wiki/Debugging-tips

Example of an unhelpful error message produced by procedural macros.

```rust
<quote expansion>:3:50: 3:70 error: mismatched types: expected `&<generic #672>` but found `tree_builder::types::Token` (expected &-ptr but found
             enum tree_builder::types::Token)
<quote expansion>:3         ^@name_1,ctxt_6643^@.^@name_1274,ctxt_6643^@(^@name_479,ctxt_6643^@);
```

--------------------------------

### Building and Testing xml5ever

Source: https://github.com/servo/html5ever/blob/main/xml5ever/README.md

Instructions for setting up the development environment for xml5ever, including fetching submodules and running tests.

```rust
git submodule update --init # to fetch xml5lib-tests
cargo build
cargo test
```

--------------------------------

### Build Local Documentation

Source: https://github.com/servo/html5ever/blob/main/README.md

Build local documentation for html5ever using Cargo.

```bash
cargo doc
```

--------------------------------

### Add xml5ever and tendril dependencies

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Declare the necessary dependencies for xml5ever and tendril in your Cargo.toml file.

```toml
[dependencies]
xml5ever = "0.2.0"
tendril = "0.1.3"
```

--------------------------------

### Basic XML Parsing with RcDom

Source: https://github.com/servo/html5ever/blob/main/xml5ever/README.md

Demonstrates how to parse a simple XML string into an RcDom tree using the `parse` function. Requires the `tendril` crate for input handling.

```rust
use xml5ever::parse_document, xml5ever::rcdom::RcDom;
use tendril::StrTendril;

let input = "<xml></xml>".to_tendril();

// To parse XML into a tree form, we need a TreeSink
// luckily xml5ever comes with a static RC backed tree represetation.
let dom: RcDom = parse_document(std::iter::once(input), Default::default()).one();

// Do something with dom

```

--------------------------------

### Run XML tokenizer with inline XML

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Execute the simple_xml_tokenizer.rs script using cargo-script, providing XML content directly via stdin.

```bash
cargo script simple_xml_tokenizer.rs <<< "<xml>Text with <b>bold words</b>!</xml>"
```

--------------------------------

### Update Git Submodules

Source: https://github.com/servo/html5ever/blob/main/README.md

Fetch the test suite for html5ever by updating git submodules.

```bash
git submodule update --init
```

--------------------------------

### Implement TokenSink for SimpleTokenPrinter

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Implement the process_token method for SimpleTokenPrinter to handle different token types from the xml5ever tokenizer.

```rust
impl TokenSink for SimpleTokenPrinter {
    fn process_token(&mut self, token: Token) {
        match token {
            CharacterTokens(b) => {
                println!("TEXT: {}", &*b);
            },
            NullCharacterToken => print!("NULL"),
            TagToken(tag) => {
                println!("{:?} {} ", tag.kind, &*tag.name.local);
            },
            ParseError(err) => {
                println!("ERROR: {}", err);
            },
            PIToken(Pi{ref target, ref data}) => {
                println!("PI : <?{} {}?>", &*target, &*data);
            },
            CommentToken(ref comment) => {
                println!("<!--{:?}-->", &*comment);
            },
            EOFToken => {
                println!("EOF");
            },
            DoctypeToken(Doctype{ref name, ref public_id, ..}) => {
                println!("<!DOCTYPE {:?} {:?}>", &*name, &*public_id);
            }
        }
    }
}
```

--------------------------------

### Reading Input to ByteTendril

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

This snippet demonstrates how to allocate an input tendril and read data from standard input into it using `ByteTendril` and `SliceExt.read_to_tendril`.

```rust
    // We need to allocate an input tendril for xml5ever
    let mut input = ByteTendril::new();
    // Using SliceExt.read_to_tendril functions we can read stdin
    io::stdin().read_to_tendril(&mut input).unwrap();
    let input = input.try_reinterpret().unwrap();
```

--------------------------------

### Add html5ever Dependency

Source: https://github.com/servo/html5ever/blob/main/README.md

Add html5ever as a dependency to your Rust project using Cargo.

```bash
cargo add html5ever
```

--------------------------------

### Add xml5ever Dependency

Source: https://github.com/servo/html5ever/blob/main/xml5ever/README.md

Use this command to add the xml5ever crate to your Rust project's dependencies.

```bash
cargo add xml5ever
```

--------------------------------

### Define a SimpleTokenPrinter struct

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

Define a unit struct that will act as a TokenSink for the xml5ever tokenizer.

```rust
struct SimpleTokenPrinter;
```

--------------------------------

### Parsing Input into RcDom

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

This code shows how to parse the input tendril into an `RcDom` structure, which is a built-in `TreeSink` implementation provided by xml5ever. The `one_input` function converts the input into an iterator, and `Default::default()` provides default parsing options.

```rust
    let dom: RcDom = parse(one_input(input), Default::default());
```

--------------------------------

### Improved Macro Error with --pretty expanded

Source: https://github.com/servo/html5ever/wiki/Debugging-tips

More helpful error message obtained after compiling with `rustc --pretty expanded`.

```rust
foo.rs:21253:57: 21253:62 error: mismatched types: expected `&<generic #672>` but found `tree_builder::types::Token` (expected &-ptr but found enum tree_builder::types::Token)
foo.rs:21253                                         self.unexpected(token);
```

--------------------------------

### Recursive Tree Traversal Function

Source: https://github.com/servo/html5ever/blob/main/xml5ever/examples/README.md

This function recursively traverses the XML document tree. It prints the node type (Document, Text, or Element) with appropriate indentation. It filters children to only process Text and Element nodes, ensuring clean indentation.

```rust
    fn walk(prefix: &str, handle: Handle) {
        let node = handle.borrow();

        // We print out the prefix before we start
        print!("{}", prefix);
        // We are only interested in following nodes:
        // Document, Text and Element, so our match
        // reflects that.
        match node.node {
            Document
                => println!("#document"),

            Text(ref text)  => {
                println!("#text {}", text.escape_default())
            },

            Element(ref name, _) => {
                println!("{}", name.local);
            },

            _ => {},

        }

        // We increase indent in child nodes
        let new_indent = {
            let mut temp = String::new();
            temp.push_str(prefix);
            temp.push_str("    ");
            temp
        };

        for child in node.children.iter()
            // In order to avoid weird indentation, we filter
            // only Text/Element nodes.
            // We don't need to filter Document since its guaranteed
            // child elements don't contain documents
            .filter(|child| match child.borrow().node {
                Text(_) | Element (_, _) => true,
                _ => false,
            }
        ) {
            // Recursion - Yay!
            walk(&new_indent, child.clone());
        }
    }
```

=== COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.