grammar from string

[adrid]

Regarding this comment:

grammar is not passed as string to be parsed, instead parsed llama_grammar* params, as at time of writing grammar_parser has no C api

Is there is any plan to support this? What do you think about creating simple cpp binding for this like that?

extern "C" llama_grammar * parseGrammar(const char * str) {
    grammar_parser::parse_state parsed_state = grammar_parser::parse(str);
    std::vector<const llama_grammar_element *> grammar_rules(parsed_state.c_rules());

    return llama_grammar_init(grammar_rules.data(), grammar_rules.size(), parsed_state.symbol_ids.at("root"));
}

I've tested this and after accept the token with grammar option it seems to work. I would prepare a draft if you think binding would be fine and we could check this in detail.

[Deins]

I think that makes sense. I haven't looked into grammars yet. But for direct usage I think that should be enough. Would not mind merging it. Feel free to adjust anything as needed.
FYI: The simplified 'Prompt' utility might or might not work. But as its still WIP, might not be worth worrying about.