Skip to content

test - validate llamacpp cfg outputs#20

Open
lapp0 wants to merge 4 commits into
mainfrom
fix-796
Open

test - validate llamacpp cfg outputs#20
lapp0 wants to merge 4 commits into
mainfrom
fix-796

Conversation

@lapp0

@lapp0 lapp0 commented May 20, 2024

Copy link
Copy Markdown
Owner

No description provided.

@github-actions

github-actions Bot commented May 20, 2024

Copy link
Copy Markdown

Benchmark Suite Results:

Before [b5c69cc] After [8089fcc] Ratio Benchmark (Parameter)
180±0.9ms 184±3ms 1.02 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('simple_phone')
128±1ms 130±0.7ms 1.02 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('ssn')
4.55±0.01s 4.58±0.06s 1.01 bench_json_schema.JsonSchemaBenchmark.time_json_schema_to_fsm('complex_schema')
78.6±1μs 79.7±1μs 1.01 bench_json_schema.JsonSchemaBenchmark.time_json_schema_to_regex('complex_schema')
4.86±0.01s 4.91±0.03s 1.01 bench_numba_compile.NumbaCompileBenchmark.time_compile_numba
286±3ms 288±2ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('email')
240±5ms 242±2ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('ip')
620M 621M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('complex_span_constrained_relation_extraction')
528M 528M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('simple_phone')
623±4ms 626±2ms 1 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('complex_phone')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant