JuliaBench/LLMBenchMCPServer.jl
3.2
If you are the rightful owner of LLMBenchMCPServer.jl and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to dayong@mcphub.com.
LLMBenchMCPServer.jl is a Julia package that implements a Model Context Protocol (MCP) server for benchmarking language models.
Tools
Functions exposed to the LLM to take actions
setup_problem
Initialize a problem in the working directory
grade_problem
Grade a solution based on the transcript
bash
Execute bash commands (if included)
str_replace_editor
Edit files (if included)
Prompts
Interactive templates invoked by user choice
No prompts
Resources
Contextual data attached and managed by the client