dokimos-dev/dokimos
πͺMarketplacedokimos-dev/dokimos
Add this Marketplace
/plugin marketplace add dokimos-dev/dokimosLLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
Plugins in this Marketplace
create-dataset
scaffoldingCreate evaluation datasets in JSON, CSV, or JSONL format for Dokimos
create-evaluator
scaffoldingScaffold a new Evaluator implementation following Dokimos conventions
create-experiment
scaffoldingScaffold a Dokimos Experiment with dataset, task, evaluators, and reporter
create-tests
scaffoldingScaffold eval-driven tests using dokimos-junit with @DatasetSource and Assertions.assertEval()
evaluate-agent
integrationSet up evaluation of AI agents with tool call validation, correctness checks, and task completion using Dokimos
evaluate-embabel
integrationSet up evaluation of Embabel agents using Dokimos
evaluate-koog
integrationSet up evaluation of Koog AI agents using Dokimos
evaluate-langchain4j
integrationSet up evaluation of LangChain4j applications and RAG pipelines using Dokimos
evaluate-openai
integrationSet up evaluation of an OpenAI Java SDK tool-calling agent using Dokimos
evaluate-spring-ai
integrationSet up evaluation of Spring AI applications using Dokimos
evaluate-spring-ai-alibaba
integrationSet up evaluation of Spring AI Alibaba graph agents using Dokimos