japanese-reranker-cross-encoder-small-v1
hotchpotch/japanese-reranker-cross-encoder-small-v1
A popular open reranker model, with 334.2K downloads a month. gigarouter benchmarks and hosts it as an OpenAI-compatible API.
about this model
Japanese Reranker Cross-Encoder (Small)
hotchpotch/japanese-reranker-cross-encoder-small-v1 is a cross-encoder (reranker) model trained on Japanese text. It accepts a query and a passage and outputs a relevance score, making it suitable for re-ranking candidate lists in retrieval pipelines.
Key Strengths
- 12 transformer layers with a hidden size of 384 – a balance of performance and inference speed.
- Part of a family of Japanese rerankers (xsmall, small, base, large, and a BGE-based variant) allowing users to scale model size as needed.
- Trained on Japanese data; outperforms general multilingual rerankers across multiple Japanese benchmarks.
Best For
- Re-ranking search results or retrieval outputs in Japanese-language applications.
- Scenarios where a lightweight model reduces latency without sacrificing ranking quality.
Benchmark Results
The following table reports normalized discounted cumulative gain (nDCG@10) on standard Japanese IR datasets. For comparison, results from other popular rerankers and baselines are included.
| Model | JQaRA | JaCWIR | MIRACL (ja) | JSQuAD |
|---|---|---|---|---|
| japanese-reranker-cross-encoder-small-v1 | 0.6247 | 0.939 | 0.7776 | 0.9604 |
| japanese-reranker-cross-encoder-xsmall-v1 | 0.6136 | 0.9376 | 0.7411 | 0.9602 |
| japanese-reranker-cross-encoder-base-v1 | 0.6711 | 0.9337 | 0.818 | 0.9708 |
| japanese-reranker-cross-encoder-large-v1 | 0.7099 | 0.9364 | 0.8406 | 0.9773 |
| japanese-bge-reranker-v2-m3-v1 | 0.6918 | 0.9372 | 0.8423 | 0.9624 |
| bge-reranker-v2-m3 | 0.673 | 0.9343 | 0.8374 | 0.9599 |
| bge-reranker-large | 0.4718 | 0.7332 | 0.7666 | 0.7081 |
| bge-reranker-base | 0.2445 | 0.4905 | 0.6792 | 0.5757 |
| cross-encoder-mmarco-mMiniLMv2-L12-H384-v1 | 0.5588 | 0.9211 | 0.7158 | 0.932 |
| shioriha-large-reranker | 0.5775 | 0.8458 | 0.8084 | 0.9262 |
| bge-m3+all | 0.576 | 0.904 | 0.7926 | 0.9226 |
| bge-m3+dense | 0.539 | 0.8642 | 0.7753 | 0.8815 |
| bge-m3+colbert | 0.5656 | 0.9064 | 0.7902 | 0.9297 |
| bge-m3+sp |
We're benchmarking and onboarding japanese-reranker-cross-encoder-small-v1 as a hosted, OpenAI-compatible API. Sign in for free credit and be ready when it lands, or tell us you want it and we'll prioritize it.