Submit a tool
RankDroid accepts newly developed Android testing tools, and existing tools that are currently non-functional or unavailable once they can be run. Every submission is evaluated under the same protocol as the tools already on the leaderboard.
How it works
Send us your tool
Share the source code or a binary, instructions to run it without human interaction, and a paper or preprint that describes it.
We run the benchmark
We run the tool for 60 minutes on each of the 100 benchmark apps, in the same environment as every other tool.
Results go live
The tool joins the leaderboard with its ranks, per-app results, and evolution curves in every category.
Get in touch
This form opens a pre-filled email in your mail app. It is also the way to request access to the benchmark or to ask a question.
The contact address has not been configured yet. Set contactEmail in data/site.js.
Requirements
- Fully automated: no human input while testing
- Works on APKs, without the app's source code
- Runs on an Android 11 (API 30) x86_64 emulator
- Can be started from the command line for a fixed time budget
- Source code or binary available to the RankDroid team
Good to know
Tools that need an LLM API key or other paid services are welcome. Tell us in your message what they need. We report results for the configuration we ran.
Tools we couldn't run
Fully automated Android testing tools found by our literature reviews that are not ranked yet, because their code is unavailable or they no longer work. If you are an author or a maintainer, help us bring them to the leaderboard.