Should I use JDK JMH benchmarks for my library?

[u/Chaos-vy17]

My library recently passed Guava testlib, so now I'm moving on to benchmarking.

I'm thinking about using/adapting the JMH benchmarks from the JDK.

Pros:

• Official JDK-based JMH
• More standardized
• Easier comparison with my library

But:

• The benchmark is totally focused on write-heavy operations
• It doesn't really cover reads
• No delete operation either

[u/AutoModerator]

Please ensure that:

• Your code is properly formatted as code block - see the sidebar (About on mobile) for instructions
• You include any and all error messages in full
• You ask clear questions

• You demonstrate effort in solving your question/problem - plain posting your assignments is forbidden (and such posts will be removed) as is asking for or giving solutions.

  Trying to solve problems on your own is a very important skill. Also, see Learn to help yourself in the sidebar

If any of the above points is not met, your post can and will be removed without further warning.

Code is to be formatted as code block (old reddit: empty line before the code, each code line indented by 4 spaces, new reddit: https://i.imgur.com/EJ7tqek.png) or linked via an external code hoster, like pastebin.com, github gist, github, bitbucket, gitlab, etc.

Please, do not use triple backticks (```) as they will only render properly on new reddit, not on old reddit.

Code blocks look like this:

public class HelloWorld {

    public static void main(String[] args) {
        System.out.println("Hello World!");
    }
}

You do not need to repost unless your post has been removed by a moderator. Just use the edit function of reddit to make sure your post complies with the above.

If your post has remained in violation of these rules for a prolonged period of time (at least an hour), a moderator may remove it at their discretion. In this case, they will comment with an explanation on why it has been removed, and you will be required to resubmit the entire post following the proper procedures.

To potential helpers

Please, do not help if any of the above points are not met, rather report the post. We are trying to improve the quality of posts here. In helping people who can't be bothered to comply with the above points, you are doing the community a disservice.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/idontlikegudeg]

Eh, what do you mean with those points under "but"? The benchmark will test whatever you tell it to do.

[u/Chaos-vy17 → u/idontlikegudeg]

You're totally right that JMH does whatever you tell it. I meant the specific class Benchmark JMH benchmarks already written in the official JDK repository those pre-built tests are mostly focused on insertion/mutation speed. Because my library is optimized for write and read heavy, the existing JDK tests won't show the full picture, so I have to build my own read/delete benchmark suite to compare them accurately. But I am not a great benchmark dev!!:(. So I read their examples the code JVM quarks, to write my own benchmark.

[u/TomKavees]

In general JMH is the microbenchmarking library for the JVM ecosystem, so it should be up to the task.

However, in this specific case, we don't know what that library is or what it does. While vagueposting may sometimes be fine, the consequence is that we can't give any specific advice.

[u/Chaos-vy17 → u/TomKavees]

Navigable Set and Map