GeoBIM, the integration of 3D geoinformation (Geo) with building information models (BIM), is a subject of increasing attention in both domains. A well-known practical challenge for this integration is the mixed state of software support for open standards in each domain that would ease the integration. This is often known by practitioners but poorly documented. In order to solve this problem, we devised the GeoBIM benchmark, in which we compile the experiences of volunteering participants, who perform a guided study to test the software they are most familiar with against a few provided datasets structured in open standards. The aim of the tests is to improve the knowledge of the state of the art in the software support for GeoBIM open standards and to identify points for improvement. In this paper, we present the design of the benchmark, especially explaining and discussing the chosen data to be used with their connected issues to be tested, and some initial results.