Fishnet Open Images Dataset v.0.1.1


The v0.1.1 (beta) dataset contains 162,926 bounding boxes for 24 object classes (composed entirely of fish species and humans) on ~35K images with an average of 5 bounding boxes per image. We've also included a higher order label that groups fishes that lack a sufficient number of examples (< 100). The boxes have been manually drawn by professional annotators at Samasource to ensure accuracy and consistency. We are principally interested in annotating fish, however, there is value in annotating humans as well as they can be a proxy for fishing activity. For fishes, we define a fish feature or part (e.g. fins, tail, head) if it is ≥80% in the frame. We label both fish on the deck of the vessel and fish that are recognizable as fish alongside the vessel in the water. We also annotate bounding boxes around ‘human features’ that are not faces, such as boots, legs, and arms.

In processing both video and declaration data we remove any information related to location, vessel name, unique identifying features like vessel license number, and any frames with human faces.

The v0.1.1 dataset is relatively small and lacks diversity as it covers a limited number of vessels and individual trips and includes many sequences. The dataset will be actively maintained and we anticipate a 10X increase in number of images and annotations and video segments in subsequent releases.

The dataset was compiled by The Nature Conservancy in partnership with Satlink, Archipelago Marine Research, the Pacific Community, the Solomon Islands Ministry of Fisheries and Marine Resources, the Australia Fisheries Management Authority, and the governments of New Caledonia and Palau.