BTS: 双语文本分割数据集,包含14250张图像,覆盖了室内和室外、不同字体、不同方向和曲线形状等各种情况,采用人工标注的方式,并通过两轮质量检查确保高质量标注

BTS: A Bi-lingual Benchmark for Text Segmentation in the Wild

This is the repo to host the dataset BTS from the following paper:

Xixi XuZhongang QiJianqi MaHonglun ZhangYing ShanXiaohu QieBTS: A Bi-lingual Benchmark for Text Segmentation in the Wild

Our dataset is now fully released for academic use. To download the dataset, please send a request email to 15821795091@163.com to get an agreement and sign. After verifying your request, we will provide the download link for you.

Selection of scenes.

The key motivation of the selection of scenes is to ensure the representation and generalization of the dataset.

  • First, we have images indoor and outdoor to balance the lighting conditions.
  • Second, the text line appearance variety is also an important factor to be considered, i.e., text line in different orientation (vertical and horizontal text in couplets and textbooks) and curve-shaped (some of the signboards).
  • The third factor lies in the font diversity, e.g., we have text images in printed font in textbook and artistic font on the signboard.

We believe that varieties in these three perspectives can ensure the segmentation model to be well-trained with better generalization.

Dataset annotation.

BTS eliminate algorithms and out-of-the-box models for the labeling process to prevent some bad labeling cases. The annotation workflow is as follows.

  • Images cleaning. Unqualified examples such as fuzzy images with unrecognizable characters and strokes will be filtered out.
  • Manual annotation. All the images in BTS are manually annotated by humans in three levels, including the pixel-level, the character-level, and the line-level annotations. PhotoShop is the main tool. The pencil tool in Photoshop is utilized to assist the annotators to label pixel-level mask annotations for texts.
  • Two rounds of quality checks. During the labeling process, annotators will cross check the annotations from each other; after the labeling process, several professional researchers will double check the annotations.

The designed workflow ensures all annotations to be made in relatively high quality and benchmark to be highly-reliable.

Dataset statistics.

BTS contains 14250 images.

The distribution is nearly balanced, which is consistent with real-world distribution.

Download

A full download should contain these files:

  • BTS_VAL.zip contains 10,188 images.
  • BTS_TRAIN.zip contains 2,696 images.
  • BTS_TEST.zip contains 1,366 images.

In each zip packages, there are three folds.

  • image contains original images. [SceneID]_[SampleID].jpg
  • bpoly_label word-level and char-level labels corresponding to the images. [SceneID]_[SampleID]_anno.json
  • semantic_label mask labels corresponding to the images. [SceneID]_[SampleID]_maskfg.png

In this table, we compare BTS with a variety of representative datasets.

DatasetText TypeImagesWordsCharsMasksChar ClassesLanguage
ICDAR13 FSTScene46219446620Word,Char36English
COCO_TSScene14690139034Word36English
MLT_SScene689630691Word36English
Total-TextScene15559330Word36English
TextSegScene+Design40241569173790Word,Word-Effect,Char36English
BTS(Ours)Scene1425044280209090Word,Char3985Bi-lingual

关于明柳梦少

坚守自己的原则,不随波逐流。