Datasets per Publication

A new database with handwritten Arabic script. It is based on five books written by different writers from the years 1088-1451. We took 668 pages from these five books, and fully annotated them on the sub-word level. For each page we manually applied bounding boxes on the different sub-words and annotated the sequence of characters. It consists of 159,149 sub-word appearances consisted of 326,289 characters out of a vocabulary of 5,509 forms of sub-words. The database is described in detail and is designed for training and testing recognition systems for handwritten Arabic sub-words. This database is available for the purpose of research, and we encourage researchers to develop and test new methods using our database.

For tutorials to understand the annotation format, extraction, and segmentation of this dataset, please refer here. In order to get more information regarding the dataset click here, and to read about the basic tracks in order to conduct research on then click here.

The dataset contains 419 handwritten flowcharts using the inkML standard format.
35 writers have contributed. The train set (248 samples) contains 14 different patterns and the test set (171 samples) uses 14 other flowchart patterns.
 

The collection contains simultaneously acquired online and offline samples. The online dataset is called "NFI-online" and was processed and segmented by Louis Vuurpijl. The offline dataset is called "NFI-offline" and was scanned by Vivian Blankers from the NFI. The offline signatures were automatically segmented and visually inspected by Louis Vuurpijl. Processing of the segmented signatures was performed by Katrin Franke. The collection contains:

The NLDCC-online signature collection contains in total 1953 online and 1953 offline signature files.

This is the dataset of the ICDAR 2013 - Gender Identification from Handwriting competition. If you use this database, please consider citing it as in [1].

This dataset is a subset of the QUWI dataset [2]. In sum, a total of 475 writers produced 4 handwritten documents: the first page contains an Arabic handwritten text which varies from one writer to another, the second page contains an Arabic handwritten text which is the same for all the writers, the third page contains an English handwritten text which varies from one writer to another and the fourth page contains an English handwritten text which is the same for all the writers.

Images have been acquired using an EPSON GT-S80 scanner, with a 300 DPI resolution. Images were provided in
JPG uncompressed format. The training set consists of the first 282 writers for which the genders are provided.
Participants were asked to predict the gender of the remaining 193 writers.

In addition to images, features extracted from the data were also provided in order to make the competition accessible by people without image processing skills. Those features are described in [3].

[1] Hassaïne, Abdelâali, et al. "ICDAR 2013 Competition on Gender Prediction from Handwriting." Document Analysis and Recognition (ICDAR), 2013 12th International Conference on. IEEE, 2013.

[2] Hassaïne, Abdelaali, et al. "The ICDAR2011 Arabic writer identification contest." Document Analysis and Recognition (ICDAR), 2011 International Conference on. IEEE, 2011.

[3] Al Maadeed, Somaya, and Abdelaali Hassaine. "Automatic prediction of age, gender, and nationality in offline handwriting." EURASIP Journal on Image and Video Processing 2014.1 (2014): 1-10.

SOURCE WEBSITES:

Statistics Canada  http://www.statcan.gc.ca/start-debut-eng.html

The World Bank,   http://www.worldbank.org/

Statistics Norway,    https://www.google.com/?gws_rd=ssl#q=Statistics+Norway

Statistics Finland, http://www.stat.fi/index_en.html

US Department of Justice,    https://www.justice.gov/

Geohive,   http://www.geohive.com/

US Energy Information Administration,    https://www.eia.gov/

US Census Bureau. http://www.census.gov/

 DATA COLLECTION:  About 1000 tables were collected from international statistical websited by DocLab graduate students in2009-2010. A perceptually random subset of 200 of these tables was converted (mostly from HTML) via EXCEL into CSV files and stored at DocLab. The original HTML files were not retained and their URLs were kept somewhat haphazardly. Many of these tables can still be found by a web search, but others have been modified, corrected, or updated on the original sites. The dataset now consists only of the 200 CSV file representation of 200 web tables.

GROUND TRUTH: The four critical cells (top-left and bottom right of the stub-header and top-left and bottom-right of the data region) were entered with an interactive tool (VeriClick) in 2011. Several GT errors were subsequently found during segmentation experiments and corrected. Researchers may still disagree on 2-3 tables on whether a particular row or column (unusual contents or units) belong to the data region.  The GT for all 200 tables is a single CSV file that allows adding to it and verifying the results of a header segmentation experiment.

AcTiV is the first publicly accessible annotated dataset designed to assess the performance of different Arabic VIDEO-OCR systems. The database has been named AcTiV for Arabic Text in Video. The challenges that are addressed by AcTiV-database are in text patterns variability and presence of complex background with various objects resembling text characters. AcTiV enables users to test their systems’ abilities to locate, track and read text objects in videos. The actual version of the dataset includes 80 videos collected from 4 different Arabic news channels. In the present work, two types of video stream were chosen: Standard-Definition (720x576, 25 fps) and High-Definition (1920x1080, 25fps).We mainly focus on text displayed as overlay in news video, which can be classified into two types: static text and dynamic one.

Two sub-datasets are created from the AcTiV database: Activ-D (D for detection) and  Activ-R (R for recognition). AcTiV-D represents a sub-dataset of nonredundant frames used to measure the performance of single-frame based methods to detect/localize text regions in still HD/SD images. AcTiV-R is a sub-dataset of cropped images used to measure the performance of Arabic OCR systems to read texts in video frames.

Please find hereafter the download links of the detection and recognition datasets.

The Bentham collection consists of a set of images of a collection of works on law and moral philosophy written by the philosopher Jeremy Bentham.

The selected subset has been written by several hands (Bentham himself and his secretaries) and entails significant varibilities and difficulties regarding the quality of text images and writting styles. Training and test data were provided in the form of carefully segmented line images, along with the corresponding transcripts.

This dataset is free available for research purposes and it is provided into two parts: the images and the GT. The GT includes information about the  layout and the transcription at line level of each image in PAGE format. 

Keywords

Forensic analysis, signatures, handwriting, off-line, on-line, verification, identification, evaluation, likelihood ratios

Description

Spectral analysis of writing materials is of great importance for the study and analysis of ancient documents. Multi-spectral (MS) imaging represents an innovative and non-destructive technique for the analysis of materials. For this purpose, we collected a Multispectral image database of ancient handwritten letters.

The SMADI database consists of 240 multispectral images of 30 real historical handwritten letters. All ancient manuscripts were written using iron gall ink and date from the 17th to the 20th century. Original documents were borrowed from Quebec’s national library (BAnQ Bibliotheque et Archives nationales du Quebec) and have been imaged using a CROMA CX MSI camera, producing 8 images for each document. A total of 240 images of real documents were captured, calibrated (illumination) and registrated.

This site provides an assessment of the quality-time performance of binarization algorithms.

Over 5.5M synthetic, 708 photographed  and 116  "real-world" documents are used in such assessment. The results of binarization are shown in statistical tables together with time elapsed. The binary images may be obtained on-demand. The current version of the platforms presents the results of 20 "classical" global binarization algorithms. The platform is being extended to include more recent algorithms.

The Total-Text dataset consists of 1555 images collected from 1) internet sources, 2) real scenery (camera or phone captured) from many countries like Malaysia, Vietnam, Japan, Canada, etc. It was annotated for three different tasks: detection, recognition, and segmentation. English is the only annotated language, the rest of the language was labeled as 'do not care' region.

This dataset contains the test and training set for the ICDAR2017 Competition on Historical Document Writer Identification (Historical-WI).

The dataset used in this competition consists of 3600 handwritten pages originating from 13th to 20th century. It contains manuscripts from 720 different writers where each writer contributed five pages. In addition, a training set is also released which contains of 394 independent writers which 3 pages each.

Example and evaluation dataset used for the ICDAR2017 Competition on Recognition of Documents with Complex Layouts, as it was made available to the participants of the competition.

Contains colour images and page layout ground truth of magazine pages and technical articles.

Example and evaluation dataset used for the ICDAR2017 Competition on Recognition of Early Indian printed Documents, as it was made available to the participants of the competition.

Challenge to find an optimal solution for accurately and automatically transcribing the Bengali books and Quarterly Lists, to form a unique dataset that can be used with computational tools and methods, and to enable full-text search and discovery.

The dataset is multilingual (50% French, 50% English, with maybe few expressions borrowed from other languages such as Latin). It consists in texts published in monographs and periodicals during the last four centuries. It accounts more than 12 million characters, and includes both noisy OCR-ed texts and the corresponding Gold-Standard (GS) which has been aligned at the character level.

The documents come from different collections (e.g. BnF, British Library) supported by various projects (e.g. Europeana Newspapers, IMPACT, Gutenberg, Perseus, Wikisource and Bank of wisdom).

Error rates, and thus difficulty, vary according to the nature of the documents. In both English and French parts of the dataset, historical newspapers, which have been reported to be especially challenging, represent more than 25% of the data.

Important notice, in the archive :

 Download link:
https://drive.google.com/open?id=1-pNT00vvIqh0ss_5b2aHo-nG8advaFJi

This is a dataset of chart images created from real data sources using matplotlib.  There are 4 basic types of charts: Bar, Line, Scatter, Box.  There are several tasks associated with this dataset including:

1) Chart Classification

2) Text Detection and Recognition

3) Text Role Classification

4) Axis Analysis

5) Legend Analysis

6a) Plot Element Detection and Classification

6b) Data Extraction

These tasks form a pipeline to recover the data used to generate the chart.

Later tasks take as input the ideal output of the previous tasks.

For more information, please visit https://chartinfo.github.io/

The dataset may be downloaded from https://github.com/adobe-research/CHART-Synthetic/releases

For this competition, the evaluation set consisted of 85 images. These included ten new scans taken from IEEE Spectrum magazines and 75 images selected from the PRImA Layout Analysis dataset as a representative sample ensuring a balanced presence of different issues affecting layout analysis and OCR. Such issues include the presence of non-rectangular shaped regions, varying text column widths, varying font sizes, presence of separators and regions of “reverse video” text (light-coloured text on a dark background). The presence of running headers and captions of illustrations/photographs in addition to the main body of text, pose difficulties in the identification of the correct reading order of the page.

For the most part, the scanned images contain single column lines of text, with a small amount containing illustrations as well as text. Some pages contain marginal data such as numbers, handwritten notes, and decorative frames. The evaluation set consisted of 56 images as a representative sample ensuring a balanced presence of different issues affecting layout analysis and OCR. Such issues include non-straight text lines, show-through or bleed-through, faded ink, decorations, the presence non-rectangular shaped regions, varying text column widths, varying font sizes, presence of separators and various aging- and scanning-related issues. In addition to the evaluation set, 25 representative images were selected as the example set that was provided to the authors with ground truth. 

This is a dataset of manually annotated chart images extracted from the Pub Med Central Open Access set.  There are 4 basic types of charts: Bar, Line, Scatter, Box.  There are several tasks associated with this dataset including:

1) Chart Classification

2) Text Detection and Recognition

3) Text Role Classification

4) Axis Analysis

5) Legend Analysis

A total of 4242 images have been annotated for Task 1, 200 for Task 2 and 200 for Tasks 3 to 5. For more information, please visit https://chartinfo.github.io/ or contact: kennydav@buffalo.edu

The dataset consists of 1172 Chinese document images mainly written in Chinese traditional Han script. The document images have been taken from different books.  The dataset is developed aiming historical documents to develop robust systems for historical document analysis. In this direction, there will be a competition named Historical Document Reading Challenge on Large Chinese Structured Family Records, in short ICDAR 2019 HDRC Chinese on this database. The objective behind this competition is to boost the research on historical document analysis. The focus of the competition is to recognize and analyze the layout, and finally detect and recognize the text lines and characters of the documents in this database.

Please follow the article 

@inproceedings{simistira2019icdar2019hdrc,

archivePrefix = {arXiv},

arxivId = {1903.03341},

eprint = {1903.03341},

author = {Saini, Rajkumar and Dobson, Derek and Morrey, Jon and Liwicki, Marcus and Simistira Liwicki, Foteini},

title = {{ICDAR 2019 Historical Document Reading Challenge on Large Structured Chinese Family Records}},

booktitle={{to appear in 15th International Conference on Document Analysis and Recognition (ICDAR)}},

year = {2019},

month = {mar}, }

Dataset page on Zenodo: https://zenodo.org/record/3515403

The proposed dataset accounts for 22M OCR-ed characters (754 025 tokens) along with the corresponding groundtruth, with an unequally share of 10 European languages.

The digitized documents come from different collections available, among others, in national libraries or universities. The corresponding GT comes from initiatives such as HIMANIS, IMPACT, IMPRESSO, Open data of National Library of Finland, 4HistOCR and RECEIPT.

Degraded documents sometimes result in highly noisy OCR output and thus cannot reasonably be fully aligned with their GT. The unaligned sequences have not been included in the presented statistics (e.g. number of characters and error rates).

Error rates vary according to the nature and the state of degradation of the documents. Historical books for example, due to their complex layout and their original fonts have been reported to be especially challenging for OCR engines with up to 50% of wrongly detected characters in some documents.

The collection contains offline signature samples. The signatures were collected under the supervision of Bryan Found and Doug Rogers in the years 2002 and 2006, respectively. The images were scanned at 600dpi resolution and cropped at the Netherlands Forensic Institute for the purpose of 4NSigComp2010 signature verification competition.

The dataset provide more than 11 000 expressions handwritten by hundreds of writers from different countries, merging the data sets from 4 CROHME competitions. Writers were asked to copy printed expressions from a corpus of expressions. The corpus has been designed to cover the diversity proposed by the different tasks and chosen from an existing math corpus and from expressions embedded in Wikipedia pages. Different devices have been used (different digital pen technologies, white-board input device, tablet with sensible screen), thus different scales and resolutions are used. The dataset provides only the on-line signal.

In the last competition CROHME 2013 the test part is completely original and the train part is using 5 existing data sets:

In CROHME 2014 a new test set has been created with 987 new expressions and 2 new tasks has been added: isolated symbol recognition and matrix recognition. Train and test files as the evaluation scripts for these new tasks are provided. For the isolated symbol datasets, elements are extracted from full expression using the existing datasets, which also includes segmentation errors. For the matrix recognition task, 380 new expressions have been labelled and split into training and test sets.

Furthermore, 6 participants of the 2012 competition provide their recognized expressions for the 2012 test part. This data allows research on decision fusion or evaluation metrics...

The Bentham collection consists of a set of images of a collection of works on law and moral philosophy written by the philosopher Jeremy Bentham.

The selected subset has been written by several hands (Bentham himself and his secretaries) and entails significant varibilities and difficulties regarding the quality of text images and writting styles. Training and test data were provided in the form of carefully segmented line images, along with the corresponding transcripts.

This dataset is free available for research purposes and it is provided into two parts: the images and the GT. The GT includes information about the  layout and the transcription at line level of each image in PAGE format. 

DIVA-HisDB is a collection of three medieval manuscripts that have been chosen regarding the complexity of their layout [1], together with partners from e-codices (http://www.e-codices.unifr.ch/) and the Humanities faculty in the University of Fribourg:

Preview pages below:

HANDS-VNOnDB (VNOnDB in short) provides 1,146 Vietnamese paragraphs of handwritten text composed of 7,296 lines, more than 480,000 strokes and more that 380,000 characters written by 200 Vietnamese. Writers were asked to write freely ground-truth text from a corpus of Vietnamese text. Our ground-truth text is derived from the VieTreeBank corpus which contains all of Vietnamese characters and some special symbols since it bases on Vietnamese newspapers. For collecting patterns, we used Fujistu PC Tablets (FMVT8170) with stylus pen at high sampling rate (120Hz). Each sequence contains multiple lines within various delayed strokes. VNOnDB is available for research purpose only. For commercial purposes and sell products, please contact us via email.

This is the dataset used in the Handwritten Text Recognition (HTR) contest on the READ dataset  that was held in the context of the International Conference on Frontiers in Handwriting Recognition 2016. This contest aimed to bring together researchers working on off-line HTR and provide them a suitable benchmark to compare their techniques on the task of transcribing typical historical handwritten documents. Two tracks with different conditions on the use of training data were proposed. The handwritten images for this contest were drawn from the German document Ratsprotokolle collection composed of minutes of the council meetings held from 1470 to 1805, used in the READ project. The selected dataset has been written by several hands and entails significant variabilities and difficulties.

The dataset provides more than 12 000 expressions handwritten by hundreds of writers from different countries, merging the data sets from 4 previous CROHME competitions and adding new ressources. Writers were asked to copy printed expressions from a corpus of expressions. The corpus has been designed to cover the diversity proposed by the different tasks and chosen from an existing math corpus and from expressions embedded in Wikipedia pages. Different devices have been used (different digital pen technologies, white-board input device, tablet with sensible screen), thus different scales and resolutions are used. The dataset provides only the on-line signal.

The training and validation sets are using CROHME 2014 datasets, but 1147 new on-line handwritten expressions are used in the CROHME 2016 test dataset. Furthemore, this new package provide updated version of tools and new math ressources: more than 500K of LaTeX expressions from wikipedia to train language models.

All these ressources allow to adress 4 different tasks: Formulas recognition, Structure recognition, isolated Symbol recognition and Matrices recognition.

HANDS-VNOnDB2018 (VNOnDB2018 in short [1]) is used for ICFHR2018 Competition on Vietnamese Online Handwritten Text Recognition using VNOnDB. It provides 1,146 Vietnamese paragraphs of handwritten text composed of 7,296 lines, more than 480,000 strokes and more that 380,000 characters written by 200 Vietnamese.

Writers were asked to write freely ground-truth text from a corpus of Vietnamese text. Our ground-truth text is derived from the VieTreeBank corpus which contains all of Vietnamese characters and some special symbols since it bases on Vietnamese newspapers. For collecting patterns, we used Fujistu PC Tablets (FMVT8170) with stylus pen at high sampling rate (120Hz). Each sequence contains multiple lines within various delayed strokes. VNOnDB2018 is available for research purpose only. For commercial purposes and sell products, please contact us via email.

The dataset contains 40 images for training and validation and 10 images for testing.

The document pages in the dataset are from multiple sources which are digitized using different devices. This increased variance makes the dataset especially challenging for segmentation task.