Study of Document Layout Analysis Algorithms

Study of Document Layout Analysis AlgorithmsRelative Study of Document Layout Analysis Algorithms for Printed Document ImagesDivya Kamat, Divya Sharma, Parag Chitale, Prateek DasguptaABSTRACTIn the following(a) survey paper, the different algorithms that could be used for schoolbookbookbook file layout psychoanalysis have been studied and their results have been comp atomic number 18d. For the remotion of depict mask, Bloombergs algorithm and CRLA have been described. For the train of text segmentation, we have studied the Recursive XY Cut algorithm, RLSA and RLSO algorithms.IntroductionPhysical layout analysis of printed document kitchen stoves is the archetypal step of the OCR conversion. For the OCR to work effectively, we need to provide an input signal wherein no images are present in the document i.e. the image contains only text. If this is not done properly, the OCR will return garbage values. To avoid this, we have discussed both algorithms, Bloombergs Algorit hm and CRLA that could be used for the removal images from the document images.The next step is the text segmentation wherein we find the text blocks inside the document. The coordinates of these text blocks are then passed as input to the OCR. To perform this segmentation, we have discussed the algorithmic XY cut algorithm, the RLSA and RLSO algorithms.Removal of Image from DocumentThe offshoot step in the document layout analysis is to remove the images present in the original document. We will be discussing the Bloombergs algorithm along with its variations and the CRLA algorithm for image removal.Bloombergs AlgorithmThe Bloombergs algorithm is primarily used to find the image mask of halftone images. The implementation of this algorithm uses basic morpho synthetical operations. The algorithm has the following stepsIn the first step, the binarization of the input image is performed.Next, 41 wand reduction is performed twice using limen T=1.41 threshold reduction is performed using T=4.41 threshold reduction is performed using T=3.Opening the image with a structural element of size 55.Next, 14 magnification of the image is performed twice.Next the pairing of overlapping components of the seed image obtained from step 6 with the image obtained from step 2 is performed.Dilation with structural element 33 followed by 14 expansion which is performed twice.The halftone mask obtained from step 8 is then subtracted from the binarized input image.The main issue with Bloombergs algorithm is that it is unable to distinguish between text and sketches (i.e. imbibe drawings) in a printed document image.Enhanced CRLA AlgorithmCRLA stands for Constraint Run length Algorithm. In this algorithm we apply horizontal and vertical smoothening to the document image to get a clear detachment between text and images in the document.Enhanced CRLA is used to smooth out only the text part in the image and avoid smoothening of non-textual part of the document image.AlgorithmLa bel the connected components in the document image.Classify the components with respect to their heights as followsHeight less(prenominal) than or equal to 1 cm, label it as 1Height between 1 and 3 cm, label it as 3Height great than 3 cm, label it as 3 generate horizontal smoothening to the components with label 1 only.Apply vertical smoothening to the components with label 1 only.Logically AND the two images obtained previously.Apply horizontal smoothening to the output image of AND operation. take aim Mean Black Run Length portend the Black Run Length (BRL) row-wise for the region under consideration. find a Black-White Transition Count (TC) for the region.Calculate Mean BRL as MBRL= (BRL/TC).Calculate Mean Transition CountMaintain a Black-White Transition Count (TC) for the region.Calculate W, the width of the region.Calculate Mean TC as MTC=(TC/W)Extract the components from the image with label 1 having values of MBRL and MTC in the acceptable range for the typical document ima ge.Apply horizontal smoothening to the components with label 2 only.Apply vertical smoothening to the components with label 2 only.Logically AND the two images obtained previously.Apply horizontal smoothening to the output image of AND operation.Calculate MBRL and MTC.Extract the components from the image with label 2 and 3 having values MBRL and MTC in the acceptable range for the typical document image.At step 9 we option the text part of the document image and at step 15 we extract the non-text part of the document image.The main advantage of the CRLA algorithm is that clear separation of text and non-text part of the document image. It also whole kit and boodle for sketches as well as halftones effectively. It has considerably less complexity as selective smoothening is done.However, after the removal of the non-textual part of the document image, some stray pixels remain the image. The connected components in the halftone image whose height is less than 1cm are assumed as text elements in the algorithm. This results in presence of unwanted components in the final image.Text SegmentationThe next step in the document layout analysis is the segmentation of text into text blocks that could be provided as input to the OCR. The following algorithms have been studied for thisRecursive XY Cut algorithmThe recursive XY cut algorithm is used for obtaining text blocks from an image that does not contain any images from the original printed document. The XY cut algorithm kit and caboodle in the following wayThe bounding boxes of the image are weighd.Next we calculate the horizontal and vertical projections of the image.After calculating the projections, we then perform X cuts on all the valleys in the horizontal projections which have a value greater than the threshold th.Next we perform Y cuts in between these X cuts at all the valleys in the vertical projections which have a value greater than the threshold tv.We repeat the steps 3 and 4 until there are no furth er X or Y cuts possible in a region.One of the problems with XY cut algorithm is that there is no method to find a threshold that will work for all the documents. Instead, a new threshold needs to be determined for each document and this cannot be done without manual intervention.Another major issue with the recursive XY algorithm is the time complexity. The recursive XY cut algorithm requires a large time to complete execution. Despite these disadvantages, this algorithm successfully separates the text blocks provided that a manual threshold is provided.RLSAThe Run-Length Smoothing Algorithm (RLSA) works on black white scanned images of documents. It finds runs of white pixels and converts them into black pixels whenever they are less than a given threshold. The RLSA works in four stepsIn the first step, we perform horizontal smoothing. For this, we scan the image row-wise and then replace lengths of white pixels by black pixels if they are less than a threshold th.In the mo step , we perform vertical smoothing. For this, we scan the image column-wise and then replace lengths of white pixels by black pixels if they are less than a threshold tv.Next, we perform logical ANDing of the images obtained from the first and second steps.Then we perform horizontal smoothing on the image obtained from step 3 with a threshold ta.RLSOA simplified version of the RLSA, RLSO (Run-Length Smoothing with OR) works as followsIn the first step, we perform horizontal smoothing. For this, we scan the image row-wise and then replace lengths of white pixels by black pixels if they are less than a threshold th.In the second step, we perform vertical smoothing. For this, we scan the image column-wise and then replace lengths of white pixels by black pixels if they are less than a threshold tv.Next we perform a logical OR operation on the images obtained from the first and second step.The RLSA algorithm returns rectangular frames of documents with Manhattan Layouts. On the other hand, RLSO algorithm also works well with non-Manhattan layouts. The problem with both RLSA and RLSO is that the threshold for smoothing needs to be determined manually. Also the threshold required for each document image is different and it is almost impossible to be determined manually.ConclusionWe have compared the above given algorithms for the document layout analysis. During our research we found that, while Bloombergs algorithm faces problems for images that contain sketches, CRLA faces problems for images that contain extremely small non-textual elements.We also observed that the recursive XY Cut algorithm and RLSA both do not work on printed documents having non-Manhattan layouts. On the other hand, the RLSO algorithm gives comparatively better results for Manhattan as well as non-Manhattan layouts. However, all three algorithms mentioned above face the common problem of manual threshold determination which is document specific.ReferencesSyed Saqib Bukhari, Faisal Shafait and Th omas M. Bruel, Improved Document Image Segmentation Algorithm using Multiresolution MorphologyJaekyu Ha and Robert M. Haralick, Ihsin T. Philips, Recursive XY Cut using Bounding Boxes of machine-accessible Components , Third International Conference on Document Analysis and Recognition, ICDAR, 1995Stefano Ferilli, Teresa M.A. Basile, Floriana Esposito, A histogram-based Technique for Automatic Threshold Assessment in a Run Length Smoothing-based Algorithm, ACM, 2010.Hung-Ming Sun, Enhanced Constrained Run-Length Algorithm for Complex Layout Document Processing, International Journal of Applied Science and Engineering, 2006