a2975f337a
2) Added a raw Latex page break directive after each TOC tree. (For the PDF tutorial look). 3) Two finished tutorials: a) one describing how the Mat data structure works and its output capabilities (format function) (demonstration YouTube video included). b) one describing image scanning operations plus the LUT function (demonstration YouTube video included). c) a basic filtering approach (plus multi row image scanning demonstration) in the work.
281 lines
9.7 KiB
ReStructuredText
281 lines
9.7 KiB
ReStructuredText
.. _Morphology_1:
|
|
|
|
Eroding and Dilating
|
|
**********************
|
|
|
|
Goal
|
|
=====
|
|
|
|
In this tutorial you will learn how to:
|
|
|
|
* Apply two very common morphology operators: Dilation and Erosion. For this purpose, you will use the following OpenCV functions:
|
|
|
|
* :erode:`erode <>`
|
|
* :dilate:`dilate <>`
|
|
|
|
Cool Theory
|
|
============
|
|
|
|
.. note::
|
|
The explanation below belongs to the book **Learning OpenCV** by Bradski and Kaehler.
|
|
|
|
Morphological Operations
|
|
--------------------------
|
|
|
|
* In short: A set of operations that process images based on shapes. Morphological operations apply a *structuring element* to an input image and generate an output image.
|
|
|
|
* The most basic morphological operations are two: Erosion and Dilation. They have a wide array of uses, i.e. :
|
|
|
|
* Removing noise
|
|
|
|
* Isolation of individual elements and joining disparate elements in an image.
|
|
|
|
* Finding of intensity bumps or holes in an image
|
|
|
|
* We will explain dilation and erosion briefly, using the following image as an example:
|
|
|
|
.. image:: images/Morphology_1_Tutorial_Theory_Original_Image.jpg
|
|
:alt: Original image
|
|
:height: 100px
|
|
:align: center
|
|
|
|
Dilation
|
|
^^^^^^^^^
|
|
|
|
* This operations consists of convoluting an image :math:`A` with some kernel (:math:`B`), which can have any shape or size, usually a square or circle.
|
|
|
|
* The kernel :math:`B` has a defined *anchor point*, usually being the center of the kernel.
|
|
|
|
* As the kernel :math:`B` is scanned over the image, we compute the maximal pixel value overlapped by :math:`B` and replace the image pixel in the anchor point position with that maximal value. As you can deduce, this maximizing operation causes bright regions within an image to "grow" (therefore the name *dilation*). Take as an example the image above. Applying dilation we can get:
|
|
|
|
.. image:: images/Morphology_1_Tutorial_Theory_Dilation.jpg
|
|
:alt: Dilation result - Theory example
|
|
:height: 100px
|
|
:align: center
|
|
|
|
The background (bright) dilates around the black regions of the letter.
|
|
|
|
Erosion
|
|
^^^^^^^^
|
|
|
|
* This operation is the sister of dilation. What this does is to compute a local minimum over the area of the kernel.
|
|
|
|
* As the kernel :math:`B` is scanned over the image, we compute the minimal pixel value overlapped by :math:`B` and replace the image pixel under the anchor point with that minimal value.
|
|
|
|
* Analagously to the example for dilation, we can apply the erosion operator to the original image (shown above). You can see in the result below that the bright areas of the image (the background, apparently), get thinner, whereas the dark zones (the "writing"( gets bigger.
|
|
|
|
.. image:: images/Morphology_1_Tutorial_Theory_Erosion.jpg
|
|
:alt: Erosion result - Theory example
|
|
:height: 100px
|
|
:align: center
|
|
|
|
|
|
Code
|
|
======
|
|
|
|
This tutorial code's is shown lines below. You can also download it from `here <https://code.ros.org/svn/opencv/trunk/opencv/samples/cpp/tutorial_code/Image_Processing/Morphology_1.cpp>`_
|
|
|
|
.. code-block:: cpp
|
|
|
|
#include "opencv2/imgproc/imgproc.hpp"
|
|
#include "opencv2/highgui/highgui.hpp"
|
|
#include "highgui.h"
|
|
#include <stdlib.h>
|
|
#include <stdio.h>
|
|
|
|
using namespace cv;
|
|
|
|
/// Global variables
|
|
Mat src, erosion_dst, dilation_dst;
|
|
|
|
int erosion_elem = 0;
|
|
int erosion_size = 0;
|
|
int dilation_elem = 0;
|
|
int dilation_size = 0;
|
|
int const max_elem = 2;
|
|
int const max_kernel_size = 21;
|
|
|
|
/** Function Headers */
|
|
void Erosion( int, void* );
|
|
void Dilation( int, void* );
|
|
|
|
/** @function main */
|
|
int main( int argc, char** argv )
|
|
{
|
|
/// Load an image
|
|
src = imread( argv[1] );
|
|
|
|
if( !src.data )
|
|
{ return -1; }
|
|
|
|
/// Create windows
|
|
namedWindow( "Erosion Demo", CV_WINDOW_AUTOSIZE );
|
|
namedWindow( "Dilation Demo", CV_WINDOW_AUTOSIZE );
|
|
cvMoveWindow( "Dilation Demo", src.cols, 0 );
|
|
|
|
/// Create Erosion Trackbar
|
|
createTrackbar( "Element:\n 0: Rect \n 1: Cross \n 2: Ellipse", "Erosion Demo",
|
|
&erosion_elem, max_elem,
|
|
Erosion );
|
|
|
|
createTrackbar( "Kernel size:\n 2n +1", "Erosion Demo",
|
|
&erosion_size, max_kernel_size,
|
|
Erosion );
|
|
|
|
/// Create Dilation Trackbar
|
|
createTrackbar( "Element:\n 0: Rect \n 1: Cross \n 2: Ellipse", "Dilation Demo",
|
|
&dilation_elem, max_elem,
|
|
Dilation );
|
|
|
|
createTrackbar( "Kernel size:\n 2n +1", "Dilation Demo",
|
|
&dilation_size, max_kernel_size,
|
|
Dilation );
|
|
|
|
/// Default start
|
|
Erosion( 0, 0 );
|
|
Dilation( 0, 0 );
|
|
|
|
waitKey(0);
|
|
return 0;
|
|
}
|
|
|
|
/** @function Erosion */
|
|
void Erosion( int, void* )
|
|
{
|
|
int erosion_type;
|
|
if( erosion_elem == 0 ){ erosion_type = MORPH_RECT; }
|
|
else if( erosion_elem == 1 ){ erosion_type = MORPH_CROSS; }
|
|
else if( erosion_elem == 2) { erosion_type = MORPH_ELLIPSE; }
|
|
|
|
Mat element = getStructuringElement( erosion_type,
|
|
Size( 2*erosion_size + 1, 2*erosion_size+1 ),
|
|
Point( erosion_size, erosion_size ) );
|
|
|
|
/// Apply the erosion operation
|
|
erode( src, erosion_dst, element );
|
|
imshow( "Erosion Demo", erosion_dst );
|
|
}
|
|
|
|
/** @function Dilation */
|
|
void Dilation( int, void* )
|
|
{
|
|
int dilation_type;
|
|
if( dilation_elem == 0 ){ dilation_type = MORPH_RECT; }
|
|
else if( dilation_elem == 1 ){ dilation_type = MORPH_CROSS; }
|
|
else if( dilation_elem == 2) { dilation_type = MORPH_ELLIPSE; }
|
|
|
|
Mat element = getStructuringElement( dilation_type,
|
|
Size( 2*dilation_size + 1, 2*dilation_size+1 ),
|
|
Point( dilation_size, dilation_size ) );
|
|
/// Apply the dilation operation
|
|
dilate( src, dilation_dst, element );
|
|
imshow( "Dilation Demo", dilation_dst );
|
|
}
|
|
|
|
|
|
Explanation
|
|
=============
|
|
|
|
#. Most of the stuff shown is known by you (if you have any doubt, please refer to the tutorials in previous sections). Let's check the general structure of the program:
|
|
|
|
* Load an image (can be RGB or grayscale)
|
|
|
|
* Create two windows (one for dilation output, the other for erosion)
|
|
|
|
* Create a set of 02 Trackbars for each operation:
|
|
|
|
* The first trackbar "Element" returns either **erosion_elem** or **dilation_elem**
|
|
* The second trackbar "Kernel size" return **erosion_size** or **dilation_size** for the corresponding operation.
|
|
|
|
* Every time we move any slider, the user's function **Erosion** or **Dilation** will be called and it will update the output image based on the current trackbar values.
|
|
|
|
Let's analyze these two functions:
|
|
|
|
#. **erosion:**
|
|
|
|
.. code-block:: cpp
|
|
|
|
/** @function Erosion */
|
|
void Erosion( int, void* )
|
|
{
|
|
int erosion_type;
|
|
if( erosion_elem == 0 ){ erosion_type = MORPH_RECT; }
|
|
else if( erosion_elem == 1 ){ erosion_type = MORPH_CROSS; }
|
|
else if( erosion_elem == 2) { erosion_type = MORPH_ELLIPSE; }
|
|
|
|
Mat element = getStructuringElement( erosion_type,
|
|
Size( 2*erosion_size + 1, 2*erosion_size+1 ),
|
|
Point( erosion_size, erosion_size ) );
|
|
/// Apply the erosion operation
|
|
erode( src, erosion_dst, element );
|
|
imshow( "Erosion Demo", erosion_dst );
|
|
}
|
|
|
|
* The function that performs the *erosion* operation is :erode:`erode <>`. As we can see, it receives three arguments:
|
|
|
|
* *src*: The source image
|
|
* *erosion_dst*: The output image
|
|
* *element*: This is the kernel we will use to perform the operation. If we do not specify, the default is a simple :math:`3x3` matrix. Otherwise, we can specify its shape. For this, we need to use the function :get_structuring_element:`getStructuringElement <>`:
|
|
|
|
.. code-block:: cpp
|
|
|
|
Mat element = getStructuringElement( erosion_type,
|
|
Size( 2*erosion_size + 1, 2*erosion_size+1 ),
|
|
Point( erosion_size, erosion_size ) );
|
|
|
|
We can choose any of three shapes for our kernel:
|
|
|
|
* Rectangular box: MORPH_RECT
|
|
* Cross: MORPH_CROSS
|
|
* Ellipse: MORPH_ELLIPSE
|
|
|
|
Then, we just have to specify the size of our kernel and the *anchor point*. If not specified, it is assumed to be in the center.
|
|
|
|
* That is all. We are ready to perform the erosion of our image.
|
|
|
|
.. note::
|
|
Additionally, there is another parameter that allows you to perform multiple erosions (iterations) at once. We are not using it in this simple tutorial, though. You can check out the Reference for more details.
|
|
|
|
|
|
#. **dilation:**
|
|
|
|
The code is below. As you can see, it is completely similar to the snippet of code for **erosion**. Here we also have the option of defining our kernel, its anchor point and the size of the operator to be used.
|
|
|
|
.. code-block:: cpp
|
|
|
|
/** @function Dilation */
|
|
void Dilation( int, void* )
|
|
{
|
|
int dilation_type;
|
|
if( dilation_elem == 0 ){ dilation_type = MORPH_RECT; }
|
|
else if( dilation_elem == 1 ){ dilation_type = MORPH_CROSS; }
|
|
else if( dilation_elem == 2) { dilation_type = MORPH_ELLIPSE; }
|
|
|
|
Mat element = getStructuringElement( dilation_type,
|
|
Size( 2*dilation_size + 1, 2*dilation_size+1 ),
|
|
Point( dilation_size, dilation_size ) );
|
|
/// Apply the dilation operation
|
|
dilate( src, dilation_dst, element );
|
|
imshow( "Dilation Demo", dilation_dst );
|
|
}
|
|
|
|
|
|
|
|
Results
|
|
========
|
|
|
|
* Compile the code above and execute it with an image as argument. For instance, using this image:
|
|
|
|
.. image:: images/Morphology_1_Tutorial_Original_Image.jpg
|
|
:alt: Original image
|
|
:height: 200px
|
|
:align: center
|
|
|
|
We get the results below. Varying the indices in the Trackbars give different output images, naturally. Try them out! You can even try to add a third Trackbar to control the number of iterations.
|
|
|
|
.. image:: images/Morphology_1_Tutorial_Cover.jpg
|
|
:alt: Dilation and Erosion application
|
|
:height: 400px
|
|
:align: center
|
|
|