Thursday, 22 May 2014

Data analyzer software with text classification

My previous project Data Analyzer software is the tool which allows:

  • Import data from any source such databases, text files, CSV files and other,
  • Create custom queries on the source data using easy query generator tools,
  • Display the data using advanced data grid with column grouping, field chooser, custom field definition, filtering,
  • Display the data on the advanced OLAP cube grid. It allows you display information in many different views,
  • Creating custom reports which can be exported to any known formats, eg.: XML, PDF, DOC, HTML and many more.
  • The custom report generator is a easy to use drop and down tool. Just pick up the field and drop on the report form.
  • Additional functionality: predictions based on imported data and finally the text classification functionality.
As I mentioned above, the predictions are based on learning algorithms. Also the text classification uses similar approach.

Below are some videos showing the data analyzer software

and report generator

Also create data source connection example

Please visit my web page for more information

Tuesday, 20 May 2014

The text classification software design

In my last post I wrote brief description of the text classification software. Today I'd like to introduce my first attempt to the software. I created the software module which is able to learn words, sentences and phrases. The software needs training before use, so we need feed the software as much as we can. The learning materials are just text which you want to classify.

For example the learning content in the IT support department: "The laptop shutdown when the power adapter is off - Hardware". The text classification software will recognize the sentence as problem with hardware. I know that this example can be easy done in any programming language with few minutes of work but text classification and natural language processing allows enter sentence for example: "My laptop stopped working when cut off the power adapter". For human being it's natural language but not for machines! So if we train the software with hundreds or more sentences then the software easy classify the documents.

Below is a short video demo of the text classification.

and also text mining software demo

Please also visit my web site for more information

The idea of the text classification software

I'm software developer with over 14 years of experience as a software developer. Some time ago one company contacted me as they was searching a solution for classify documents and other text information incoming to the company. As the number of incoming data was increasing they decided to find solution which will help with text classification. They already hired another persons to classify documents but still the performance was not good. Now a days the data traffic is increasing every day and software like text classification, text mining and data mining is very desirable.