Statistical Optimization of Training Data for Semi-Supervised Text Document Clustering

dc.contributor.advisorPhillips, Joshua
dc.contributor.authorNewbold, Cody Renae
dc.contributor.committeememberPettey, Chrisila
dc.contributor.committeememberLi, Cen
dc.contributor.departmentComputer Scienceen_US
dc.date.accessioned2017-10-04T20:13:31Z
dc.date.available2017-10-04T20:13:31Z
dc.date.issued2017-06-22
dc.description.abstractUnsupervised machine learning algorithms suffer from uncertainty that results are accurate or useful. In particular, text document clustering algorithms such as Latent Dirichlet Allocation (LDA) and Latent Semantic Analysis (LSA) give no guarantee that documents are clustered in a manner similar to human readers. Using a semi-supervised approach on text document clustering, we show that the selection of training data can be statistically optimized using LDA and LSA. Using this method, a human reader categorizes a percentage of the data as an analysis step, then feeds the partially-labeled data into bootstrap training and testing steps. Using mutual information to discover which documents were better for training, the algorithm does a post-processing step using the optimized training set. The results show that mutual information values are higher when the statistically optimized training set is used and indicate that human-like performance is better achieved with optimized training data.
dc.description.degreeM.S.
dc.identifier.urihttp://jewlscholar.mtsu.edu/xmlui/handle/mtsu/5393
dc.publisherMiddle Tennessee State University
dc.subjectAfghan war diary
dc.subjectLatent dirichlet allocation
dc.subjectLatent semantic analysis
dc.subjectTopic modeling
dc.subject.umiComputer science
dc.thesis.degreegrantorMiddle Tennessee State University
dc.thesis.degreelevelMasters
dc.titleStatistical Optimization of Training Data for Semi-Supervised Text Document Clustering
dc.typeThesis

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Newbold_mtsu_0170N_10848.pdf
Size:
958.54 KB
Format:
Adobe Portable Document Format

Collections