- Methodology
- Open Access
- Published:

# Potential identification of pediatric asthma patients within pediatric research database using low rank matrix decomposition

*Journal of Clinical Bioinformatics***volume 3**, Article number: 16 (2013)

## Abstract

Asthma is a prevalent disease in pediatric patients and most of the cases begin at very early years of life in children. Early identification of patients at high risk of developing the disease can alert us to provide them the best treatment to manage asthma symptoms. Often evaluating patients with high risk of developing asthma from huge data sets (e.g., electronic medical record) is challenging and very time consuming, and lack of complex analysis of data or proper clinical logic determination might produce invalid results and irrelevant treatments. In this article, we used data from the Pediatric Research Database (PRD) to develop an asthma prediction model from past All Patient Refined Diagnosis Related Groupings (APR-DRGs) coding assignments. The knowledge gleamed in this asthma prediction model, from both routinely use by physicians and experimental findings, will become fused into a knowledge-based database for dissemination to those involved with asthma patients. Success with this model may lead to expansion with other diseases.

## Background

### Data mining in medical informatics

Because of their predictive power, various healthcare systems are attempting to use available data mining techniques to discover hidden relationships as well as trends in huge data available within the clinical database and convert it to valuable information that can be used by physicians and other clinical decision markers. In general, data mining techniques can learn from what was happened in past examples and model oftentimes non-linear relationships between independent and dependent variables. The resulting model provides formalized knowledge and prediction of outcome. For example, Shekar et al. used data mining based decision tree algorithm to discover the most common refractive error in both male and female [1]. Palaniappan et al. presented a prototype that combines the strengths of both an online analytical processing (OLAP) and data mining techniques for clinical decision support systems (DSS) [2]. Jonathan et al. used data mining techniques to explore the factors contributing to cost of prenatal care and outcomes [3]. Chae et al. used data mining approach analysis in health insurance domain [4]. With advanced data mining techniques to help evaluate healthcare utilization costs for employees and dependents in organizations [5].

More advanced machine learning methods, such as artificial neural networks and support vector machines, have been adopted to use in various areas of biomedical and bioinformatics, including genomics and proteomics [6]. For biological data, clustering is probably the most widely used data mining technique, such as clustering analysis, hierarchical clustering, *k*-means clustering, backpropagation neural networks, self-organization maps, fuzzy clustering, expectation maximization, and support vector machines [7, 8]. Bayesian models were widely used to classify data into predefined classes based on a set of features. Given the training examples, a Bayesian model stores the probability of each class, the probability of each feature, and the probability of each feature given each class. When a new unseen example occurred, it can be classified according to these probabilities [9, 10]. This classification technique is one of the most widely used in medical data mining. Decision tree models, such as the Iterative Dichotomiser 3 (ID3) Heuristic techniques belong to the subfield of machine learning. The ID3 Heuristic uses a technique called "entropy" to measure disorder in a set of data [11, 12]. The idea behind the ID3 Heuristic is to find the best attribute to classify the records in the data set. The outcome is learned rules and a model used to predict unseen examples based on past seen examples. Non-negative matrix factorization (NMF) has been widely used in the field of text mining applications [13, 14]. The only constraint that is unique from other methods is factorization of two matrices *W* and *H* from *V* (i.e., *nmf* (*V*) *→ WH*) must be non-negative or all elements must be equal to or greater than zero. Typically, *W* and *H* are initialized with random non-negative values to start the NMF algorithm. The convergent time is varied and local minimum is not guaranteed [15].

Here, we are working on a methodology and classification technique in data mining called Low Rank Matrix Decomposition (LRMD) to allow computer to learn from what has happened in the past APR-DRGs datasets for asthma, able to extract dominant features, and then predict outcomes. The summary of APR-DRGs and the mathematics behind LRMD is discussed further below.

### All patient refined diagnosis related groups (APR-DRGs)

APR-DRG is a grouping methodology developed in a joint effort between 3M Health Information Systems (HIS) and National Association of Children’s Hospitals and Related Institutions (NACHRI). APR-DRGs are proprietary and have the most comprehensive and complete classification of any severity of illness system for pediatric patients. It was designed to be more appropriate for general population patients than the old Diagnosis Related Group (DRG) [16]. While the DRG was designed and normed on Medicare patients only, the APR-DRG was designed and normed on a general population. We use APR-DRG based weights normed on a pediatric patient population. There are 316 APR-DRGs, such common APR-DRG codes include but not limited to 138 Bronchiolitis/RSV pneumonia, 141 Asthma, 160 Major repair of heart anomaly, 225 Appendectomy, 420 Diabetes, 440 Kidney transplant, 662 Sickle cell anemia crisis, and 758 Childhood behavioral disorder. Each group has 4 severity levels of illnesses (SOI) and 4 risk levels of mortality (ROM) while the DRG and Medicare Service – Diseases Related Groups (MS-DRG) have only a single severity and risk of mortality per group. For example, there are multiple diagnosis codes for asthma and an encounter might have asthma as principal diagnosis or a secondary diagnosis and if the encounter was primarily for asthma treatment, then the APR-DRG code will be 141 and all asthma encounters will be assigned the same APR-DRG code. In our internal system we code inpatient encounters to APR-DRG as well as DRG. We have available from our PRD back through 2009 [17], including Emergency Room (ER), Ambulatory Surgery (AS), and Observation (OBS) encounters.

## Methods

### Singular value decomposition

In general, the Singular Value Decomposition method is a method for decomposition of any matrix A∈R^{MxN} where M ≥ N in a product of UV^{T} , where U∈R^{Mxk} and V∈R^{Nxk}[18, 19]. Since any rank *k* matrix can be decomposed in such a way, and any pair of such matrices yields a rank *k* matrix, the problem becomes as an unconstrained minimization over pairs of matrices (U ,V ) with the minimization objective

Where *A*^{(k)} is a rank *k* approximation of matrix A. To find the optimum choices of U,V in *l*_{2} norm sense [20, 21], the partial derivatives of the objective *f* (*U,V*) with respect to U,V are

Solving $\frac{\partial f\left(U,V\right)}{\partial U}=0$ for U yields *U* = *AV*(*V*^{T}*V*)^{- 1}. By considering an orthogonal solution, then U = Λ is diagonal such that U = AV. Substituting back into $\frac{\partial f\left(U,V\right)}{\partial V}=0$, we have

The columns of V are mapped by *A*^{T}*A* to multiples of themselves, i.e., they are eigenvectors of *A*^{T}*A*. Therefore, the gradient $\frac{\partial f\left(U,V\right)}{\partial \left(U,V\right)}$ vanishes at an orthogonal (U,V) if and only if the columns of V are eigenvectors of *A*^{T}*A* and the column of U are eigenvectors of *AA*^{T}, scaled by the square root of their eigenvalues [18, 19]. More generally, the gradient vanishes at any (U,V) if and only if the columns of U are spanned by eigenvector of *AA*^{T} and the columns of V are spanned by eigenvector of *A*^{T}*A*. In term of the singular value decomposition, $A={U}_{o}S{V}_{o}^{T}$ the gradient vanishes at (U,V) if and only if there exist matrices ${P}_{U}^{T}{P}_{V}=I\in {R}^{\mathit{kxk}}$ such that *U* = *U*_{
O
} *SP*_{
U
} and *V* = *V*_{
O
} *P*_{
V
}. Thus, using singular eigenvectors that corresponds to the largest singular values can represent the global properties (i.e., feature vectors) of A with satisfying the minimization under *l*_{2} norm sense [19].

### Low rank matrix decomposition

Suppose that it is desired to represent matrix *X*∈*R*^{MxN} as a sum of simple rank one matrices so as to capture the nature of the matrix in which matrix *X* is to be represented by the summation of *r,* i.e., rank of matrix. In this case, the outer products can be written as:

Where *X* ∈ *R*^{M x N}, {*u*_{1}, *u*_{2}, …, *u*_{
r
}} and {*v*_{1}, *v*_{2}, …, *v*_{
r
}} vectors each represents linearly independent column vectors with dimensions M and N, respectively. The constituent outer product ${u}_{i}{v}_{i}^{T}$ is rank one in which the MxN matrix whose column (row) vectors are each a linear multiple of vector *u*_{
i
}*(v*_{
i
}*)*. To be more precise, a necessary condition is that the vector set {*u*_{
1
}*, u*_{
2
}*, …, u*_{
r
}} must form a basis for the column space of matrix X and the vector set $\left\{{v}_{1}^{T},{v}_{2}^{T},\dots ,{v}_{r}^{T}\right\}$ should form a basis for the row space of matrix X. It is noted, however, that there will exist an infinite number of distinct selections of these basis vectors for the case r ≥ 2. It then follows that there will be an infinite number of distinct ranks when the decomposition of a matrix has rank r ≥ 2. The ultimate selection to be made is typically based on the application as well as computational considerations. To provide a mathematically based method for selecting the required basis vectors, let us consider the functional relationship

For 1 ≤ *k* ≤ *r* and *p* = 1,2 where the integer *k* ranges in the interval 1 ≤ *k* ≤ *r*.

It can be readily shown that the function (6) represents a convex function of the set {*u*_{
i
}} for a fixed set of {*v*_{
i
}} and vice-versa. For the proof, please refer to [22]. The convexity property is important since it ensures that any local minimum of *f*_{
k
} (*v*) (i.e., *u* is fixed) and vice-versa is also a global minimum. With regard to the above equation, a specific selection of the vector sets {*u*_{1},*u*_{2},…,*u*_{
k
}}∈ *R*^{M} and {*v*_{1},*v*_{2},…,*v*_{
k
}}∈ *R*^{N} is to be made so as to minimize this functional. The optimal selection will then provide the best rank *k* approximation of matrix *X* in the *lp* norm sense, as designated by

This optimal matrix is said to be the best rank *k* approximation of matrix *X* in the *lp* norm sense. For convenience, we express equation (5) in a normalized form as:

Where ${\left|\right|u}_{i}^{o}{\left|\right|}_{p}={\left|\right|v}_{i}^{o}{\left|\right|}_{p}=1$ and σ_{
i
}^{o} are positive scalars. The most employed matrix decomposition procedure is the Singular Value Decomposition (SVD). The SVD method provides an effective method for mitigating the deleterious effects of additive noise and is characterized by the function *f*_{
k
}({*u*_{
i
}},{*v*_{
i
}}) in the *l*_{2} norm sense, that is

The use of the *l*_{1} norm criterion can be of practical use when analyzing data that contains data outliers. Namely, it would be useful to express this equation (9) as an objective function that optimizes the best rank *k* approximation of matrix *X*∈*R*^{MxN} as measured for the case of the *l*_{1} norm criterion. That is

In order to attempt to find the optimum solution which minimizes the objective function (10), we introduce a concept, called Alternating Optimization, This optimization concept is explained a detailed below.

### Alternating optimization

We can rewrite the equation (10) in term of matrices U and V as *f* (*U*, *V*) = ||*X* - *UV*^{T}||_{1} by fixing U, then objective function becomes:

Where $X=\left[{\stackrel{\rightharpoonup}{x}}_{{}_{1}}\phantom{\rule{0.12em}{0ex}}{\stackrel{\rightharpoonup}{x}}_{{}_{2}}.\phantom{\rule{0.36em}{0ex}}.\phantom{\rule{0.36em}{0ex}}.\phantom{\rule{0.36em}{0ex}}.\phantom{\rule{0.36em}{0ex}}.{\stackrel{\rightharpoonup}{x}}_{{}_{n}}\right],V=\left[{\stackrel{\rightharpoonup}{v}}_{{}_{1}}\phantom{\rule{0.12em}{0ex}}{\stackrel{\rightharpoonup}{v}}_{{}_{2}}.....{\stackrel{\rightharpoonup}{v}}_{{}_{k}}\right]$ and similarly the column of *V*^{T} are denoted by ${V}^{T}=\left[{\tilde{v}}_{1}\phantom{\rule{0.12em}{0ex}}{\tilde{v}}_{2}.\phantom{\rule{0.5em}{0ex}}.\phantom{\rule{0.5em}{0ex}}.\phantom{\rule{0.5em}{0ex}}.\phantom{\rule{0.5em}{0ex}}.{\tilde{v}}_{n}\right]$. It is straightforward to see that f (V) can be rewritten as a sum of independent criteria

where each $\left|\right|{\tilde{x}}_{i}-{U}_{\mathit{fix}}{\tilde{v}}_{i}{\left|\right|}_{1}$ term may be minimized independently by selecting an appropriate. The solution method for each of these subproblems is given in [23]. Grouping the resulting ${\tilde{v}}_{i}$ together to obtain *V*^{T}, we get a solution for equation (11). On the other hand, by fixing V, the objective function can be expressed as:

And a similar method may be used to solve for U. The iteration process proceeded by finding ${\tilde{v}}_{i}$ and then finding ${\tilde{u}}_{i}$ (i.e., the alternating optimization) is continued until a stopping criterion is met (i.e., the matrix from two successive iterations are sufficiently close). For example, $\left|\right|{X}_{i-1}^{\left(k\right)}-{X}_{i}^{\left(k\right)}{\left|\right|}_{2}<\mathrm{\u03f5},\mathrm{\u03f5}={10}^{-7}$. However, it must be noted that finding a global minimum is not guaranteed. In the following section, we establish a guideline for selection of the stopping criteria.

### Selection criterion

In this section, let us direct our attention to the selection criteria for the initial choice for *U*, where *U*∈*R*^{Mxk}. We note that for the following cases where (i) rank *k* = 1 approximation and (ii) rank 1 < *k ≤ r*, then *r =* rank (*X*). In order to take the global data into account, a good choice of initial value of *U* for a rank *k* = 1 (i.e., *U*∈*R*^{Mx1}) approximation may be obtained as follows. First, we compute the *l*_{1} norm of each column vector in *X*, and denoted this norm by ${x}_{1}^{c},{x}_{2}^{c},\dots ,{x}_{n}^{c}$. Next compute the *l*_{1}norm of each row vector in *X*, and denoted this norm by ${x}_{1}^{r},{x}_{2}^{r},\dots ,{x}_{m}^{r}$. Now we find the maximum value in $\left\{{x}_{1}^{c},{x}_{2}^{c},{x}_{n}^{c},{x}_{1}^{r},{x}_{2}^{r},\dots ,{x}_{m}^{r}\right\}$. If the maximum corresponds to a column norm, say from column j, then chose that column (i.e., *U* = *X* (:,*j* )) as the initial choice for *U*. If the maximum corresponds to a row norm, say row I, then we start with the transposed form of the criterion in (11) and we chose that row (i.e., *V*^{T} = *X* (*i*,:)) as the initial choice for *V*^{T}. We can also extend the previous concept to find the initial choice for *U* for the rank *k* = 2. Essentially, we apply the rank one approximation twice in succession. Therefore our objective function can be expressed as:

Where *U* = [*u*_{1}*u*_{2}] and *V* = [*v*_{1}*v*_{2}], *u*_{1},*u*_{2},*v*_{1},*v*_{2} are vectors. Therefore the initial choice for U (rank *k =* 2) is *U* = [*u*_{1}*u*_{2}] (i.e., two largest *l*_{1} column or row norm). In a similar fashion, a selection criterion for the initial for U for rank *k* (1 *< k ≤ r* ) can be also obtained. Thus the column space of *X* (i.e., U) represents a feature vector that is considered as a global property (i.e., the best low rank approximation) of *X* that minimizes the above objective function under *l*_{1} norm sense [22].

### Convergence subsequence

The error sequence happened in each iteration can be expressed as:

Since the error sequence is bounded below (i.e., *E*(*U,V*) ≥0)) we have

And lim _{i → ∞}*E*_{
i
} = *E*_{
final
} ≥ 0. Therefore the entire infinite length sequence lies inside a hypersphere (i.e., a closed and bounded set of points) of finite volume centered at *X* and with a radius of *E*_{1}. Since this hypersphere has finite volume, it is possible to construct a finite number of smaller hypersphere, each with radius ϵ > 0, such that the union of all these small hyperspheres contains the large hypersphere of radius *E*_{1}. For all ϵ > 0 there will be at least one hypersphere of radius ϵ containing an infinite number of points of the sequence. Thus, there is at least one cluster point. The cluster point is the limit of a convergent subsequence. Therefore, we know that the sequence of *X*_{
i
}^{(k)}, produced by the algorithm must contain at least one convergent subsequence.

### Feature extraction methodology

For the purpose of this preliminary study, we acquired de-identified data sets from PRD that demonstrate patient visits in year 2012. The total number of observations includes 92,175 encounters. Among all encounters, we selected encounters that have APR-DRG code = 141 Asthma, 144 Respiratory signs & minor diagnoses, 131 Cystic fibrosis – pulmonary disease, and 132 BPD & chronic respiratory for our initial datasets. The total number of meeting criteria is 8,895 encounters for 7,011 distinct patient records (see Figure 1 and Figure 2). Among all patients, 57.8% (4,052) were male, 11.7% (817) were white, and 81.1% (5,685) were black or African-American. The PRD has the UTHSC Institutional Review Board (IRB) approval for the creation and maintenance of the database. The waiver applies to the medical records of patients who received care in 2009 or later.

The text parsing software and natural language toolkit [24] (written in Python) were used to parse all encounter data sets for this preliminary study. If *X =* [*x*_{ij}] defines the *m* × *n* term-by-encounter matrix for decomposition. Each element or component *x*_{ij} of the matrix *X* defines a weighted frequency at which term *i* occurs in encounter *j*, where term *i*∈ {gender, age, discharge status, admitting diagnosis, secondary diagnoses, principal diagnosis, principal procedure, secondary procedures}. The corpus stop words from NLTK were used to filter out unimportant terms.

In evaluating the classification performance, we randomly selected subset 1,200 encounters and divided into a number of four subsets of equal size (i.e., four-fold cross validation). The system is trained and tested for four iterations (see Figure 3).

In each iteration, three subsets of data are used as training data and the remaining set is used as testing data. In rotation, each subset of data serves as the testing set in exactly one iteration. The rank *U* used to test the LRMD was *k* = 4. Hence, the *U* and *V* matrix factors were number of terms × 4 and 4 × 1200, respectively. The percentage of possible asthma encounters used for training in our testing was 900 encounters and the remaining 300 encounters were used for testing our classifier. The initial matrix factors *U* and *V* were selected to meet our Selection criterion (see Selection Criterion) and alternating iteration was continued until the matrix from two successive iterations are sufficiently close (see Alternating optimization). All classification results were obtained using Python version 2.7.4.

## Results

Table 1 demonstrates an example of dominant features for the classifier, when applied to training data sets (randomly selected 900 out of a 1,200 encounters). We note that among all features, admitting diagnosis = 786.07 (wheezing), secondary diagnosis = 786.05 (shortness of breath), age 4–8, and having family history of asthma (ICD-9-CM = v175) would potentially progress toward asthma, i.e., APR-DRG code = 141 asthma. The 2nd Feature shows asthma patients with pneumonia condition (ICD-9-CM = 486.00) during the length of stay in a hospital. The 4th Feature demonstrates the connection between asthma symptoms and another pulmonary condition known as bronchitis symptom (ICD-9-CM = 466.0). When the two conditions co-exist, bronchitis can cause patients with asthma to make their asthma symptoms worse, i.e., an asthma attack.

To evaluate the performance of our classifier for this preliminary study, we plot a receiver operating characteristic (ROC). Figure 4 shows the receiver operating characteristic (ROC) curves (true positive rate versus false positive rate).

Our goal is to maximize the number of true positives (correctly diagnosed asthmas) with an acceptable number of false positives (false alarm). From Table 2 and Figure 4, we note that as sensitivity goes up, a specificity goes down. We can begin to see the trade-offs when we insist an higher sensitivity (fewer missed asthmas) the result is lower specificity, and more false positive. In practice, it is much worse to miss a asthma than to endure unnecessary treatment, so we tend to choose a higher sensitivity cut off (e.g., cutoff score > 0.65 or > 0.75). As it is apparent from Table 2, LRMD yields very promising results for disease identification and classification. However, we still have much work to do to enhance the LRMD classifier and it is discussed further below.

## Discussion

The results presented in this paper should not be taken as an accurate representation of our patient data (as it does not include all the data records). These data are meant to demonstrate the potential of PRD and the feasibility of data mining technique using LRMD. Additional experiments with a larger number of features (rank *k* > 4) and encounter data sets (2009 – 2012) should produce better models to capture the diversity of contexts described by those encounters. Using ICD-9-CM has limitations because they are generally used for billing purposes and not for clinical research. We are planning to access free-text fields in the near future, such as physician and clinician notes, and include them into our classifier. Additional socio-demographic variables such as incomes, type of insurance, environment, nutrition, genome and comorbidity covariants could potentially be added to the model to support the evaluation of potential causes for readmission.

## Conclusions

Using data mining technique to learn from past examples within rich data sources such as electronic medical records not only permits users to detect expected events, such as might be predicted by models, but also helps users discover the unexpected patterns and relationships that can then be examined and assessed to develop new insights. We hope that learned rules from the LRMD technique will greatly advance progress toward the goal of identifying high risk of pediatric asthma patient and help support clinical decisions.

## References

- 1.
Chandra Shekar DV, Sesha Srinivas V: Clinical Data Mining An Approach for Identification of Refractive Errors. 2008, Hong Kong: Proceedings of the International MultiConference of Engineers and Computer Scientists 2008 Vol I IMECS 2008, 19-21 March

- 2.
Palaniappan S, Ling C: Clinical Decision Support Using OLAP With Data Mining. IJCSNS International Journal of Computer Science and Network Security. September 2008, 8: 9-

- 3.
Prather JC, et al: Medical data mining: knowledge discovery in a clinical data warehouse. Proc AMIA Annu Fall Symp. 1997, 101-105.

- 4.
Chae YM, et al: Data mining approach to policy analysis in a health insurance domain. Int J Med Inform. 2001, 62 (2-3): 103-111. 10.1016/S1386-5056(01)00154-X.

- 5.
Hedberg SR: The data gold-rush. Byte. 1995, 20 (10): 83-88.

- 6.
Mohri M, Rostamizadeh A, Talwalkar A: Foundations of Machine Learning. 2012, New York: The MIT Press

- 7.
Huang Z: Extensions to the

*k*-means algorithm for clustering large data sets with categorical values. Data Mining and Knowledge Discovery. 1998, 283: 304- - 8.
Jain AK, Murty MN, Flynn PJ: Data Clustering: A Review. 1999, ohio: ACM computing surveys

- 9.
Neapolitan RE: Learning Bayesian Networks. 2004, Illinois: Prentice Hall

- 10.
Gelman A: A Bayesian formulation of exploratory data analysis and goodness-of-fit testing. International Statistical Review. 2003, 71 (2): 369-382.

- 11.
Tom M: Machine Learning. 1997, McGraw-Hill, 55-58.

- 12.
Grzymala-Busse JW: Selected algorithms of machine learning from examples. Fundamenta Informaticae. 1993, 18: 193-207.

- 13.
Liu WX, et al: Nonnegative matrix factorization and its applications in pattern recognition. Chinese Science Bulletin. 2006, 51 (1): 7-18. 10.1007/s11434-005-1109-6.

- 14.
Cemgil AT: Bayesian inference for nonnegative matrix factorisation models. Comput Intell Neurosci. 2009, 785152-

- 15.
Berry MW, Gillis N, Glineur F: Document Classification Using Nonnegative Matrix Factorization and Underapproximation. 2009, IEEE

- 16.
Sedman AB, Bahl V, Bunting E, Bandy K, Jones S, Nasr SZ, Schulz K, Campbell DA: Clinical redesign using all patient refined diagnosis related groups. Pediatrics. 2004, 114 (4): 965-969. 10.1542/peds.2004-0650.

- 17.
Viangteeravat T: Giving Raw Data a Chance to Talk: A demonstration of de-identified Pediatric Research Database and exploratory analysis techniques for possible cohort discovery and identifiable high risk factors for readmission. Proceeding of 12TH Annual UT-ORNL-KBRIN Bioinformatics Summit. 2013

- 18.
Srebro N, Jaakkola T: Weighted Low Rank Approximation. 2003, Washington DC: Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003)

- 19.
Young E: Singular Value Decomposition. http://www.schonemann.de//svd.htm,

- 20.
Cadzow JA: Signal enhancement: a useful signal processing tool Spectrum Estimation and Modeling. Fourth Annual ASSP Workshop. 1988, 162: 167-

- 21.
Cadzow JA: Minimum l(1), l(2), and l(infinity) norm approximate solutions to an overdetermined system of linear equations. Digital Signal Processing. 2002, 12 (4): 524-560. 10.1006/dspr.2001.0409.

- 22.
Viangteeravat T: Discrete Approximation using L1 norm Techniques. 2000, Master Thesis: Electrical Engineering, Vanderbilt University

- 23.
Cadzow JA: Application of the l1 norm in Signal Processing". Department of Electrical Engineering. 1999, Nashville: Vanderbilt University

- 24.
Perkins J: Python Text Processing with NLTK 2.0 Cookbook. 2010, Birmingham: Packt Publishing

## Acknowledgements

The author thanks the UTHSC department of ITS Computing Systems and Office of Biomedical Informatics for use of informatics resources and collaborations. We gratefully acknowledge Rae Shell and Grady Wade for assistance on proofreading and providing good comments. This work was supported by the Children’s Foundation Research Institute (CFRI).

## Author information

## Additional information

### Competing interests

The author declares that they have no competing interests.

## Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

## Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## About this article

#### Received

#### Accepted

#### Published

#### DOI

### Keywords

- Clinical research
- Translational research
- Medical informatics
- Biomedical informatics
- Machine learning
- Data mining
- Feature extraction
- Classification