SN algorithm: analysis of temporal clinical data for mining periodic patterns and impending augury
© Sengupta and Naik; licensee BioMed Central Ltd. 2013
Received: 27 September 2013
Accepted: 25 November 2013
Published: 28 November 2013
EHR (Electronic Health Record) system has led to development of specialized form of clinical databases which enable storage of information in temporal prospective. It has been a big challenge for mining this form of clinical data considering varied temporal points. This study proposes a conjoined solution to analyze the clinical parameters akin to a disease. We have used “association rule mining algorithm” to discover association rules among clinical parameters that can be augmented with the disease. Furthermore, we have proposed a new algorithm, SN algorithm, to map clinical parameters along with a disease state at various temporal points.
SN algorithm is based on Jacobian approach, which augurs the state of a disease ‘Sn’ at a given temporal point ‘Tn’ by mapping the derivatives with the temporal point ‘T0’, whose state of disease ‘S0’ is known. The predictive ability of the proposed algorithm is evaluated in a temporal clinical data set of brain tumor patients. We have obtained a very high prediction accuracy of ~97% for a brain tumor state ‘Sn’ for any temporal point ‘Tn’.
The results indicate that the methodology followed may be of good value to the diagnostic procedure, especially for analyzing temporal form of clinical data.
KeywordsAssociation rule mining Clinical informatics Data mining Jacobian Jacobian determinant Temporal
Advancement in clinical research and diagnostic processes produce large amount of data that are heterogeneous in nature . The data obtained from a patient generally include patient complaints, history, clinical symptoms and signs, physician’s examinations, biochemical analyses, imaging profiles, pathologies, therapies and other measurements  pertaining to clinical diagnostics. Since there is lack of integration of these data, the importance and relationships among the clinical parameters pertaining to occurrence of diseases is difficult to analyze. Immense efforts have been made recently to address the issues concerning to extract information from these heterogeneous clinical data. Henceforth, development of novel informatics techniques based on mathematical or statistical models are essential. This development will provide a better understanding of the complex nature of diseases and guide in more accurate & improved diagnosis for better therapies.
Path breaking step in the field of clinical informatics was the development of EHR/EMR (Electronic Health/Medical Records) which led to evolution of information technology in the field of clinical sciences . As an effort to facilitate access to this wealth of information, data warehouses were developed that contained clinical data from healthcare organizations . The enormous amount of data collected by EHR/EMR provides additional value when integrated and stored in data warehouses suitable for data mining techniques such as co-occurrence analysis and association mining. As an archetype, National Cancer Institute has developed a medical knowledge information system integrated with data mining applications . Similarly, New York-Presbyterian Hospital is using an electronic health record system for the past several years and maintaining a longitudinal record for each patient . Congruous mining techniques such as co-occurrence statistics analyzes the importance of clinical data associations together systematically rather than random combinations . Similarly, technique using association rule mining is a general purpose rule discovery scheme and has been widely used for discovering rules based on the importance of finding disease co-occurrences.
Crucial to mining in clinical informatics is to use background knowledge to discover interesting interpretable and non-trivial relationships, to construct rule-based and other symbolic-type models that can be reviewed and scrutinized by experts, to discover models that offer an explanation when used for prediction and, also to bridge model discovery and decision support to deploy predictive models in daily clinical practice . Among the various mining approaches, predictive data mining approach is gaining impulse among the researchers and clinical practitioners as it utilizes the knowledge available in the clinical domain and explains proposed decision for the proposed model . The goal of predictive data mining in clinical medicine is to derive models that can use patient specific information to predict the outcome of interest and thereby support clinical decision-making . Among the various approaches, Naive Bayesian classifier is one of the earliest designed approach that is based on probability. It is one of the simplest yet a useful and often a fairly accurate predictive data mining method. However, since it is dependent on the type of data subjected to mining, it may be inclined in case of biased clinical data set . Another popular data mining technique is decision tree which is based on recursive data partitioning, where in each iteration the data is split according to the value of a selected clinical attribute. However, its performance is impacted because of clinical data segmentation . Logistic regression is another powerful and well-established statistical method used in predictive clinical mining. It is an extension of normal regression method that models a two-valued outcome for occurrence or non-occurrence of some event. It is based on multiplicative probability model that utilizes maximum likelihood estimation to determine the coefficients in its probability formula. Handling of the missing values usually causes problem in this approach . For a long period artificial neural network models were the most popular artificial intelligence-based predictive algorithm used in clinical medicine. Albeit they have a number of deficiencies that include high sensitivity to the parameters of the method - including those that determine the architecture of the network and induction of the model that may be hard to interpret by domain experts . Support vector machines (SVM) are perhaps today’s most powerful classification algorithm in terms of predictive accuracy and most popular in clinical informatics. However, the exception are linear kernels, where the structure of the model can be easily revealed through the coefficients that define a linear hyperplane, and it use a formalism that is often unsuitable for interpretation by human experts .
An interesting prospective in these predictive mining of heterogeneous clinical data would be an approach that could analyse the temporal form. The discovery of hidden periodic patterns in temporal data, apart from unveiling important information, can facilitate data management substantially . However, very limited work has been done so far on data mining of temporal data, which demonstrates generalization of pattern mining in time-series data . For instance, we can model the change of climatic conditions in a spatial region as a sequence of existing or a past set of values. Periodicity has only been studied in the context of temporal analysis of time-series based databases that addressing the following problem: given a long sequence S and a period T, the aim is to discover the most representative trend that repeats itself in S every T timestamps . This uses a tree structure to count the support of multiple patterns at two database points and comparatively studies the problem of finding sets of events that appear together periodically . However, it does not take into consideration the order of occurrence of events. Whereas, in case of temporal clinical data it is necessary to consider specific order of occurrence of events that are associated with the state of a disease. Considering the given scenario, SN algorithm proposed in this study, is a novel predictive data mining algorithm based on Jacobian approach. It will traverse selective clinical parameters at different temporal points to augur the possible “STATE” of the disease. The advantage of this algorithm over existing predictive techniques like logistic regression or ANN or SVM is that it is independent of coefficients for prediction. Moreover, it keeps a track of previous versus new information i.e. for a given patient it predicts the corresponding state of the disease based on the value of input clinical parameters along with the state of the disease at previous temporal point.
In this study we have defined the temporal mining problem of clinical data in terms of (a) discovery of associative rules for clinical parameters, which can be associated with a specific disease (clinical parameters are discovered by apriori association mining); and (b) an algorithm for traversing the clinical parameters of temporal points ‘T’ (T0, T1 … Tn) in order of their occurrences, alongwith mapping the values observed for each point with the previous one. This helps in auguring the state of a specific disease at point Tn whose result is unknown. To predict the state of a disease at point Tn, we propose a new algorithm (we termed it as ‘SN algorithm’) based on Jacobian transformation by considering different temporal points, in which Jacobian of selected clinical parameters are associated with the state of that disease. Hence, derivatives ‘J’ (J0, J1…) of temporal points ‘T’ (T0, T1 …) along with respective states ‘S’ (S0, S1....) are mapped with a future point (Tn) Jacobian (Jn) and finally its determinant (J”) is calculated to obtain a possible state (Sn).
Data warehouse development
Approval was obtained from joint institutional review board of hospitals under Indira Gandhi Medical College, Himachal Pradesh, India (IGMC Study Approval No.: HFW(MC-II)G-7/07-Vol. IV-17754) and patient consent was taken for using the clinical data. Clinical data for all the human subjects have been analyzed anonymously. Based on NOC (No objection certificate) received from the hospitals in India, all the patient information was received corresponding to IDs (Identification Number). There is no disclosure of the hospital names or patient information in this study.
An in-house data warehouse was developed using MySQL (v5.019) to store the clinical data collected from various Government Hospitals across India. By nature this data is heterogeneous and obtained in different forms, such as printed & manual reports, doctor’s advice & prescription, images in form of CT scan, MRI, etc. As there are no EHR/EMR system implemented in these hospitals, data were collected in form of hard copies and then manually entered into the electronic form. Accuracy of data is an important criteria to be considered during development of a clinical warehouse especially when there are no EHR/EMR implemented . Data incorrectness usually exists because of design or operational deficiency and can be identified where the mapping between the information system state and the real world state break down . Henceforth, with utmost care the dimensional model (data model) of the clinical warehouse was designed based on the descriptive and measurable features of the clinical data . Further, it consists of date and time dimension that ensures temporal storage of data for a patient. Also, to check the operational deficiencies, the quality assurance of data was ensured by implementing appropriate data processing codes for range and data validation checks , re-entering samples of data to assess for accuracy, checks for data completeness and attention for data consistency .
The warehouse is integrated with the data mining process for analysis. Data were preprocessed, normalized based on prescribed clinical ranges  and analyzed for identification of associative clinical rules for disease. The parameters identified to be associated with the state of the disease were used to map at different temporal points based on SN algorithm which in turns help in auguring the state of the disease.
This study focuses on identification of clinical parameters that can be associated with progressive state of a disease by implementing association mining algorithm. It is a popular data mining technique  that tries to find interesting patterns in large databases . The Apriori algorithm exploits the downward closure property, which states that if an item set is infrequent, all of its supersets must be infrequent too. The classic framework for association rule mining uses support and confidence as thresholds for constraining the search space. Each item set has an associated statistical measure called support. For an itemset X ⊂ I, support(X) = s, if the fraction of transactions in the dataset D containing X = s . The confidence of an association rule X = > Y in D is the conditional probability of having Y contained in a transaction, given that X is contained in that transaction: confidence (X= > Y) = P (Y|X) = support(XY)/support(X) . A confidence value of 100 for a certain rule means that the possibility of obtaining outcome Y when X is a given condition (X → Y) is 100%; if not, the possibility of A → B is defined as a value (possible rule) between 0 and 100.
It is arduous to predispose appropriate criteria for any two parameters in association rule mining, because information is obtained based on a minimum threshold for support and confidence . As such, in this study, the frequent item sets were discovered based upon selected parameters for preprocessed clinical dataset that were subjected to confidence of atleast 50%, when the minimum support was defined to 30%. STATISTICA DATAMINER 9.1  was used to calculate the frequency of each item set with support% criteria of at least 30 along with head and body iteration rate of 10. All frequent item sets obtained were subjected for the discovery of association rules. The final confidence to deduce rule was set to at least 85% through a physician’s opinion and the process was executed with antecedent and precedent iteration rate of value 10.
With an input of set of temporal points (T0, T1, T2,....,Tn), a set of selected clinical parameter values (P0, P1, P2,…, Pn) for a patient along with the state of disease (S0, S1, S2,…,Sn) is chosen for each temporal point, where State ‘Sn’ is unknown for the point Tn.
Jacobian transformation is applied over the set of selected parameters (P0, P1, P2,…, Pn) for each of the temporal point ‘T’ to obtain the Jacobian.
Jacobian (J0, J1, J2, …, Jn) for each temporal point along with state of disease ‘S’ is then mapped to the values of other temporal point.
Jacobian determinant (J”) is then determined based on the mapping done in step iii for predicting augury of state Sn for point Tn.
Mathematically, Jacobian, mapping of Jacobian in time-space as area and estimation of its determinant for area can be explained as follows .
Let dA denote the area of the parallelogram spanned by dx and dy parameter, then dA approximates the area of T (R) for du and dv sufficiently close to 0.
Result & discussion
Association rules mined for various diagnostic parameters that are associated with the occurrence of brain tumor in patients
KFT_Creatinine = HIGH == > KFT_BUN = HIGH
KFT_Creatinine = HIGH == > STATE = 1
KFT_BUN = HIGH == > STATE = 1
KFT_Creatinine = HIGH, KFT_BUN = HIGH == > STATE = 1
LFT_SGOT = HIGH == > STATE = 1
LFT_SGOT = HIGH == > LFT_SGPT = HIGH, STATE = 1
LFT_SGPT = HIGH == > STATE = 1
Haemoglobin_content = NORMAL == > STATE = 1
Temporal points along with various selected clinical parameters corresponding to brain tumor
P1, T1, c1, b1, s1, g1
P2, T1, c’1, b’1, s’1, g’1
P55, T1, c”1, b”1, s”1, g”1
P1, T2, c1′, b1′, s1′, g1′
P2, T2, c’2′, b′2′, s’2′, g’2′
P55, T2, c”2′, b”2′, s”2′, g”2′
P1, T3, c1″, b1″, s1″, g1″
P2, T3, c’3″, b’3″, s’3″, g’3″
P55, T3, c”3″, b”3″, s”3″, g”3″
L (c, b, s, g) is the transformation with Jacobian J (c, b, s, g) applied for each predicted state So(S1, S2, S3). Jacobian is calculated for each of the functional parameter (c,b,s,g) of the first temporal point T1 which is mapped with the state S1 (S’1 is selected to map the initial state of disease at first temporal point i.e. S1 = S’1) as area curve. J1 (c1,b1,s1,g1) is the Jacobian for patient ’P1′ at time ‘T1’ that is mapped to the state of the disease ‘S1′. Similarly for the second temporal point ‘T2′, Jacobian J2 (c1′, b1′, s1′, g1′) is to be mapped with S2 (represented by area dA) for patient ‘P1′. Based on the cross product of Jacobian for point T1 and T2, the differential area ‘dA’ is mapped as Jacobian determinant to obtain S2 state. The accuracy of predicted state S2 based on SN algorithm was 100% when compared to observed S’2 state (Additional file 1). However, for the third temporal point only Jacobian J3 (c1”, b1”, s1”, g1”) for the parameters was obtained and S’3 result was in a hidden state. To obtain the S3 predicted state, differential area was mapped as Jacobian determinant based on cross products of Jacobian for points T2 and T3. Predictability of the S3 state with the hidden S’3 state was 92.7% accurate (Additional file 1). Thus, the proposed algorithm is helping in auguring the state of disease for brain tumor patients, independent of results from MRI, CT scan, arteriogram or small dime craniotomy based on temporal values for Creatinine, BUN, SGOT & SGPT clinical parameters.
Where, n - > number of temporal points analyzed for given set of parameters.
The estimated time complexity of the proposed SN algorithm suggests minimal execution time for auguring the STATE of disease at a particular temporal point. However, increasing the number of temporal point will directly proportionate the execution time.
In this study, temporal mining problem associated with clinical data was raised as a research problem, corresponding to which SN algorithm has been proposed. The algorithm is based on Jacobian and mapping of its derivative as area. The accuracy of the algorithm was evaluated using a data set of 55 patients suffering from brain tumor. Using this algorithm we have achieved 100% accuracy in predicting the progression of brain tumor at 2nd temporal point by mapping with the Jacobian derivative of 1st temporal point. In contrast, we have predicted the disease progression with an accuracy of 92.7% at 3rd temporal point based on 2nd temporal point. Taken together, the algorithm developed in this study hold a great potential in monitoring the state of disease based on regular input values for minimal set of clinical parameters. However, the effectiveness of the algorithm needs to be further evaluated by analyzing the parameters associated with other diseases and analyzing it over various temporal points for a group of patients.
Written informed consent was obtained from the patient for the publication of this report and any accompanying images.
Artificial neural network
Blood urea nitrogen
Electronic health/medical record
Kidney functionality test
Liver functionality test
Magnetic resonance imaging
No objection certificate
Serum glutamic oxaloacetic transaminase
Serum pyruvic transaminase
Support vector machine.
We would like to thank Dr. Pradeep Kumar Pandey, Dept. of Mathematics, Jaypee University of Information Technology, Waknaghat, Solan, India for his kind inputs and help provided to understand the concept of Coordinate transformations and Jacobian’s. We would also like to thank Prof. (Dr.) M.C.Pant from Ram Manohar Lohia Hospital, Lucknow, India who provided the technical guidance corresponding to aspects of brain tumor and other clinical parameters during the course of this study.
- Wang X, Liotta L: Clinical bioinformatics: a new emerging science. J Clin Bioinforma. 2011, 1 (1): 1-10.1186/2043-9113-1-1. doi:10.1186/2043-9113-1-1PubMed CentralView ArticlePubMedGoogle Scholar
- Schwarz E, Leweke FM, Bahn S, Liò P: Clinical bioinformatics for complex disorders: a schizophrenia case study. BMC Bioinforma. 2009, 10 (12): S6-doi: 10.1186/1471-2105-10-S12-S6View ArticleGoogle Scholar
- Atherton J: Development of the electronic health record. American Medical Association Journal of Ethics. 2011, 13 (3): 186-189.PubMedGoogle Scholar
- Evans RS, Lloyd JF, Pierce LA: Clinical use of an enterprise data warehouse. AMIA Annu Symp Proc. 2012, 189: 98-Google Scholar
- Houston AL, Chen H, Hubbard SM, Schatz BR, Tobund NG, et al: Medical Data Mining on the Internet: research on a cancer information system. Artif Intell Rev. 1999, 13: 437-466. 10.1023/A:1006548623067.View ArticleGoogle Scholar
- Holmes AB, Hawson A, Liu F, Friedman C, Khiabanian H, et al: Discovering disease associations by integrating electronic clinical data and medical literature. PLOS One. 2011, 6: 6-View ArticleGoogle Scholar
- Bellazzi R, Zupanb B: Predictive data mining in clinical medicine: current issues and guidelines. International journal of medical informatics. 2008, 77: 81-97. 10.1016/j.ijmedinf.2006.11.006.View ArticlePubMedGoogle Scholar
- Kononenko I: Inductive and Bayesian learning in medical diagnosis. Appl Artif Intelligen. 1993, 7: 317-337. 10.1080/08839519308949993.View ArticleGoogle Scholar
- Breiman L: Classification and Regression Trees. 1993, Boca Raton: Chapman & HallGoogle Scholar
- Hosmer DW, Lemeshow S: Applied Logistic Regression, (2nd ed.). 2000, New York: WileyView ArticleGoogle Scholar
- Schwarzer G, Vach W, Schumacher M: On the misuses of artificial neural networks for prognostic and diagnostic classification in oncology. Stat Med. 2000, 19: 541-561. 10.1002/(SICI)1097-0258(20000229)19:4<541::AID-SIM355>3.0.CO;2-V.View ArticlePubMedGoogle Scholar
- Cristianini N, Taylor JS: An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. 2000, Cambridge: Cambridge University PressView ArticleGoogle Scholar
- Mamoulis N, Cao H, Kollios G, Tao Y, Hadjieleftheriou, et al: Mining, indexing, and querying historical spatiotemporal data. Knowledge discovery and data mining. 2004, 236: 245-Google Scholar
- Peng WC, Chen MS: Developing data allocation schemes by incremental mining of user moving patterns in a mobile computing system. IEEE Trans Knowl Data Eng. 2003, 15 (1): 70-85. 10.1109/TKDE.2003.1161583.View ArticleGoogle Scholar
- Indyk P, Koudas N, Muthukrishnan: Identifying representative trends in massive time series data sets using sketches. Proc. of Very Large Data Bases. 2000, Cairo, Egypt: 26th VLDB Conference, 363-372.Google Scholar
- Ma S, Hellerstein JL: Mining partially periodic event patterns with unknown periods. Proc. of International Conference on Data Engineering. 2001, Heidelberg: Data Engineering, 205-214. doi: 10.1109/ICDE.2001.914829Google Scholar
- Leitheiser RL: Data quality in health care data warehouse environments. Proc. of the 34th Hawaii International Conference on System Sciences. 2001, Hawaii: System Sciences, doi: 10.1109/HICSS.2001.926576Google Scholar
- Sengupta D, Arora P, Pant S, Naik PK: Design of dimensional model for clinical data storage and analysis. Applied Medical Informatics. 2013, 32 (2): 47-53.Google Scholar
- Marshall WJ: Clinical Biochemistry: Metabolic and Clinical Aspects. 2008, UK: Churchill Livingstone, 2Google Scholar
- Gliklich RE, Dreyer NA: Data Collection and Quality Assurance, Registries for Evaluating Patient Outcomes: A User’s Guide. 2010, Rockville: AHRQ Publication No.10-EHC049, 2Google Scholar
- Borgelt C: Simple algorithms for frequent item set mining. Advances in machine learning II. 2010, Berlin: Springer, 351-369. doi: 10.1007/978-3-642-05179-1_16View ArticleGoogle Scholar
- Goethals B: Survey on frequent pattern mining. 2003, Univ. of Helsinki, http://adrem.ua.ac.be/~goethals/software/survey.pdf,Google Scholar
- Agrawal R, Srikant R: Fast algorithms for mining association rules. 1994, Santiago, Chile: 20th VLDB Conference, 487-99.Google Scholar
- StatSoft, Inc: STATISTICA (data analysis software system), version 9.1. 2010, http://www.statsoft.com,Google Scholar
- Kinsley J: Multivariable Calculus Online adapted from Calculus: A Modern Approach. http://math.etsu.edu/multicalc/prealpha/,
- Sengupta D, Sood M, Vijayvargia P, Naik PK: Association rule mining based study for identification of clinical parameters akin to occurrence of brain tumor. Bioinformation. 2013, 9 (11): 555-9. 10.6026/97320630009555.PubMed CentralView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.