Tools for Educational Data Mining
Journal of Educational and Behavioral StatisticsPublished 20 September 2016Open access
Stefan Slater, Srécko Joksimovíc, Vitomir Kovanović, Ryan S. Baker, Dragan Gašević
Citations184
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Some of the most widely used, most accessible, and most powerful tools available for the researcher interested in conducting EDM/LA research are highlighted.
Abstract
In recent years, a wide array of tools have emerged for the purposes of conducting educational data mining (EDM) and/or learning analytics (LA) research. In this article, we hope to highlight some of the most widely used, most accessible, and most powerful tools available for the researcher interested in conducting EDM/LA research. We will highlight the utility that these tools have with respect to common data preprocessing and analysis steps in a typical research project as well as more descriptive information such as price point and user-friendliness. We will also highlight niche tools in the field, such as those used for Bayesian knowledge tracing (BKT), data visualization, text analysis, and social network analysis. Finally, we will discuss the importance of familiarizing oneself with multiple tools—a data analysis toolbox—for the practice of EDM/LA research.
Keywords
Computer Science
Elsevier eBooksData Mining: Practical Machine Learning Tools and Techniques
25,718 Citations2011Ian H. Witten, Eibe Frank
The Stanford CoreNLP Natural Language Processing Toolkit
7,238 Citations2014Christopher D. Manning, Mihai Surdeanu +4 more
The design and use of the Stanford CoreNLP toolkit is described, an extensible pipeline that provides core natural language analysis, and it is suggested that this follows from a simple, approachable design, straightforward interfaces, the inclusion of robust and good quality analysis components, and not requiring use of a large amount of associated baggage.
Journal of Language and Social PsychologyThe Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
5,776 Citations2009Yla Tausczik, James W. Pennebaker
Empirical results using LIWC demonstrate its ability to detect meaning in a wide variety of experimental settings, including to show attentional focus, emotionality, social relationships, thinking styles, and individual differences.
Communications of the ACMProbabilistic topic models
5,549 Citations2012David M. Blei
Surveying a suite of algorithms that offer a solution to managing large document archives suggests they are well-suited to handle large amounts of data.
Journal of Educational and Behavioral StatisticsComputational Tools for Probing Interactions in Multiple Linear Regression, Multilevel Modeling, and Latent Curve Analysis
5,012 Citations2006Kristopher J. Preacher, Patrick J. Curran +1 more
An overview of methods used to probe interaction effects and a unified collection of freely available online resources that researchers can use to obtain significance tests for simple slopes, compute regions of significance, and obtain confidence bands across the range of the moderator in the MLR, HLM, and LCA contexts are described.
Discourse ProcessesAn introduction to latent semantic analysis
4,817 Citations1998Thomas K. Landauer, Peter W. Foltz +1 more
The adequacy of LSA's reflection of human knowledge has been established in a variety of ways, for example, its scores overlap those of humans on standard vocabulary and subject matter tests; it mimics human word sorting and category judgments; it simulates word‐word and passage‐word lexical priming data.
Wiley Interdisciplinary Reviews Computational StatisticsJournal of Statistical Software
3,607 Citations2009Jan de Leeuw
The history, motivation, and implementation of the Journal of Statistical Software are discussed, including the history of the journal itself and its purpose and scope.
NLTK
3,299 Citations2002Edward Loper, Steven Bird
The Natural Language Toolkit has been rewritten, simplifying many linguistic data structures and taking advantage of recent enhancements in the Python language.
User Modeling and User-Adapted InteractionKnowledge tracing: Modeling the acquisition of procedural knowledge
2,133 Citations1995Albert T. Corbett, John R. Anderson
An effort to model students' changing knowledge state during skill acquisition and a series of studies is reviewed that examine the empirical validity of knowledge tracing and has led to modifications in the process.
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)Educational Data Mining: A Review of the State of the Art
2,127 Citations2010Cristóbal Romero, Sebastián Ventura
The most relevant studies carried out in educational data mining to date are surveyed and the different groups of user, types of educational environments, and the data they provide are described.
University of Maribor digital library (University of Maribor)Data Mining Techniques: For Marketing, Sales, and Customer Support
1,756 Citations1997Michael J. Berry, Gordon S. Linoff
One of the first practical guides to mining business data, Data Mining Techniques describes techniques for detecting customer behavior patterns useful in formulating marketing, sales, and customer support strategies.
BT Technology JournalConceptNet — A Practical Commonsense Reasoning Tool-Kit
1,560 Citations2004H Liu, Pankaj Kumar Singh
Behavior Research Methods, Instruments, & ComputersCoh-Metrix: Analysis of text on cohesion and language
1,515 Citations2004Arthur C. Graesser, Danielle S. McNamara +2 more
Standard text readability formulas scale texts on difficulty by relying on word length and sentence length, whereas Coh-Metrix is sensitive to cohesion relations, world knowledge, and language and discourse characteristics.
Expert Systems with ApplicationsEducational data mining: A survey from 1995 to 2005
1,464 Citations2006Cristóbal Romero, Sebastián Ventura
This paper surveys the application of data mining to traditional educational systems, particular web- based courses, well-known learning content management systems, and adaptive and intelligent web-based educational systems.
Annual Review of Information Science and TechnologyLatent semantic analysis
1,106 Citations2004Susan Dumais
Latent semantic analysis (LSA) approximates human understanding of relations between word and passage meanings in a wide variety of ways.
Journal of Statistical Software<b>topicmodels</b>: An<i>R</i>Package for Fitting Topic Models
1,088 Citations2011Bettina Grün, Kurt Hornik
The R package topicmodels provides basic infrastructure for fitting topic models based on data structures from the text mining package tm to estimate the similarity between documents as well as between a set of specified keywords using an additional layer of latent variables.
Educational Data Mining and Learning Analytics
909 Citations2014Ryan S. Baker, Paul Salvador Inventado
How these methods emerged in the early days of research in this area is discussed, which methods have seen particular interest in the EDM and learning analytics communities, and how this has changed as the field matures and has moved to making significant contributions to both educational research and practice.
TAGME
750 Citations2010Paolo Ferragina, Ugo Scaiella
Machine LearningLogistic Regression, AdaBoost and Bregman Distances
689 Citations2002Michael Collins, Robert E. Schapire +1 more
A unified account of boosting and logistic regression in which each learning problem is cast in terms of optimization of Bregman distances, and a parameterized family of algorithms that includes both a sequential- and a parallel-update algorithm as special cases are described, thus showing how the sequential and parallel approaches can themselves be unified.
American Behavioral ScientistLearning Analytics Dashboard Applications
612 Citations2013Katrien Verbert, Erik Duval +3 more
A conceptual framework is presented that helps to analyze learning analytics applications for these kinds of users and whether dashboards contribute to behavior change or new understanding is assessed.
Educational ResearcherCoh-Metrix
612 Citations2011Arthur C. Graesser, Danielle S. McNamara +1 more
The authors discuss five major factors that account for most of the variance in texts across grade levels and text categories: word concreteness, syntactic simplicity, referential cohesion, causal cohesion, and narrativity.
Cambridge University Press eBooksEducational Data Mining and Learning Analytics
451 Citations2014Ryan S. Baker, George Siemens
How these methods emerged in the early days of research in this area is discussed, which methods have seen particular interest in the EDM and learning analytics communities, and how this has changed as the field matures and has moved to making significant contributions to both educational research and practice.
Attention please!
318 Citations2011Erik Duval
Through information visualization techniques, this work can provide a dashboard for learners and teachers, so that they no longer need to "drive blind" and recommendation can help to deal with the "paradox of choice" and turn abundance from a problem into an asset for learning.
BPM (Demos)ProM : the process mining toolkit
288 Citations2009Wil M. P. van der Aalst, Boudewijn F. van Dongen +4 more
Modeling and understanding students' off-task behavior in intelligent tutoring systems
230 Citations2007Ryan S. Baker
A machine-learned model that can automatically detect when a student using an intelligent tutoring system is off-task, i.e., engaged in behavior which does not involve the system or a learning task is presented.
A framework for benchmarking entity-annotation systems
201 Citations2013Marco Cornolti, Paolo Ferragina +1 more
This framework is designed and implemented to perform the first extensive comparison among all available entity annotators over all available datasets, and draws many interesting conclusions upon their efficiency and effectiveness.
SNAPP
139 Citations2011Aneesha Bakharia, Shane Dawson
The functional features included in SNAPP 2.0 are detailed and how they relate to learning activity intent and participant monitoring.
International Journal of Artificial Intelligence in EducationStudent Modelling Based on Belief Networks
137 Citations2004Jim Reye
Clustering for improving educational process mining
116 Citations2014Alejandro Bogarín, Cristóbal Romero +2 more
The results show that the fitness of the specific models is greater than the general model obtained using all the data, and the comprehensibility of the models can be also improved in some cases.
Introduction
105 Citations2010Cristóbal Romero, Sebastián Ventura, Mykola Pechenizkiy, and Ryan S. J. d. Baker
In recent years, educational data mining has emerged as a burgeoning new area for scientific investigation because of the increasing availability of fine-grained, extensive, and longitudinal data on student learning.
IEEE Transactions on Learning TechnologiesAutomatic Detection of Off-Task Behaviors in Intelligent Tutoring Systems with Machine Learning Techniques
90 Citations2009Suleyman Cetintas, Luo Si +2 more
An extensive set of experiment results demonstrates the power of using multiple types of evidence, the personalized model, and the robust Ridge Regression algorithm to address data sparseness problem.
Journal of Learning AnalyticsComputer-Assisted Reading and Discovery for Student Generated Text in Massive Open Online Courses
50 Citations2014Justin Reich, Dustin Tingley +3 more
Usefulness of information visualizations based on educational data
40 Citations2014Anne-Maritta Tervakari, Kirsi Silius +3 more
According to the results of this research, most of the students seemed to prefer visualizations that offer concrete and practical support for their studies rather thanVisualizations that support them in monitoring and evaluating their own learning performance.
Advanced information and knowledge processingIntroduction to Data Mining in Bioinformatics
39 Citations2005Jason T. L. Wang, Mohammed J. Zaki +2 more
The aim of this book is to introduce the reader to some of the best techniques for data mining in bioinformatics in the hope that the reader will build on them to make new discoveries on their own.
A process mining approach to linking the study of aptitude and event facets of self-regulated learning
37 Citations2015Sanam Shirazi Beheshitha, Dragan Gašević +1 more
This paper proposes the use of the Fuzzy miner process mining technique to examine the relationship between students' self-reported aptitudes and strategies followed in self-regulated learning.
IT ProfessionalAutomated Semantic Tagging of Textual Content
32 Citations2014Jelena Jovanović, Ebrahim Bagheri +4 more
The authors offer insight into the process of semantic tagging, the capabilities and specificities of today's semantic taggers, and also indicate some of the criteria to be considered when choosing a tagger.
Lecture notes in computer scienceAn Assessment of Online Semantic Annotators for the Keyword Extraction Task
22 Citations2014Ludovic Jean‐Louis, Amal Zouaq +2 more
It is demonstrated that semantic annotators are not able to outperform keyword extractors and that annotators perform best on domains having a high keyword density.
Educational Data MiningDevelopment of a Workbench to Address the Educational Data Mining Bottleneck
16 Citations2012Ma. Mercedes T. Rodrigo, Ryan S. Baker +3 more
The development of an Educational Data Mining Workbench is discussed, designed to address the challenges faced in developing real-time detectors of cognitive skill as well as of metacognitive and motivational behavior.
Feature Factory
2 Citations2015Kalyan Veeramachaneni, Kiarash Adl +1 more
When the crowd-sourced features in the context of predicting stopout were examined, not only were they impressively nuanced, but they also integrated more than one interaction mode between the learners and platform and described how the learner was relatively performing.