Back To Schedule
Wednesday, November 19 • 4:15pm - 4:45pm
Skills Mapping and Analytics for OER

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

The Open Learning Initiative (OLI) is an open educational resources initiative that seeks to build learning environments based on principles derived from learning science research into how people learn. One of the main principles is that goal-directed practice and targeted feedback are critical to learning. Goal-directed practice involves working toward a specific level of performance and continually monitoring performance relative to clearly defined goals. When these goals are explicitly communicated to students, they support students' purposeful practice and help them monitor their progress.

In order to create online learning environments that provide goal-directed practice, OLI courses start with the development of a skills map. The skills map is authored by design teams who identify learning objectives and the skills that compose those objectives. Learning objectives specify what students will be able to do or know at the end of a section of content. A skill identifies the discrete concept, or knowledge component, embedded within the learning objective. Each learning objective comprises one or more skills. Interactive activities and quizzes are created to assess students' learning related to the various skills identified in the skills map.

The creation of skills maps serves a number of purposes, including assisting in the iterative course improvement process; measuring, validating and improving the model of student learning that underlies each course; and offering information necessary to support learning scientists in making use of OLI open datasets for continued research. One of the best known uses of these skills maps, however, is to support learning analytics for instructors. In this context, the objective of skill mapping in OLI is to determine the probability that a given student has learned a given skill. Individual skills are treated as mathematically independent variables.

In the current version of the model used in OLI courses, student learning is modeled using a Bayesian hierarchical statistical model with the latent variables of interest, students' learning states, becoming more accurate as more data is accrued about performance on a given skill. This learning model is used to drive dashboard-style displays for both instructors and students. For instructors, the display gives a high-level overview of how students are performing on the learning objectives for each module in the course. Before going into class, instructors can see quickly the concepts students are grasping and the concepts with which they are struggling. This enables instructors to spend their time with students addressing areas where students are having trouble, as opposed to covering material that students have been able to master on their own. For students, the display shows level of mastery for each learning objective, and also allows students to view activities associated with each objective in order to provide an easy way to get more practice on a given objective.

We will give an overview of the skills map process, discuss the analytics reports and dashboard-style displays that skills mapping enables, review next steps for future improvements, and discuss implications for how skills mapping can drive student learning and iterative course improvement in OER.

avatar for Norman Bier

Norman Bier

Executive Director Simon Initiative; Director, Open Learning Initiative, Carnegie Mellon University
Norman Bier has spent his career at the intersection of learning and technology, working to expand access to and improve the quality of education. He is currently the Executive Director of the Simon Initiative and the Director of the Open Learning Initiative (OLI) at Carnegie Mellon... Read More →

Wednesday November 19, 2014 4:15pm - 4:45pm EST

Attendees (0)