Home | Carnegie Learning
  • Facebook
  • Twitter
  • LinkedIn
  • Instagram
Back to BlogUpGrade: An Open Source Platform for A/B Testing in Education

UpGrade: An Open Source Platform for A/B Testing in Education

We've got some exciting news to share!

We'd like to introduce UpGrade, an open source A/B testing platform for education software funded by the Bill & Melinda Gates Foundation and Schmidt Futures.

UpGrade will make it easier for educators to develop and discover the most effective learning outcomes by supporting real-time field tests. Our vision is to bring together teachers, researchers and edtech companies to design “A/B tests” of new approaches to digital learning. Our mission is to build a community of practitioners to continuously improve student outcomes -- and to contribute to the science of learning.

In the first phase, UpGrade will be introduced within MATHia, our artificial intelligence math learning software, for the 2020/2021 school year. The project is designed to be a fully open source platform and aims to provide a common resource for learning scientists and educational software companies. Our design and development collaborator, Playpower Labs, is currently using UpGrade to support learning science-based improvements in their own math games.

Why A/B Test?

 

Software companies like Amazon, Google and Facebook use A/B testing to continuously improve their products. They will assign users one of two versions of a software feature ("A" or "B") and see how that impacts user behavior. The version that promotes the most desired behavior "wins" and is then implemented.

Our goal is to take the power of A/B testing and apply it to learning technology in order to optimize student learning. For example, which version of a MATHia feature contributes to better understanding of the mathematical concept? Having this information, validated by science, will enable us to continuously improve our solutions, making them most effective for teachers and students.

What We'll Test

 

Here is an example of what an A/B test in MATHia might look like:

Which is the better model for fraction division?

 

Working together with researchers and educators, we may also explore:

  • Motivational messaging to support a growth mindset
  • Interactive tools for building conceptual knowledge
  • How optimized problem transitions can support learning
  • Providing progress feedback that is realistic but not discouraging
  • Encouraging appropriate use of hints


The Impact on Education

 

Dr. Steven Ritter, our Co-Founder and Chief Scientist, recently told The Learning Agency, "The ability to try out improvements like this will lead to more effective approaches to instruction. We are working with learning science researchers to field-test basic principles that can apply across many instructional systems."

Want updates on our work? Sign up here.

Author

  • Carnegie Learning

Carnegie Learning is helping students learn why, not just what. Born from more than 30 years of learning science research at Carnegie Mellon University, the company has become a recognized leader in the ed tech space, using artificial intelligence, formative assessment, and adaptive learning to deliver groundbreaking solutions to education’s toughest challenges. With the highest quality offerings for K-12 math, ELA, literacy, world languages, professional learning and more, Carnegie Learning is changing the way we think about education, fostering learning that lasts.

Explore more related to this author

You May Like

Is This the Best German Textbook? This Teacher Thinks So.
Kelly Denzler
How ClearLanguages Solutions Boost Listening Comprehension
Kelly Denzler
MATHia’s APLSE Report: Your Summative Assessment Crystal Ball
Karen Sloan
Can You Really “Teach” Language Listening Comprehension?
Kelly Denzler
Quiz: What Kind of School Administrator Are You?
Kelly Denzler
Low-Prep Winter Math Worksheets
Karen Sloan
  • June 18, 2020

"Our mission is to build a community of practitioners to continuously improve student outcomes -- and to contribute to the science of learning."

Filed Under

  • Carnegie Learning
  • EdTech
  • Future Ready
  • Research

Tags

  • Adaptive Learning
  • Artificial Intelligence
  • Math Software

Connect With Us

  • Facebook
  • Twitter
  • LinkedIn
  • Instagram
  • Privacy Policy
  • Terms of Use

Carnegie Learning, Inc.

4 Smithfield Street, Floor 8
Pittsburgh, PA 15222
  • P: 888.851.7094

© 2014-2024 Carnegie Learning, Inc.

Home | Carnegie Learning Close
  • Home
  • Solutions
    • ClearMath Solutions
    • Elementary Math Solution (K-5)
    • Middle School Math Solution (6-8)
    • High School Math Solution (9-12)
    • MATHia Adventure (K-5)
    • MATHia (6-12)
    • MATHstream (6-12)
    • ClearLiteracy Solutions
    • Lenses on Literature (6-12)
    • Mirrors & Windows (6-12)
    • Fast ForWord (K-12)
    • ClearFluency (K-12)
    • ClearLanguages Solutions
    • ¡Qué chévere!: Spanish (6-12)
    • En voz alta: Español para hispanohablantes (6-12)
    • T’es branché?: French (6-12)
    • Deutsch So Aktuell: German (6-12)
    • Zhēn Bàng!: Chinese (6-12)
    • Amici d'Italia: Italian (6-12)
    • Symtalk (K-5)
    • Exploring (6-8)
    • World Language Immersion (6-12)
    • Services
    • Professional Learning Services
    • Patterns Professional Learning
    • Instructional Services
    • District Impact Services
  • Our Difference
    • Research
    • Case Studies
  • Company
    • Careers
    • Events & Webinars
    • Press Room
    • Blog
    • Communities
    • Year One Podcast
  • Let's Talk
  • Blog Listings
  • Sample Center
  • Help Center
  • Customer Sign-in