Evaluating instructional technology implementation in a higher education environment

For decades colleges and universities have experimented with various techno logical innovations to deliver instruction. Although not new in higher educ ation, use of learning technology has greatly increased in recent years (Bu rnaska, 1998). This increased use brings an increased need for understandin g the methodologies and approaches best suited to the evaluation of learnin g technologies in higher education. Here we first review the literature and describe the methods used in a myriad of evaluation studies in this area. Our primary purpose, however, is to describe our experiences evaluating a c ampus-wide learning technology effort (the SCALE Project) at the University of Illinois at Urbana-Champaign. This evaluation spanned three years and u sed multiple methods. More importantly, it provided some challenges from wh ich others may learn and benefit.