The BYU Office of Information Technology (OIT) asked us to evaluate the TEC (Technology Enabled Classroom) panels across BYU campus in order to determine pain points and opportunities for improvement.
TEC panels are touchscreens found in classrooms that are used to power on/off projectors or TVs, choose inputs, and control other technologies in the classroom.
We were hired to do an external evaluation of the current panels, knowing that OIT would be updating them to a different tech stack in the near future.
My friend, Bryan (also a UX Designer), and I were hired on to do an external evaluation of the system. We worked closely with a project team of 5 people at BYU OIT led by Brandon.
Mine and Bryan's roles overlapped a lot during this project, but I was primarily responsible for surveys and other qualitative research activities.
Classtime is precious. It's a short amount of time where professors help students learn about a subject through lecture and audio/visuals.
Setting up the audio/visuals often takes too long though because it's unclear whether there's a user error or system error. Also, with so many different kinds of inputs (i.e. VGA, DVI, DVD player, overhead projector, etc.) it can be confusing to professors on how to best set up their classroom to teach each day.
Our task was to perform an external evaluation of BYU's systems to make recommendations to create consistency in all classrooms to enable professors to set up quickly, or be able to quickly resolve problems.
Photo by Miguel Henriques on Unsplash
We surveyed 69 BYU faculty and staff about their thoughts on the TEC A/V panels. We gleaned 2 insights which gave us perspective on which to build and directed us to other methods that would help us write our recommendations.
standard deviation: 1.013
Responders were really mixed on what to call the A/V Panels. This may not be the worst part of the experience, but having stronger branding could create better communication between staff and OIT.
The most common complaints were that it's "finnicky" or "tempermental", suggesting that the system works, but has room for improvement, especially by making it more dependable.
We learned 2 things from this survey
Responders were really mixed on what to call the A/V Panels. This may not be the worst part of the experience, but having stronger branding could create better communication between staff and OIT.
The most common complaints were that it's "finnicky" or "tempermental", suggesting that the system works, but has room for improvement, especially by making it more dependable.
We compared BYU's A/V system to 2 other University's systems to see how other Universities are using A/V to improve the classroom experience.
Here's what we captured of the BYU experience for comparison:
University of Utah’s podium setup was pretty cool. The Large workspace with an incorporated document scanner seemed particularly useful. The TV seemed somewhat small for being able to see in the back of the room though. The control panel interface really crammed a lot of buttons into a single screen, but it seemed intuitive enough.
University of Utah’s podium setup was pretty cool. The Large workspace with an incorporated document scanner seemed particularly useful. The TV seemed somewhat small for being able to see in the back of the room though. The control panel interface really crammed a lot of buttons into a single screen, but it seemed intuitive enough.
We also took a minute to evaluate the BYU system based on Jakob Nielsen's 10 Usability Heuristics. This evaluation helped give us further backing to our recommendations. We did this evaluation by noting how well (on a scale from Low to High) the system achieved each heuristic.
Our output for this project was a written report and presentation to the BYU OIT team. The report included recommendations for fixing problems we discovered through surveys, user tests, heuristical analysis, and observation. It also included recommendations for improving the system based on conversations with users and our competitive analysis.
Wireframes and information architecting were not part of this project, but we did create a couple concepts.
More than 700 classrooms across BYU campus are using a new A/V system that uses design principles that we proposed.
He was instrumental in helping us understand our user landscape and to consider options for improving the UX. We've been able to improve our product greatly because of his efforts.
This project was a lot of fun and a great way to dive into different various UX methods which are more analytical in nature instead of wireframing and interaction design. This project required careful thinking and perspective from professors, staff, students, and help desk to craft recommendations that would make a technology-enabled classroom a great experience.