Work

How interface design affects the composition, interpretation, and utilization of feedback

Year: 2022
Type: dissertation
Abstract: Interfaces for composing and reviewing feedback vary widely in terms of the information they include and how they present it.These interfaces can have a strong impact on how content creators and their feedback providers engage with the feedback, ranging from task performance and perceptions of fairness and helpfulness to strategies used for composing and navigating the feedback.In my thesis, I report the results from three experiments exploring how user interfaces present throughout the feedback exchange process influence feedback composition, interpretation, and utilization.In the first experiment, we examine how various combinations of constructive and summative feedback influence a creator's perceptions of the feedback and the revisions they subsequently perform.Participants (N=441) wrote and revised short stories when presented with quality scores, pre-authored constructive comments, both scores and comments, or no feedback.We found that while showing scores can have marginal benefits compared to showing no feedback, constructive comments without scores led to the most favorable feedback perceptions and revisions.In the second experiment, we investigate how feedback's level of detail influences perceptions of the feedback by both the provider and recipient, and how these perceptions translate to revisions and creative outcomes.Writers (N=285) received feedback from expert providers (N=4) in the form of a writing rubric, open comments, a rubric with open comments, or a rubric with per-criterion comments.We found that writers' revision quality and feedback perceptions increased with the feedback's level of detail, but providers felt the interface that required the most detail diminished their ability to effectively articulate their thoughts.In the third experiment, we explore how students integrate an interactive visualization of feedback's topic and opinion structure into their proceses for navigating and interpreting feedback.Teams (N=18) of 3-5 students each used the tool to review feedback on three different project deliverables and revise these deliverables for a grade in an authentic UI design course.We found that students used the visualization to assess their work quality, prioritize revisions, and justify design decisions to their teammates.Some students additionally developed emergent techniques for reviewing and annotating feedback that they adapted to their other projects outside the course.My dissertation represents a large step towards a future where the interfaces with which feedback is composed and presented are given as much consideration as the feedback's content when designing tools for supporting feedback exchange between content creators and feedback providers.Ph.D. without the love and support from dozens of people rooting for me to succeed.I would like to first and foremost thank my advisor, Dr. Brian Bailey, for not only providing constant support and guidance, but having an unreal amount of patience in mentoring me as I repeatedly stumbled in learning how to conduct and report research of the highest quality.To this day it is difficult to imagine what kind of potential you saw in the inexperienced, incoherent, and socially awkward person I was when I began my journey at UIUC.From helping me write half of my first published paper to giving me just enough support to write my final papers on my own, I am sincerely grateful for the several chances you took in giving me the time, resources, and opportunities I needed to develop and hone my skills as an independent researcher.I would next like to thank the distinguished researchers who served on my committee and provided additional mentoring support throughout the years.To Dr. Yun Huang, I am grateful for your inviting me to attend your own group's meetings to brainstorm research ideas with your students and yourself.I thoroughly enjoyed the few discussions I was able to attend, and several topics from these meetings sparked ideas that made their way into my last few papers in significant ways.To Dr. Joy Kim, I am grateful for your ability to present alternative perspectives with a positive and constructive energy.Your perspectives have not only been useful in improving the quality of my research, but have served as wonderful examples I strive to mirror in presenting my own ideas to others.To Dr. Alex Kirlik, I am grateful for your taking the time to offer feedback and insights on my experimental designs.Although we sat down to chat maybe once or twice per year, each time left me feeling much more confident in my experiments, and at least two of my papers are vastly improved as a result of our discussions.I would also like to thank my family for their unwavering support not just throughout graduate school, but throughout the entirety of my life and education.To my mom and dad especially, thank you for being incomprehensibly invested in every aspect of my happiness and well-being.Regardless of what my needs are or what my pursuit of happiness may entail, and regardless of how busy, cranky, or stressed I get, both of you have always been there to help me in every way I could possibly imagine and in many ways I couldn't imagine.I am immensely grateful to have such supportive and loving parents, and I hope to never take that iii for granted.To my sister, thank you for loving and caring for me in the goofball way that you do.Even when I'm heads down working for weeks on end, your excitement in sending me cute pictures from the vet's office never fails to bring a chuckle and a smile to my face when I finally remember to check messages once in a while.To my grandma, thank you for continuing to think of me and keeping me part of your life even from thousands of miles away.I love you all very much, and I am truly blessed to call you my family.I would of course like to thank all of my wonderful friends for their support and companionship throughout our mutual journeys, especially Luke Upton, Sneha Kumaran, and Peyton Smith.Luke, you've been one of my closest friends for 20 years now, and getting to share and bond over parallel life experiences for two decades is a truly amazing feeling.Whether it's playing Command and Conquer, commiserating over research duties, sharing random videos, or contemplating more serious topics, hanging out with you is always a bright spot in my day, and I am excited you will soon complete your Ph.D. journey as well.Sneha, you are the first and closest friend I've made at UIUC, and watching you succeed as we both fought similar battles was probably the biggest motivator for me to push myself for the majority of graduate school.Beyond that, you've been a wonderful friend and have helped with my research and my life in several ways I don't think I can repay, and I wish you the best with your new family and job.Peyton, you are one of the wisest, most understanding, and most sincere people I have ever met, and whether I'm practicing Super Smash Brothers Melee with you or picking your brain about philosophy, almost every time we hang out is an eye-opening experience.Even if they're months apart, I always look forward to each time we get to talk and hang out, and I hope you are able to find happiness and fulfillment in all of the things you do.I would also like to thank Grace Yen, Sebastian Rodriguez, Charlotte Yoder, Wayne Wu, Gina Do, Emily Hastings, Helen Wauck, Wendy Shi, Kristen Vaccaro, Robert Deloatch, John Lee, and all of my other friends and lab mates at UIUC for the company and moral support that have made the last 7 years that much easier.Finally, I would like to thank my extraordinary girlfriend and future wife, Kaii Ki, for continuously supporting me in countless ways each and every day.Words cannot describe how much of my success, happiness, and well-being the last few years is the result of your love, understanding, patience, wisdom, and strength.Between keeping me company as I pull all-nighters trying to revise papers, making sure I get the nourishment I need as I push myself each day, and doing everything you can to brighten my mood when I'm stressed or cranky, I could not imagine a more loving or caring person to spend the rest of my days with.Thank you all! iv Table of ContentsChapter 1 Introduction . . . . . .
Language: English
Subfield: Education
Open Access status: green
OpenAlex ID: W7220783738
Cites: 168
Cited by:
Related to: 10