IAT 802 Quantitative Research Methods and Design

(taught in 2012, 2013, 2014, 2016, 2018, 2020, 2021 …)

Course Objectives, Learning Goals & Outcomes

The course struc­ture and teaching/learning activ­i­ties are designed around the fol­low­ing ques­tions. That is, by actively par­tic­i­pat­ing in this course, stu­dents should be able to effec­tively address the fol­low­ing ques­tions and per­form the respec­tive tasks:

1) What is sci­ence, the “sci­en­tific method” and quan­ti­ta­tive research? How do you think and argue like a good scientist?

2) Why do sci­ence? What is sci­en­tific & quan­ti­ta­tive research useful for?

  • a) Why could you be excited about sci­ence? What drives and excites a researcher?
  • b) What are advan­tages and dis­ad­van­tages of quan­ti­ta­tive & sci­en­tific research meth­ods (as com­pared to other meth­ods)? That is, what are they appro­pri­ate and useful for?

3) What to research? Why research something?

  • a) How to devise effec­tive research ques­tions and hypotheses?
  • b) How to effec­tively moti­vate research questions?

4) How to use quan­ti­ta­tive & sci­en­tific meth­ods prop­erly, care­fully & effectively?

  • a) Experimental design: How to design an effec­tive exper­i­ment? What does effec­tive mean?
  • b) Descriptive sta­tis­tics: How to present data effec­tively? What does effec­tive mean?
  • c) Inferential sta­tis­tics: What can you con­clude from quan­ti­ta­tive data? Why? What are your chances of being wrong? How do you decide which sta­tis­ti­cal meth­ods to use? How to apply them prop­erly? How to do this in a given sta­tis­ti­cal analy­sis software?

5) How to com­mu­ni­cate all that effec­tively and scholarly?

6) How to crit­i­cally eval­u­ate and dis­cuss the qual­ity of quan­ti­ta­tive / sci­en­tific research (of your­self and others)?

"What's in it for me"?

Practically speak­ing, engag­ing in this course will (hope­fully) empower you to

  • no longer fear sta­tis­tics (in case you ever might have ;-), but instead appre­ci­ate and enjoy the beauty and craft of rig­or­ous sci­en­tific research
  • design, con­duct, ana­lyze, write up, present, and dis­cuss your own quan­ti­ta­tive (or mixed-methods) research projects
  • tackle your own thesis research projects suc­cess­fully, by having the most pow­er­ful sci­en­tific research tool­box at your fingertips
  • have enough skills to con­tinue learn­ing and apply­ing scientific/quantitative research meth­ods prop­erly (the goal of the course is to give you a solid basis in the basic research meth­ods and the skills to keep learn­ing and suc­cess­fully apply­ing more advanced ones)

Textbooks & tutorials

  • Field, A., & Hole, G. J. (2003). How to Design and Report Experiments. Sage Publications. ISBN: 0761973834 
  • TBD: Open Learning Initiative Statistics (online learn­ing mod­ules, prob­a­bly with a $25.00 fee. Registration infos will be pro­vided in class / by email) might also be: Statistical Reasoning by CMU OLI (no-login link & out­line)

Statistics and JMP resources & links to video tutorials and online courses etc.

JMP & statistics short summaries and cheat-sheets from Bernhard

(Note: these are draft and work in progress, feed­back is welcome):

Bernhard’s first attempts to do short sta­tis­tics video tuto­ri­als for SPSS & JMP

Peer-reviewed publications based on my teaching of IAT802

(Let me know if I’m miss­ing any pub­li­ca­tions in this list so I can update things)

Ens, J., Pasquier, P., & Riecke, B. E. (2017). The Significance of the Low Complexity Dimension in Music Similarity Judgements. 31–38. (Download)
Hashemian, A. M., & Riecke, B. E. (2017, April 6). Rotate and Lean: Does Leaning toward the Target Direction Improves the Virtual Reality Navigation? [Poster]. Second International Workshop on Models and Representations in Spatial Cognition, Tübingen, Germany. (Download)
Nguyen-Vo, T., Riecke, B. E., & Stuerzlinger, W. (2017, April 6). Investigating the Effect of Simulated Reference Frames on Spatial Orientation in Virtual Reality [Poster]. Second International Workshop on Models and Representations in Spatial Cognition, Tübingen, Germany. (Download)
Jones, B., Maiero, J., Mogharrab, A., Aguliar, I. A., Adhikari, A., Riecke, B. E., Kruijff, E., Neustaedter, C., & Lindeman, R. W. (2020). FeetBack: Augmenting Robotic Telepresence with Haptic Feedback on the Feet. Proceedings of the 2020 International Conference on Multimodal Interaction, 194–203. https://doi.org/10.1145/3382507.3418820
Malekmakan, M., Stuerzlinger, W., & Riecke, B. E. (2020). Analyzing the Trade-off between Selection and Navigation in VR. 1–3. https://vrst.acm.org/vrst2020/?page_id=515 (Download)
Hashemian, A. M., Kitson, A., Nguyen-Vo, T., Benko, H., Stuerzlinger, W., & Riecke, B. E. (2018). Investigating a Sparse Peripheral Display in a Head-Mounted Display for VR Locomotion. 2-page extended abstract and poster. (Download)
Nguyen-Vo, T., Riecke, B. E., & Stuerzlinger, W. (2018). Simulated Reference Frame: A Cost-Effective Solution to Improve Spatial Orientation in VR. 415–422. (Download)
Sun, J., Stuerzlinger, W., & Riecke, B. E. (2018). Comparing Input Methods and Cursors for 3D Positioning with Head-mounted Displays. Proceedings of the 15th ACM Symposium on Applied Perception, 8:1–8:8. https://doi.org/10.1145/3225153.3225167
Hashemian, A. M., & Riecke, B. E. (2017). Leaning-Based 360° Interfaces: Investigating Virtual Reality Navigation Interfaces with Leaning-Based-Translation and Full-Rotation. In S. Lackey & J. Chen (Eds.), Virtual, Augmented and Mixed Reality (VAMR 2017) (Vol. 10280, pp. 15–32). Springer. https://youtu.be/7IT9EODJn3c (Download)
Nguyen-Vo, T., Riecke, B. E., & Stuerzlinger, W. (2017). Moving in a Box: Improving Spatial Orientation in Virtual Reality using Simulated Reference Frames. 207–208. https://doi.org/10.1109/3DUI.2017.7893344 (Download)
Pan, R., Singhal, S., Cramer, E., Riecke, B. E., & Neustaedter, C. (2017). “MyEyes”: The Design and Evaluation of First Person View Video Streaming for Long-Distance Couples. 135–146. https://doi.org/10.1145/3064663.3064671 (Download)
Quesnel, D., & Riecke, B. E. (2017). Awestruck: Natural Interaction with Virtual Reality on Eliciting Awe. 205–206. https://doi.org/10.1109/3DUI.2017.7893343 (Download)
Wong, S., Yang, L., Riecke, B. E., Cramer, E., & Neustaedter, C. (2017). Assessing the Usability of Smartwatches for Academic Cheating during Exams. 1–11. https://doi.org/10.1145/3098279.3098568 (Download)
Fan, J., Thorogood, M., Riecke, B. E., & Pasquier, P. (2015). Automatic Recognition of Eventfulness and Pleasantness of Soundscape. Proceedings of the Audio Mostly 2015 on Interaction With Sound, 12:1–12:6. https://doi.org/10.1145/2814895.2814927 (Download)
Joksimovic, S., Gasevic, D., Kovanovic, V., Riecke, B. E., & Hatala, M. (2015). It is the qual­ity not quan­tity that mat­ters: Social pres­ence in online dis­cus­sions as a process pre­dic­tor of aca­d­e­mic per­for­mance. Journal of Computer Assisted Learning.
Riecke, B. E., Jordan, J. D., Prpa, M., & Feuereissen, D. (2014). Underlying Perceptual Issues in Virtual Reality Systems: Does Display Type Affect Self-Motion Perception? [Talk]. 55th Annual Meeting of the Psychonomic Society (Psychonomics), Los Angeles, USA.
Freiberg, J., Grechkin, T., & Riecke, B. E. (2013). Do walk­ing motions enhance visu­ally induced self-motion illu­sions in vir­tual real­ity? IEEE Virtual Reality, 101–102. https://doi.org/10.1109/VR.2013.6549382
Freiberg, J., & Riecke, B. E. (2013). Its your turn: Enhancing visu­ally induced self motion illu­sions (“vec­tion”) with walk­ing motions in vir­tual real­ity [Poster]. 54th Annual Meeting of the Psychonomic Society (Psychonomics), Toronto, Canada.

Project presentations

Latest presentations (Spring 2020)

on April 23rd 2020, the 8 stu­dents in my grad course on “Quantitative Research Methods & Design (IAT802) pre­sented their project — due to the Covid-19 pan­demic all-virtual, here are their videos, enjoy!

Project presentations from Fall 2016 offering

On November 26th, the 17 stu­dents in my grad course on “Quantitative Research Methods & Design (IAT802)” that I taught in Fall 2016 give their final 5:30-min project pre­sen­ta­tions in the SIAT research col­lo­quium at Simon Fraser University. Enjoy!

here’s the video record­ing of the whole ses­sion:

 

Here’s the list of speak­ers and topics

  • Elgin McLaren:   Attention Retention: The effec­tive­ness of neu­ro­feed­back sys­tems for cueing sus­tained attention
  • Jeff Ens: Music and the role of dimen­sional com­plex­ity in sim­i­lar­ity judgements
  • Arron Ferguson: Choose Wrong, Someone Dies: Measuring Engagement with Ethical Choices and Character Consistency in Interactive Narrative
  • Duc-Minh Pham: Body-based Navigation: A Promising Locomotion Technique in Immersive Virtual Environment.
  • Ray Pan: “Split, Horizontal or Overlapped?”: Comparing Social Presence and Body Ownership in Shared Video Views for Long Distance Relationships
  • Denise Quesnel:   Are you awed yet? Objective and sub­jec­tive indi­ca­tors of awe, using vir­tual real­ity content
  • Mia Cole: Time to Relax: No effects to the stress response after short-term use of an EEG-based brain-computer interface.
  • Maha El Meseery:   TBD (Will track­ing user inter­ac­tions during visual explo­ration helps improve their analy­sis efficiency? )
  • Ted Nguyen Vo: Moving in a Box: A Visual Cue for Virtual Reality Locomotion
    Fatemeh Salehian Kia: Motive or Strategic Student: Comparing 3 Types of Visual Feedbacks on Students’ Performance with Different Learning Styles in Online Discussions
  • Junwei Sun: Assessing Input Methods and Cursor Displays for 3D Positioning with HMDs
    Narges Ashtari: Exploring fac­tors which affect archi­tects design explo­ration struc­ture in CAD spaces
  • Stephanie Wong: Easy A: assess­ing student’s abil­ity to cheat with smart­watch
    Abraham Hashemian: Leaning-Based 360 Locomotion Interfaces: How good are they for nav­i­ga­tion in Virtual Reality
  • Serkan Pekcetin: Measuring the Effect of Binaural Audio on the Sense of Direction in Virtual Environments
  • Xintian Sun: Where Was It? Evaluating Spatial Memory in Different Backgrounds from Static and Moving Viewpoints

 

 

 

Project presentations from Fall 2014 offering

On November 26th 2014, the 9 stu­dents in my grad course on “Quantitative Research Methods & Design (IAT802)” that I taught in Fall 2014 gave their final 7-min project pre­sen­ta­tions in the SIAT research col­lo­quium at Simon Fraser University. Enjoy! I think the stu­dents did an amaz­ing job, quite proud of them! — for many it was their first sci­en­tific research project and presentation!

(alter­nate link)

Here’s the list of speak­ers and topics

  • Alejandro:  Non-Expert Movement Observation Using Laban Movement Analysis
  • Alex Kitson:  Individual fac­tors influ­enc­ing ori­en­ta­tion per­for­mance in vir­tual environments
  • Jianyu Fan:  Groundtruthing and Validating the Soundscape Valence/Arousal Classification with Multiple Users
  • William Li:  Validation of MotionCapture (MoCap) Labels in Movement
  • Jason Procyk:  Video Feedback for Ice Hockey: Investigating the Effect on Shot Training
  • Luciano Frizzera:
  • Effectiveness and effi­ciency of time rep­re­sen­ta­tion on human spa­tial move­ment map visualization
  • Srilekha Kirshnamachari Sridharan:  Association of Colors to Phoneme-Grapheme pairs.
  • Kıvanç Tatar:  Empirical Evaluation of a Commercial Synthesizer Automatic Calibration System
  • Arefin Mohiuddin:  Exploration of Parallel Alternatives in Design Tasks — The Effect on Task Completion Times

Project presentations from Fall 2013 offering

Here are the pre­sen­ters & talk titles:

Carolyn Pang    Evaluating the Usability of Desktop and Mobile Government Portals
Mirjana Prpa    Can an immer­sive dis­play enhance the expe­ri­ence of self-motion illu­sions in VR?
Sujoy Hajra    Evaluating EEG based mea­sures for lan­guage ther­apy assess­ment in stroke patients
Xiaolan Wang    Does pre­vi­ous con­tact with fund­ing orga­ni­za­tions affect the money com­mu­nity gar­dens get?
Emily C    Color’s effect on learn­ing symbol-sound rela­tion­ships
Ankit Gupta      Can seman­ti­cally labeled graphs help you find infor­ma­tion faster?
Xiao Zhang    Progressive or regres­sive visual inter­face design: com­par­ing user expe­ri­ence sup­ported by iOS 7 versus iOS 6
Ethan Soutar-Rau     It all started with a Penguin
Reese Muntean    Effects of Gender on Beer Preference
Sohail.Md    Melodic com­par­i­son in META-MELO system
Xin Tong    Comparison between two kinds of Virtual Reality dis­play: the Oculus Rift HMD & the Firsthand dis­play
Sanam Shirazi    Can we pre­dict stu­dents’ aca­d­e­mic per­for­mance from engage­ment in online learn­ing activ­i­ties?
Srecko Joksimovic The level of social pres­ence in online learn­ing com­mu­nity as a pre­dic­tor of stu­dents’ aca­d­e­mic per­for­mance
Jacqueline Jordan     Does vec­tion inten­sity differ between Virtual Reality dis­plays?

Project presentations from Fall 2012 offering

For the first time, stu­dents from the SIAT grad­u­ate course on “Quantitative Research Methods & Design (IAT802)” that I taught in Fall 2012 at SIAT gave their final 6-min project pre­sen­ta­tion pub­licly in the SIAT research col­lo­quium. Enjoy! I think the stu­dents did a won­der­ful job — for many it was their first sci­en­tific research project and presentation!

 

Jake Freiberg                Biomechanical Influences on Visually Induced Rotational Vection
Audrey Desjardins       Exploring Computer Mice Materials and Affective Responses
Jim Silvester                 The Effect of Viewpoint Jitter on Circular Vection in Virtual Reality
Nadya Calderon            Animation of Real-Time Series: Trends and Common Fate
Mehdi Karamnejad      The Effects of Walking on Galvonic Skin Response
Saeedeh Bayatpour      The Ability of Fusion in Three-Dimensional Autostereogram
Omid Alemi                   Are We Biased Against Computers’ Creativity?
Lisa Donaldson            The Effect of Contrast on Circular Vection When Viewed Within Virtual Reality

The last two pre­sen­ta­tions were recorded in out normal sem­i­nar room a few days later:

Jillian Warren             The Effect of Textual and Pictorial Representation on Learning Ability with Interactive Tangibles
Laura Lande              The Effects of Nursing Experience on Diagnosing Fetal Position