publications

2024

  1. 230,439 Test Failures Later: An Empirical Evaluation of Flaky Failure Classifiers
    Alshammari, Abdulrahman, Ammann, Paul,  Hilton, Michael, and Bell, Jonathan
    In IEEE Conference on Software Testing, Verification and Validation, ICST 2024, Toronto, ON, Canada, May 27-31, 2024 2024
  2. A Study of Flaky Failure De-Duplication to Identify Unreliably Killed Mutants
    Alshammari, Abdulrahman, Ammann, Paul,  Hilton, Michael, and Bell, Jonathan
    In IEEE International Conference on Software Testing, Verification and Validation, ICST 2024 - Workshops, Toronto, ON, Canada, May 27-31, 2024 2024
  3. Student-AI Interaction: A Case Study of CS1 students
    Amoozadeh, Matin, Nam, Daye, Prol, Daniel, Alfageeh, Ali, Prather, James,  Hilton, Michael, Ragavan, Sruti Srinivasa, and Alipour, Amin
    In Proceedings of the 24th Koli Calling International Conference on Computing Education Research, Koli Calling 2024, KoliFinland, November 12-17, 2024 2024
  4. A Retrospective Study of one Decade of Artifact Evaluations
    Winter, Stefan, Timperley, Christopher Steven, Hermann, Ben, Cito, Jürgen, Bell, Jonathan,  Hilton, Michael, and Beyer, Dirk
    In Software Engineering 2024, Fachtagung des GI-Fachbereichs Softwaretechnik, Linz, Austria, February 26 - March 1, 2024 2024
  5. Trust in Generative AI among Students: An exploratory study
    Amoozadeh, Matin, Daniels, David, Nam, Daye, Kumar, Aayush, Chen, Stella,  Hilton, Michael, Ragavan, Sruti Srinivasa, and Alipour, Mohammad Amin
    In Proceedings of the 55th ACM Technical Symposium on Computer Science Education, SIGCSE 2024, Volume 1, Portland, OR, USA, March 20-23, 2024 2024
  6. Best Practices for Hiring of Teaching Track Faculty Members
    Campbell, Jennifer, Conrad, Phill, Dean, Victoria, Herman, Geoffrey L., and Hilton, Michael
    In Proceedings of the 2024 ACM Virtual Global Computing Education Conference V. 2, SIGCSE Virtual 2024, Virtual Event, NC, USA, December 5-8, 2024 2024
  7. Improving Software Engineering Teamwork with Structured Feedback
    Huang, Victor Weiqi, Krueger, Kori, Cohen, Taya, and Hilton, Michael
    In Proceedings of the 55th ACM Technical Symposium on Computer Science Education, SIGCSE 2024, Volume 1, Portland, OR, USA, March 20-23, 2024 2024

2023

  1. Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models
    Parry, Owain, Kapfhammer, Gregory M.,  Hilton, Michael, and McMinn, Phil
    Empir. Softw. Eng. 2023
  2. Towards Characterizing Trust in Generative Artificial Intelligence among Students
    Amoozadeh, Matin, Daniels, David, Chen, Stella, Nam, Daye, Kumar, Aayush,  Hilton, Michael, Alipour, Mohammad Amin, and Ragavan, Sruti Srinivasa
    In Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 2, ICER 2023, Chicago, IL, USA, August 7-11, 2023 2023
  3. Continuously Accelerating Research
    Barr, Earl T., Bell, Jonathan,  Hilton, Michael, Mechtaev, Sergey, and Timperley, Christopher Steven
    In 45th IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results, NIER@ICSE, Melbourne, Australia, May 14-20, 2023 2023
  4. Proceedings of the 2023 ACM SIGPLAN International Symposium on SPLASH-E, SPLASH-E 2023, Cascais, Portugal, 25 October 2023
    In 45th IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results, NIER@ICSE, Melbourne, Australia, May 14-20, 2023 2023

2022

  1. Collaborative Programming for Work-Relevant Learning: Comparing Programming Practice With Example-Based Reflection for Student Learning and Transfer Task Performance
    Sankaranarayanan, Sreecharan, Kandimalla, Siddharth Reddy, Bogart, Christopher A., Murray, R. Charles,  Hilton, Michael, Sakr, Majd F., and Rosé, Carolyn P.
    IEEE Trans. Learn. Technol. 2022
  2. A Survey of Flaky Tests
    Parry, Owain, Kapfhammer, Gregory M.,  Hilton, Michael, and McMinn, Phil
    ACM Trans. Softw. Eng. Methodol. 2022
  3. What Do Developer-Repaired Flaky Tests Tell Us About the Effectiveness of Automated Flaky Test Detection?
    Parry, Owain,  Hilton, Michael, Kapfhammer, Gregory M., and McMinn, Phil
    In IEEE/ACM International Conference on Automation of Software Test, AST@ICSE 2022, Pittsburgh, PA, USA, May 21-22, 2022 2022
  4. Surveying the Developer Experience of Flaky Tests
    Parry, Owain, Kapfhammer, Gregory M.,  Hilton, Michael, and McMinn, Phil
    In 44th IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice, ICSE (SEIP) 2022, Pittsburgh, PA, USA, May 22-24, 2022 2022
  5. Evaluating Features for Machine Learning Detection of Order- and Non-Order-Dependent Flaky Tests
    Parry, Owain, Kapfhammer, Gregory M.,  Hilton, Michael, and McMinn, Phil
    In 15th IEEE Conference on Software Testing, Verification and Validation, ICST 2022, Valencia, Spain, April 4-14, 2022 2022
  6. A retrospective study of one decade of artifact evaluations
    Winter, Stefan, Timperley, Christopher Steven, Hermann, Ben, Cito, Jürgen, Bell, Jonathan,  Hilton, Michael, and Beyer, Dirk
    In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2022, Singapore, Singapore, November 14-18, 2022 2022
  7. Reproduction Package (Docker container) for the FSE 2022 Article ’A Retrospective Study of one Decade of Artifact Evaluations’ (Version 1.0: Submission to FSE 2022 Artifact Evaluation)
    Winter, Stefan, Timperley, Chris, Hermann, Ben, Cito, Jürgen, Bell, Jonathan,  Hilton, Michael, and Beyer, Dirk
    In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2022, Singapore, Singapore, November 14-18, 2022 Aug 2022
  8. Reproduction Package (Docker container) for the ESEC/FSE 2022 Article ’A Retrospective Study of one Decade of Artifact Evaluations’ (Version 1.1: Update to include Camera Ready changes)
    Winter, Stefan, Timperley, Chris, Hermann, Ben, Cito, Jürgen, Bell, Jonathan,  Hilton, Michael, and Beyer, Dirk
    In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2022, Singapore, Singapore, November 14-18, 2022 Sep 2022

2021

  1. Understanding and improving artifact sharing in software engineering research
    Timperley, Christopher Steven, Herckis, Lauren, Le Goues, Claire, and Hilton, Michael
    Empir. Softw. Eng. Sep 2021
  2. FlakeFlagger: Predicting Flakiness Without Rerunning Tests
    Alshammari, Abdulrahman, Morris, Christopher,  Hilton, Michael, and Bell, Jonathan
    In 43rd IEEE/ACM International Conference on Software Engineering: Companion Proceedings, ICSE Companion 2021, Madrid, Spain, May 25-28, 2021 Sep 2021
  3. FlakeFlagger: Predicting Flakiness Without Rerunning Tests
    Alshammari, Abdulrahman, Morris, Christopher,  Hilton, Michael, and Bell, Jonathan
    In 43rd IEEE/ACM International Conference on Software Engineering, ICSE 2021, Madrid, Spain, 22-30 May 2021 Sep 2021
  4. Combining Collaborative Reflection based on Worked-Out Examples with Problem-Solving Practice: Designing Collaborative Programming Projects for Learning at Scale
    Sankaranarayanan, Sreecharan, Kandimalla, Siddharth Reddy, Bogart, Christopher, Murray, R. Charles,  Hilton, Michael, Sakr, Majd, and Rosé, Carolyn P.
    In L@S’21: Eighth ACM Conference on Learning @ Scale, Virtual Event, Germany, June 22-25, 2021 Sep 2021

2020

  1. Agent-in-the-Loop: Conversational Agent Support in Service of Reflection for Learning During Collaborative Programming
    Sankaranarayanan, Sreecharan, Kandimalla, Siddharth Reddy, Hasan, Sahil, An, Haokang, Bogart, Christopher, Murray, R. Charles,  Hilton, Michael, Sakr, Majd, and Rosé, Carolyn P.
    In Artificial Intelligence in Education - 21st International Conference, AIED 2020, Ifrane, Morocco, July 6-10, 2020, Proceedings, Part II Sep 2020
  2. Creating Opportunities for Transactive Exchange for Learning in Performance-Oriented Team Projects
    Sankaranarayanan, Sreecharan, Kandimalla, Siddharth Reddy, Hasan, Sahil, An, Haokang, Bogart, Christopher, Murray, R. Charles,  Hilton, Michael, Sakr, Majd, and Rosé, Carolyn P.
    In Interdisciplinarity in the Learning Sciences: Proceedings of the 14th International Conference of the Learning Sciences, ICLS 2020, [Nashville, Tennessee, USA], Online Conference, June 19-23, 2020 Sep 2020
  3. Flake It ’Till You Make It: Using Automated Repair to Induce and Fix Latent Test Flakiness
    Parry, Owain, Kapfhammer, Gregory M.,  Hilton, Michael, and McMinn, Phil
    In ICSE ’20: 42nd International Conference on Software Engineering, Workshops, Seoul, Republic of Korea, 27 June - 19 July, 2020 Sep 2020
  4. It Takes a Village to Build a Robot: An Empirical Study of The ROS Ecosystem
    Kolak, Sophia, Afzal, Afsoon, Le Goues, Claire,  Hilton, Michael, and Timperley, Christopher Steven
    In IEEE International Conference on Software Maintenance and Evolution, ICSME 2020, Adelaide, Australia, September 28 - October 2, 2020 Sep 2020
  5. A Study on Challenges of Testing Robotic Systems
    Afzal, Afsoon, Le Goues, Claire,  Hilton, Michael, and Timperley, Christopher Steven
    In 13th IEEE International Conference on Software Testing, Validation and Verification, ICST 2020, Porto, Portugal, October 24-28, 2020 Sep 2020
  6. Empirical Study of Restarted and Flaky Builds on Travis CI
    Durieux, Thomas, Le Goues, Claire,  Hilton, Michael, and Abreu, Rui
    In MSR ’20: 17th International Conference on Mining Software Repositories, Seoul, Republic of Korea, 29-30 June, 2020 Sep 2020

2019

  1. An Intelligent-Agent Facilitated Scaffold for Fostering Reflection in a Team-Based Project Course
    Sankaranarayanan, Sreecharan, Wang, Xu, Dashti, Cameron, An, Marshall, Ngoh, Clarence,  Hilton, Michael, Sakr, Majd, and Rosé, Carolyn P.
    In Artificial Intelligence in Education - 20th International Conference, AIED 2019, Chicago, IL, USA, June 25-29, 2019, Proceedings, Part II Sep 2019
  2. Online Mob Programming: Bridging the 21st Century Workplace and the Classroom
    Sankaranarayanan, Sreecharan, Wang, Xu, Dashti, Cameron, An, Haokang, Ngoh, Clarence,  Hilton, Michael, Sakr, Majd, and Rosé, Carolyn P.
    In 13th International Conference on Computer Supported Collaborative Learning, CSCL 2019, Lyon, France, June 17-21, 2019 Sep 2019
  3. Group Formation in the Digital Age: Relevant Characteristics, Their Diagnosis, and Combination for Productive Collaboration
    Tsovaltzi, Dimitra, Weinberger, Armin, Schmitt, Lara Johanna, Bellhäuser, Henrik, Müller, Adrienne, Konert, Johannes, Röpke, René, Gijlers, Hannie, Eshuis, Elise H., Eysink, Tessa H. S., Erkens, Melanie, Manske, Sven, Hoppe, Heinz Ulrich, Bodemer, Daniel, Sankaranarayanan, Sreecharan, Dashti, Cameron, Bogart, Christopher, Wang, Xu, Sakr, Majd,  Hilton, Michael, and Rosé, Carolyn P.
    In 13th International Conference on Computer Supported Collaborative Learning, CSCL 2019, Lyon, France, June 17-21, 2019 Sep 2019
  4. Graph-based mining of in-the-wild, fine-grained, semantic code change patterns
    Nguyen, Hoan Anh, Nguyen, Tien N., Dig, Danny, Nguyen, Son, Tran, Hieu, and Hilton, Michael
    In Proceedings of the 41st International Conference on Software Engineering, ICSE 2019, Montreal, QC, Canada, May 25-31, 2019 Sep 2019
  5. The Problem of Packaging Curricular Materials
    Bart, Austin Cory,  Hilton, Michael, Edmison, Bob, and Conrad, Phill
    In Proceedings of the 50th ACM Technical Symposium on Computer Science Education, SIGCSE 2019, Minneapolis, MN, USA, February 27 - March 02, 2019 Sep 2019
  6. Online Mob Programming: Effective Collaborative Project-Based Learning
    Hilton, Michael, and Sankaranarayanan, Sreecharan
    In Proceedings of the 50th ACM Technical Symposium on Computer Science Education, SIGCSE 2019, Minneapolis, MN, USA, February 27 - March 02, 2019 Sep 2019
  7. A conceptual replication of continuous integration pain points in the context of Travis CI
    Widder, David Gray,  Hilton, Michael, Kästner, Christian, and Vasilescu, Bogdan
    In Proceedings of the ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/SIGSOFT FSE 2019, Tallinn, Estonia, August 26-30, 2019 Sep 2019

2018

  1. A study of the organizational dynamics of software teams
    Hilton, Michael, and Begel, Andrew
    In Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice, ICSE (SEIP) 2018, Gothenburg, Sweden, May 27 - June 03, 2018 Sep 2018
  2. DeFlaker: automatically detecting flaky tests
    Bell, Jonathan, Legunsen, Owolabi,  Hilton, Michael, Eloussi, Lamyaa, Yung, Tifany, and Marinov, Darko
    In Proceedings of the 40th International Conference on Software Engineering, ICSE 2018, Gothenburg, Sweden, May 27 - June 03, 2018 Sep 2018
  3. A large-scale study of test coverage evolution
    Hilton, Michael, Bell, Jonathan, and Marinov, Darko
    In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, ASE 2018, Montpellier, France, September 3-7, 2018 Sep 2018
  4. I’m leaving you, Travis: a continuous integration breakup story
    Widder, David Gray,  Hilton, Michael, Kästner, Christian, and Vasilescu, Bogdan
    In Proceedings of the 15th International Conference on Mining Software Repositories, MSR 2018, Gothenburg, Sweden, May 28-29, 2018 Sep 2018

2017

  1. Deriving Age Diverse Personas from a Participatory Design Study on Home Electricity Feedback
    Dodge, Jonathan,  Hilton, Michael, Metoyer, Ronald A., Hunter, Josie, Smeltzer, Karl, Vijay, Catharina, and Atkinson, Andrew
    In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, May 06-11, 2017, Extended Abstracts Sep 2017
  2. Hazelnut: a bidirectionally typed structure editor calculus
    Omar, Cyrus, Voysey, Ian,  Hilton, Michael, Aldrich, Jonathan, and Hammer, Matthew A.
    In Proceedings of the 44th ACM SIGPLAN Symposium on Principles of Programming Languages, POPL 2017, Paris, France, January 18-20, 2017 Sep 2017
  3. Trade-offs in continuous integration: assurance, security, and flexibility
    Hilton, Michael, Nelson, Nicholas, Tunnell, Timothy, Marinov, Darko, and Dig, Danny
    In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2017, Paderborn, Germany, September 4-8, 2017 Sep 2017
  4. Toward Semantic Foundations for Program Editors
    Omar, Cyrus, Voysey, Ian,  Hilton, Michael, Sunshine, Joshua, Le Goues, Claire, Aldrich, Jonathan, and Hammer, Matthew A.
    In 2nd Summit on Advances in Programming Languages, SNAPL 2017, May 7-10, 2017, Asilomar, CA, USA Sep 2017

2016

  1. Usage, costs, and benefits of continuous integration in open-source projects
    Hilton, Michael, Tunnell, Timothy, Huang, Kai, Marinov, Darko, and Dig, Danny
    In Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, ASE 2016, Singapore, September 3-7, 2016 Sep 2016
  2. API code recommendation using statistical learning from fine-grained changes
    Nguyen, Anh Tuan,  Hilton, Michael, Codoban, Mihai, Nguyen, Hoan Anh, Mast, Lily, Rademacher, Eli, Nguyen, Tien N., and Dig, Danny
    In Proceedings of the 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, Seattle, WA, USA, November 13-18, 2016 Sep 2016
  3. Understanding and improving continuous integration
    Hilton, Michael
    In Proceedings of the 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, Seattle, WA, USA, November 13-18, 2016 Sep 2016
  4. TDDViz: Using Software Changes to Understand Conformance to Test Driven Development
    Hilton, Michael, Nelson, Nicholas, McDonald, Hugh, McDonald, Sean, Metoyer, Ronald A., and Dig, Danny
    In Agile Processes, in Software Engineering, and Extreme Programming - 17th International Conference, XP 2016, Edinburgh, UK, May 24-27, 2016, Proceedings Sep 2016

2014

  1. Refactoring local to cloud data types for mobile apps
    Hilton, Michael, Christi, Arpit, Dig, Danny, Moskal, Michal, Burckhardt, Sebastian, and Tillmann, Nikolai
    In Proceedings of the 1st International Conference on Mobile Software Engineering and Systems, MOBILESoft 2014, Hyderabad, India, June 2-3, 2014 Sep 2014