In addition to my research on attention and cognition, I am actively involved in open science initiatives that promote transparency, reproducibility, and rigorous research practices. My work in this area combines methodological research, software development, and collaborative replication efforts to better understand how research is shared, evaluated, and reused.
This project examines whether shared research data are not only available, but also usable. In a recent paper in Behavior Research Methods, my collaborators and I analyzed shared datasets from the visual cognition literature, focusing on how core variables such as participant identifiers, trial identifiers, accuracy, and response times are named and documented. We found substantial variability in these basic conventions, as well as broader issues related to unclear documentation, inaccessible files, and uncurated software exports. This work highlights the need for clearer community standards that make shared datasets easier to interpret, reuse, and build upon.
My collaborators and I published this research in Behavior Research Methods. You can check out the PDF here.
This figure illustrates the diversity of column names used for participant identifiers in the datasets we examined. Despite referring to the same fundamental variable, researchers used many different labels, demonstrating the lack of standardized naming conventions and the challenges this creates for data reuse.
Output It Forward is a browser extension designed to support open science and data curation workflows. The tool automatically detects open data indicators in scholarly articles, including data availability statements, repository links, and open-science phrases in both webpages and PDFs. By allowing users to collect and export this information without programming expertise, Output It Forward aims to make open data screening more efficient and accessible for researchers, editors, librarians, and data curators.
A manuscript currently under review at the International Journal of Digital Curation will provide detailed guidance on using the extension and contributing to its continued development. Community contributions are warmly welcomed and are essential for keeping OIF’s phrase dictionary and repository coverage broad, accurate, and current (though our GitHub)
My collaborators and I have also contributed to reproducibility initiatives through the Institute for Replication by participating in a Replication Game. These collaborative events bring together teams of researchers to reproduce published findings by checking code, rerunning analyses, identifying potential errors, and assessing the robustness of the original results. The Replication Game is conducted in partnership with Psychological Science, with the collective findings from participating teams contributing to large-scale publications on research reproducibility.
Our team's report can be accessed here.
Beyond its scientific value, participating in a Replication Game is very fun! Although the event itself takes place over a single day, our team continued working together in the following weeks to refine our analyses and prepare our report.