New tools for open research and online collaborations
Many tools and platforms for open research already exist; which features are still missing in these tools? How can we imagine innovations that go beyond ‘just another tool’—that are game changers?
Problem of existence of lots of different tools: by using them, we don’t maximize common knowledge. The more tools we create, the more we dilute this knowledge.
Need a cloud/electronic Kiva!
What works with existing systems
- Conversational platforms (blogs, SO, etc.)
- Peer review process? With perhaps some changes, e.g., editors mediate more actively
- But is an open science ethos compatible with blind review?
Key unmet needs of existing tools
- Who to trust?
- How do we develop metrics of “quality of character”? This would encompass…
- History of contributions (quantity work per project; retractions; some classifications of leaders, contributors, followers)
- Perhaps a test project to assess interested collaborators, esp. graduate students, post-docs
- How to measure intrinsic motivation, students who seek opportunities actively?
- How do we develop metrics of “quality of character”? This would encompass…
- How to democratize access to collaboration networks?
- How to lower barriers to entry?
Existing tools
- PeerLibrary, Hypothes.is
- Fermat’s Library
- Fermat’s library has a Chrome extension called Librarian for commenting on arXiv papers. If it works that would be great, but it is missing users - I tried it on several maths papers on arXiv but there have been no comments. This may be due to some design problems, or simply lack of exposure to researchers.
- Github
- Github is a great tool for open research. The only problems are 1. Steep learning curve for those not familiar with Git / UNIX; 2. No maths rendering support - yes one can host .tex files on Github, but there is no way to have a discussion involving mathematics on Github; 3. Not suitable for hosting data of nontrivial size, but this can be mitigated by hosting data on e.g. Dropbox and providing a link on Github.
- (what’s missing in) Wikipedia
- No one has control of the contents. One’s contribution can be easily overwritten by another person
- Deletionist problem: any entry deemed “not notable enough” risks fast deletion. I imagine many cutting edge research topics can get deleted for this.
- No attribution/credit or performance measure
- No original research.
- Stackexchange / mathoverflow
- Q&A websites, not meant for discussion like Github issues
- Questions can be put on hold / locked etc. due to all kinds of reasons even if legitimate
- Technical discussion
- Discourse https://www.discourse.org/
- Hackernews
- Great forum for high quality discussions, heavily moderated
- But not for science research
- Online document editing: overleaf/sharelatex, google docs
- Overleaf/sharelatex are just for latex and relatively slow to compile
- Need to be online to access/edit
- Google docs is not ideal from a privacy point of view
- Open knowledge map
- Use of meta data to create knowledge maps for specific keywords
- Would be even better with a time series (e.g. how did a discourse develop over time; i.e. new keywords show up and become bigger or a keyword enters a new field …)
- arXiv
- Open Journals http://www.theoj.org/
- Online collaboration/publishing
- Open Science Framework https://osf.io/
- Pubpub https://www.pubpub.org/
- knowen.org
- New/better interactive ways to present technical information (read only)
- Interactive geosci resource https://geosci.xyz/
- Rowan's dream https://row1.ca/on-my-website-2018
- Victor's dream http://worrydream.com/#!/ScientificCommunicationAsSequentialArt
Higher level concepts
- data mists
- blockchain republic
- moon shot
A hacker news for science would be useful. For one thing, we can post links to results of this workshop on it for maximum exposure.
If a tool is to be universally useful (for all scientists), it needs to solve universal problems. Do scientists have universal problems that one tool can solve?