- Acceptance Testing#
A level of the software testing process where a system is tested for acceptability. The purpose of this test is to evaluate the system’s compliance with the project requirements and assess whether it is acceptable for the purpose.
Where contributions to a project that don’t qualify as authorship are written. It records the contributors name and the contribution that they made is described.
Command used to add files to the staging area. Allows the user to specify which files or directories to include in the next commit.
- Adversarial Learning#
A process under which learning systems are exposed to negative stimuli, such as the addition of purposefully manipulated data samples, in order to obtain potentially-beneficial effects. Examples of this technique may include the addition of additional learning objectives which penalise unwanted characteristics of a learning system, for example the ability to distinguish between data records based on inappropriate demographic attributes.
- Artificial intelligence (AI)#
The ability of synthetic computational systems to perform tasks and activities usually associated with biological, especially human, mental and intellectual capabilities. Also the field of study associated with imbuing synthetic systems with these capabilities. See also Machine Learning (ML)
Authors in this context are the contributors to The Turing Way project who have made a substantial contribution to the project such as writing a subchapter, facilitating community interactions, maintaining project’s infrastructure and supporting the participation of others through mentored-contributions. All authors are named co-authors on the book as a whole.
A web-based service which allows users to upload and share fully-functioning versions of their projects in an environment they define.
A service which generates Binders. The most widely-used is mybinder.org, which is maintained by the Binder team. It is possible to create other BinderHubs which can support more specialised configurations. One such configuration could include authentication to enable private repositories to be shared amongst close collaborators.
To make a Binder of a project.
A parallel version of a repository. Although it is contained within the same repository it allows you to develop it separately and then merge changes back into the ‘live’ repository or with other branches when appropriate.
This is an error, flaw or fault in a computer program or system that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.
A group of jobs. For example, a build might have two jobs, each of which tests a project with a different version of a programming language. A build finishes when all of its jobs are finished.
Git command to switch to a specific file, branch, or commit. Allows you to activate older versions of files or commits or switch between active branches.
- Citizen Science#
The inclusion of members of the public in scientific research.
Copy of an existing Git repository, normally from some remote location to your local environment. When you clone a repo you copy its entire history as well as all branches.
- Code Coverage#
A measure which describes how much of the source code is exercised by the test suite.
- Code of Conduct#
Guidelines that establish the kind of behaviour encouraged in the community, outline the process by which problems or violations of the guidelines will be addressed and who will be in charge of enforcing them.
- Code Review#
An additional way of testing code quality. Code review gets another programmer to look over the new code and assess it. The goal is to point out strengths and also potential areas of improvement.
When a senior researcher forces a junior researcher to include a gift or guest author.
Snapshot of project history. A commit can be made after changes of a single file or a range of files and directories.
- Commit Message#
A message the user can attach to a commit to explain what it contains.
- Communication Channel#
The method of communication established for projects that might include mailing lists, community forums, chats and/or social media.
- Community Member#
People who use the project. They might be active in conversations or express their opinion on the project’s direction.
- Computational Environment#
Features of a computer which can impact the behaviour of work done on it, such as its operating system, what software it has installed, and what versions of software packages are installed.
A commonly used package management system.
A collective or community group authorship model. All members of the consortium are considered authors and are usually required to be listed in the published article although sometimes the article is published in the groups name. If not all members of the consortium agree to the responsibilities of authorship, the members that are authors will be listed separately from those who are not.
Lightweight files that can encapsulate an entire computational environment including its operating system, customised settings, software and files.
- Continuous Delivery#
It automates and runs the steps required to build and test a project.
- Continuous Deployment#
It automatically deploys each time a code change is made.
- Continuous Integration#
It is the practice of integrating changes to a project made by individuals into a main, shared version frequently (usually multiple times per day). Also called CI.
- Contributing Guidelines#
Guidelines outlining how a person should go about contributing to an open source project.
Everyone who has contributed something back to the project. These are members of a research project that have done some work that has made a contribution to the overall completion of the research. This could be a small contribution such as fixing a bug in software or a much larger contribution such as writing an academic article.
The person who administers an academic article for the research group. They are responsible for receiving the reviewers comments, the proofs, corresponding with the editors and their details are printed on the final version of the published article.
- CRediT Taxonomy#
The CRediT Taxonomy is a high-level taxonomy, including 14 roles, that can be used to represent the roles typically played by contributors to scientific scholarly output. The roles describe each contributor’s specific contribution to the scholarly output. These details are becoming increasingly required by journals as well as authors meeting authorship criteria.
- Data repository#
A storage place on the internet where resources (data, software, publications or anything else) can be stored and accessed. Often data repositories provide long term preservation and persistent identifiers for the research objects stored. A data repository is the container for data and metadata, whereas a database is the structure that is used to store and manage that data.
- Differential privacy#
A strategy to provide quantifiable privacy guarantees when working with datasets containing personal information. The idea is that if the effect of making a single arbitrary substitution of a single record within the dataset on an aggregated query is below a specific threshold, then the result of any such query would not reveal substantial information about any individual member.
Data Management Plan.
Domain Name System. The system which translates domain names, for example the-turing-way.netlify.app, to the IP addressess used by computer networks.
- Docker Container#
An active computational environment executed from a Docker image.
A file used for creating Docker images
- Docker Image#
A machine-readable set of instructions to create a specified computational environment.
- Docker Registry#
A storage and distribution system for named Docker images. The registry allows Docker users to pull images locally, as well as push new images to the registry (given adequate access permissions when applicable). Such systems are often hosted in the cloud for ease of access.
- Digital Object Identifier#
A digital object identifier (DOI) is a persistent identifier or handle used to identify objects uniquely, standardized by the International Organization for Standardization (ISO). An implementation of the Handle System, DOIs are in wide use mainly to identify academic, professional, and government information, such as journal articles, research reports, data sets, and official publications. However, they also have been used to identify other types of information resources, such as commercial videos.
Theory of knowledge and deals with how knowledge is gathered and from which sources. In research terms your view of the world and of knowledge strongly influences your interpretation of data and therefore your philosophical standpoint should be made clear from the beginning. (Source: Post by Nicole Brown)
- Equitable, Diverse and Inclusive Practices#
Ensuring scholarship is open to anyone without barriers based on factors such as race, background, gender, and sexual orientation.
- End to End Test#
A test that runs the program from beginning to end and verifies that the output is correct.
Findable, Accessible, Interoperable and Reusable.
- Federated Learning#
A design paradigm for information processing technologies in which the processing of information is decentralized and local data samples are not exchanged in full with a central entity. Used in machine learning to denote a system where learning is carried out via multiple nodes through the exchange of parameter values or other learning products rather than data samples directly.
The most prominent position in academic authorship. It conveys this person’s position as the researcher who has made the greatest contribution to the research.
Combining replicable and robust findings allow us to form generalisable results. Note that running an analysis on a different software implementation and with a different dataset does not provide generalised results. There will be many more steps to know how well the work applies to all the different aspects of the research question. Generalisation is an important step towards understanding that the result is not dependent on a particular dataset nor a particular version of the analysis pipeline.
Version control system that GitHub is built around. It is a widely used open source distributed version control system developed by the author of Linux.
An online code hosting and version control service. It has a great many features to aid collaboration between users, and hosts a large number of open source projects.
GitLab is a web-based DevOps lifecycle tool that provides a Git-repository manager providing wiki, issue-tracking and continuous integration and deployment pipeline features, using an open-source license, developed by GitLab Inc.
It is a person who writes an academic article without having carried out the research. It could be a professional writer. They would often not qualify as an author under the ICMJE criteria for authorship.
People who are listed as authors but who did not make significant contributions to the research. This is also known as a guest author.
Some journals permit the use of group names but many require contributors to be listed and/or the writing group to be named. This is the same as shared authorship.
As well as fulfilling criteria for being a named author, some journals require one or more authors that take responsibility for the integrity of the work as a whole from inception to the published article.
Inherent qualities or characteristics of something that make it potentially harmful.
The latest commit on the branch which is currently checked out.
A package manager for Kubernetes applications.
This is when an individual becomes a named author even though they have not made a substantial contribution and/or met authorship criteria.
A service which makes data, such as a website, available on the internet. It is possible to self-host, using your own infrastructure. However, it is common to use a third-party, often commerical, hosting provider.
- Human Readable#
A human readable medium or human readable format is any encoding of data or information that can be naturally read by humans. Some human readable formats, such as PDF, are not machine readable as they are not structured data, such as the representation of the data on disk does not represent the actual relationships present in the data.
An identifier is a key or name used as label or the identity of a unique class of objects, represnting an idea or physical objects. Also see: Persistent Identifier, Digital Object Identifier.
Files used for generating containers.
- Inner source#
Inner source is the use of open source software development best practices (open collboration, open communication and peer review practices) and the establishment of an open source-like culture within an organisation for the development of a non-open source output.
- Integration Testing#
A level of software testing where individual units are combined and tested as a group. The purpose of this level of testing is to expose faults in the interaction between integrated units.
The way in which a person’s identities (gender, race, class, sexual orientation, physical ability and others) can overlap and intersect to form a unique experience of social status, discrimination or oppression. This term was coined by Professor Kimberlé Crenshaw.
Bug tracking system for GitHub. Collaborators can use issues to report bugs, request features, or set milestones for projects. Issues are tracked, reported, and closed by collaborators during the development process. They’re a great way of communicating with your team and reporting progress.
- Issue Tracking#
The process of tracking current issues on the project, such as bug fixing, rolling out new features or community engagement plans.
Autonomous computational cluster manager.
This is a legal document that sets out the permissions for creative and academic work. It explains copyright, ensures proper attribution and sets out how others can copy, distribute and make use of the works.
Usually the person in the research team with a supervisory role such as a PhD supervisor or Principal investigator. This is discipline dependent as sometimes the last author is the person that has made the smallest contribution to the research.
- Machine Learning (ML)#
Methods which allow computational systems to extract regularities from data which permit them to perform tasks such as prediction and categorisation in a way that is at least superfially analogous to how biological systems learn. A broard sub-field of Artificial Intelligence (AI) generally distinct from Symbolic Artificial inteligence, also know as GOFAI (good old fashioned AI), which focuses on programmed systems which perform logical reasoning. Machine Learning (ML) is sometimes used interchangeably with Artificial Intelligence (AI), but often employed to differentiate concrete or extant systems and algorithms from broarder and more speculative approaches to synthetic intelligent systems.
- Machine Readable#
Machine readable refers to documents, data or other digital outputs whose content can be readily processed by computers. Such documents are distinguished from machine readable data by virtue of having sufficient structure to provide the necessary context to support the business processes for which they are created. Machine readable data can be defined as data in a format that can be easily processed by a computer without human intervention while ensuring no semantic meaning is lost.
The repository’s main branch. Depending on the workflow, it is the one people work on or the one where the integration happens. This used to be called ‘Master’ in Github.
Contributors who are responsible for driving the vision and managing the organizational aspects of the project. They may also be authors and/or owners of the project.
A text file that contains the configuration for the build.
The process of combining branches. Changes made on one or more branches are applied to another.
- Merge Conflict#
Incompatibilities between branches being merged.
Data used to describe other data. For example (35, 33, 27, 30, 33) is data but the units (miles per hour) and the fact these are the speeds of cars on a certain stretch of road is metadata.
- Mock Test#
Replace a real object with a pretend one to use when running tests.
- Open Access#
Making all published outputs freely accessible for maximum use and impact.
- Open Access publishing (gratis)#
The practice of making research publications available to anyone to read without charge.
- Open Access Publishing (libre)#
Libre open access is gratis, meaning the research is available free of charge, but it goes further by granting users the right to copy, reuse, and remix the publication.
- Open data#
Documenting and sharing research data openly for re-use.
- Open Educational Resources#
Making educational resources publicly available to be re-used and modified.
- Open Source Hardware#
Hardware whose design is made publicly available so that anyone can study, modify, distribute, make, and sell the design or hardware based on that design.
- Open License#
A license is a document that specifies what can and cannot be done with a work. It grants permissions and states restrictions. Broadly speaking, an open license is one that grants permission to access, re-use and redistribute a work with few or no restrictions.
- Open Notebooks#
An emerging practice, documenting and sharing the experimental process of trial and error (see Open Notebooks).
- Open Scholarship#
This is a concept that extends open research further. It relates to making other aspects of scientific research open to the public such as open educational resources, having inclusive practice and citizen science.
- Open Project#
Same as Open Science or Open Research Projects. A project in which a significant amount of collaboration between the core or leadership team and the wider community takes place in the form of online interactions. Community interactions should maintain transparency and openness of the project to facilitate the growth of your community.
- Open Source Software#
Documenting research code and routines, and making them freely accessible and available.
Open Researchers and Contributor iD. It is a long lasting unique identifier for you as a researcher. A persistent digital identifier for researchers’ that can be used on publications to ensure fair credit is given for all the researchers works.
The person/s who has administrative ownership over the organization or repository (not always the same as the original author).
- Package Management System#
A tool for installing, managing, and uninstalling software packages including specific versions.
- Persistent Identifier#
A long-lasting reference to a document, file, web page, or other digital object for identifying a resource that is unique, and widely understandable by a community. Also see: Digital Object Identifier.
A pattern rule is a rule that contains exactly one % character in the target, which can be used to match a part of a filename.
- Peer Review#
A process of evaluating one’s work by others working in the same field.
A persona is the detail of an imaginary user or member, based on real-world observations and understandings of existing members or potential future members.
- Persona Canvas#
The persona canvas can be used to assemble all your responses in one place, share this tangible information of your mental model (abstract concepts from our thoughts) with your colleagues and create a common language to communicate about your community members, users, and contributors.
- Phony Target#
A phony target is one that doesn’t correspond to a file on the filesystem. A target is marked as phony by making it a prerequisite of the .PHONY target.
Differences in social position and power shape identities and access in society. In acknowledging positionality, we also acknowledge intersecting social locations and complex power dynamics (also see: Intersectionality).
- Power Users#
These are people who are already familiar enough with a platform to know the gotchas and tricks that make their experience more efficient.
A preprint is a version of a scholarly or scientific paper that precedes formal peer review and publication in a peer-reviewed scholarly or scientific journal. It is usually uploaded by the authors to a public server where it is available openly.
The prerequisite(s) of a rule correspond to files or other targets in the Makefile that must be up to date before the rule is run.
- Project Design#
An early phase of the project where a project’s key features, structure, criteria for success, and major deliverables are all planned out.
- Pull Request#
Proposed changes to a remote repository. Collaborators without write access can send a pull request to the administrator with the changes they’ve made to the repo. The administrator can then approve and merge or reject the changes to the main repository. For open source projects pull requests can be sent by anyone that has forked a project.
Sending changes to a remote repo. The remote repository is updated with the changes pushed and now mirrors the local repo.
Abbreviation for research data management - see research data management for definition.
A file which contains useful information about a project such as what it is, how to use/install it, how to test it, and how to contribute to it.
One or more shell commands that are executed by Make. Usually these commands update the target of the rule.
- Regression Test#
Comparing the result of a test before and after the code has been altered. If the output has changed a problem has been introduced somewhere in the program, and an error is thrown.
A result is replicable when the same analysis performed on different datasets produces qualitatively similar answers.
A tool to build Docker images from code repositories.
A central location where resources (data, software, publications or anything else) are stored and accessed. This keyword is often shortened to ‘repo’. See Data Repository if this place is long-lived.
A result is reproducible when the same analysis steps performed on the same dataset consistently produces the same answer.
- Rendered Output#
This is what the text will look like on an online page in Github or web page
- Research Compendia#
This is a collection of all digital parts of a research project including data, code, texts (protocols, reports, questionnaires, metadata). The collection is created in such a way that reproducing all results is straight forward.
- Research Data Management#
Acronym: RDM. Refers to the organisation, storage and preservation of data created during a research project. It covers initial planning, day-to-day processes and long-term archiving and sharing. Shortened to RDM.
- Research Ethics#
Research ethics are the moral principles that govern how researchers should carry out their work. These principles are used to shape research regulations agreed by groups such as university governing bodies, communities or governments. All researchers should follow any regulations that apply to their work.
- Research Objects#
Research objects are living resources aggregating inputs, materials, methods and/or software used in research.
Suggesting changes or asking for committing something to an already created pull request.
A term that refers to the likelihood and impact of something happening. It’s often used in decision-making contexts to evaluate the potential consequences of actions
- Risk Assessment#
This is used to help choose the appropriate sustainable software concepts for your project.
- Risk Matrix#
A risk matrix is a way of quantifying what’s going on with the thing you’re interested in. One axis measures exposure in some way, and the other the impact of a mishap. The further from the origin, the more safeguards are needed to make the risk acceptable.
This is the creation of a roadmap for your project. It is an outline for the work you need to do. It covers your goals, vision and a timeline for tasks.
A result is robust when the same dataset is subjected to different analysis workflows to answer the same research question (for example one pipeline written in R and another written in Python) and a qualitatively similar or identical answer is produced. Robust results show that the work is not dependent on the specificities of the programming language chosen to perform the analysis.
An element of the Makefile that defines something that must be built, usually consists of targets, recipes, and optionally, prerequisites.
- Runtime Test#
Tests embedded within the program which are run as part of it.
- Self Archiving#
Placing a publication or other research outputs in a suitable repository, institutional or subject-based, following the possible restrictions posed by the publisher, for example an embargo period, or limits on the allowed version to be deposited in such archives.
- Self Reflection#
Activity of thinking about our thoughts, feelings, emotions, behaviour action, and the reasons that may lie behind them. Taking the time for reflection we can grow our understanding of who we are, what our values are, and why we think, feel, and act the way we do. When we self-reflect and become more conscious of what drives us, we can more easily make changes that help us more easily develop our self or improve our life including the way we conduct research (source: Berkeley Wellbeing).
Unique string of numbers of letters used to identify every commit or node in the repository.
Some journals permit the use of group names but many require contributors to be listed and/or the writing group to be named. This is the same as group authorship.
- Smoke Testing#
Very brief initial checks that ensure the basic requirements required to run the project hold. If these fail there is no point proceeding to additional levels of testing until they are fixed.
Staging the changes that will be included in the next git commit.
- Stochastic Code#
Code which, while correct, does not always output the same result. For example a program that outputs ten random numbers will generate a different result each time, despite being correct.
The structure of statements in a computer language.
- System Testing#
A level of the software testing process where a complete, integrated system is tested. The purpose of this test is to evaluate whether the system as a whole gives the correct outputs for given inputs. Also see end to end test.
The outcome of a rule in a Makefile. It is usually a file. If it is not a file, it’s a phony target.
- Test Driven Development#
A process of code development where unit tests are written before the units themselves.
- Test Stub#
Fake implementations of parts of code which are used in testing to remove dependencies.
- Test Suite#
The tests that have been written for a project.
- Testing Framework#
Tools that make writing and running tests less labour intensive.
A commonly used continuous integration platform.
A small piece of code that does one simple thing. It usually has one or a few inputs and usually a single output.
- Unit Testing#
A level of the software testing process where individual units of a software are tested. The purpose is to validate that each unit of the software performs as designed.
- Virtual Machine#
A simulated computer that can encapsulate and entire computational environment including its operating system, customised settings, software and files.
A human readable/writable markup language which used by many projects for configuration files.