Update canvas.md

Author: Open Ethics

canvas.md

@@ -1,116 +1,123 @@
 # The Open Ethics Canvas v1.0
 modified: 2021-08-07
 
-Designed For
-Designed By
-Date
-Version
+---
+
+- Designed For
+- Designed By
+- Date
+- Version
+
+
+---
 
 ## Scope
-What is this product designed for?
-In which context it operates?
+- What is this product designed for?
+- In which context it operates?
 
 ## Users
-What type of users does this product have? (customers/admins/ etc)
-What are their roles?
+- What type of users does this product have? (customers/admins/ etc)
+- What are their roles?
 
 ## Training Data
-How was the training data collected?
-How do you ensure its representativeness?
-Does your training dataset contain personal data?
-Who annotates the data and how quality is controlled?
-What is the data labeling process that you employ?
+- How was the training data collected?
+- How do you ensure its representativeness?
+- Does your training dataset contain personal data?
+- Who annotates the data and how quality is controlled?
+- What is the data labeling process that you employ?
 
 ## Algorithms & Source Code
-Do you use open or proprietary sources? Why? Which?
-Who in the team is setting the heuristics (rules) which influence the output?
-How do you ensure the quality of used third-party codebases?
-What is your process of making the key architectural choices?
+- Do you use open or proprietary sources? Why? Which?
+- Who in the team is setting the heuristics (rules) which influence the output?
+- How do you ensure the quality of used third-party codebases?
+- What is your process of making the key architectural choices?
 
 ## Decision Space
-What exactly does the product do?
-Can you provide the list of all possible outputs?
-How incorrectly supplied inputs are spotted?
-Is there anomaly detection in place?
+- What exactly does the product do?
+- Can you provide the list of all possible outputs?
+- How incorrectly supplied inputs are spotted?
+- Is there anomaly detection in place?
 
 ## Key Stakeholders
-Who are the key stakeholders?
-What influence do they have over the product?
-How do stakeholders interact with each other?
-How is the power distributed?
+- Who are the key stakeholders?
+- What influence do they have over the product?
+- How do stakeholders interact with each other?
+- How is the power distributed?
 
 ## Values & Interests
-What values do stakeholders/users have?
-Where these values can clash or create tensions?
-What is known at the moment and how assumptions are tested?
-How can you align your technology to the values you want to support/people desire?
+- What values do stakeholders/users have?
+- Where these values can clash or create tensions?
+- What is known at the moment and how assumptions are tested?
+- How can you align your technology to the values you want to support/people desire?
 
 ## Personal Data Processing
-Which personal data is collected by the product?
-What is the purpose of collecting personal data?
-How is this data processed? Used? Stored? Deleted?
+- Which personal data is collected by the product?
+- What is the purpose of collecting personal data?
+- How is this data processed? Used? Stored? Deleted?
 
 ## Components & Subprocessing
-Which third parties are engaged by the product?
-How do you evaluate the potential impacts of API on the quality of your product’s output?
-How do you check the reliability of your data processing contractors?
+- Which third parties are engaged by the product?
+- How do you evaluate the potential impacts of API on the quality of your product’s output?
+- How do you check the reliability of your data processing contractors?
 
 ## Failure modes
-How failures are detected and monitored?
-What are the possible failures of a product?
-What actions are performed if a product fails?
+- How failures are detected and monitored?
+- What are the possible failures of a product?
+- What actions are performed if a product fails?
 
 ## Explainability
-How is interpretability defined for the system?
-What interpretability methods are used?
-What metrics are used in result interpretation?
-How interpretations of the output are communicated?
+- How is interpretability defined for the system?
+- What interpretability methods are used?
+- What metrics are used in result interpretation?
+- How interpretations of the output are communicated?
 
 ## Human in the Loop (HITL)
-What is the role of a human agent in the validation/verification of the outputs?
-What is the role of a human agent in refining the model performance?
-What is the decision-making power assigned to human agents responsible for the quality of output?
+- What is the role of a human agent in the validation/verification of the outputs?
+- What is the role of a human agent in refining the model performance?
+- What is the decision-making power assigned to human agents responsible for the quality of output?
 
 ## Model Performance Metrics
-Which metrics are used to evaluate the product performance?
-Which measures are used to re-evaluate Accuracy, Recall, Precision, and F1- Score?
+- Which metrics are used to evaluate the product performance?
+- Which measures are used to re-evaluate Accuracy, Recall, Precision, and F1- Score?
 
 ## Decision Feedback & Objection
-How does the product allow for structured feedback?
-How can the user challenge the application output?
-Which are the third parties involved in claims/objection resolution?
+- How does the product allow for structured feedback?
+- How can the user challenge the application output?
+- Which are the third parties involved in claims/objection resolution?
 
 ## Impact Assessment
-What potential harms can your product cause? (loss of opportunity, discrimination, economic loss, social stigma, detriment, emotional distress, etc)?
-What are the risks of the product’s failure?
-What impact product can cause if deployed at scale?
-How is the product influencing the existing markets?
+- What potential harms can your product cause? (loss of opportunity, discrimination, economic loss, social stigma, detriment, emotional distress, etc)?
+- What are the risks of the product’s failure?
+- What impact product can cause if deployed at scale?
+- How is the product influencing the existing markets?
 
 ## Regulatory Landscape
-What is the regulatory context in which the product operates?
-Is the model portable to other market verticals?
-What are the involved regulatory risks?
+- What is the regulatory context in which the product operates?
+- Is the model portable to other market verticals?
+- What are the involved regulatory risks?
 
 ## Mitigation
-How do you test for bias and fairness? What fairness definitions do you employ and why?
-Does your team reflect a diversity of opinions, backgrounds, and thoughts?
-Do you have a process for redress if people are harmed by the outputs?
-How fast can you shut down your product in production if it behaves badly?
-Who and how should be informed?
+- How do you test for bias and fairness? What fairness definitions do you employ and why?
+- Does your team reflect a diversity of opinions, backgrounds, and thoughts?
+- Do you have a process for redress if people are harmed by the outputs?
+- How fast can you shut down your product in production if it behaves badly?
+- Who and how should be informed?
 
 ## Changes in Behavior
-Do the automated decisions have significant legal or similar effects on the users/stakeholders?
-How the users may change their behavior after use?
-What are the potentials for power imbalance?
-Group Interactions
-What are potential changes in group behavior?
-How is the product addressing group interests?
-What new groups could be born due to the product deployment at scale?
+- Do the automated decisions have significant legal or similar effects on the users/stakeholders?
+- How the users may change their behavior after use?
+- What are the potentials for power imbalance?
+- Group Interactions
+- What are potential changes in group behavior?
+- How is the product addressing group interests?
+- What new groups could be born due to the product deployment at scale?
 
 ## Comments
 
+
 ---
 
+
 The Open Ethics Canvas v1.0 © 2021 by Open Ethics contributors
 Designed by Nikita Lukianets, Alice Pavaloiu, Vlad Nekrutenko
 Licensed under Attribution-ShareAlike 4.0 International