From 16eaf455268419a7009024d50195ff146ff230bc Mon Sep 17 00:00:00 2001 From: Bethany Letalien Date: Tue, 12 Oct 2021 09:04:48 -0400 Subject: [PATCH 1/6] Add link to guide Did I do it right? I've forgotten everything, which ought to be fun when I start the guide--now! --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 5e039557..a46c637d 100644 --- a/README.md +++ b/README.md @@ -17,3 +17,5 @@ The ICT Baseline Alignment Validation Framework provides test cases as a way for Working Group members can use the [editor on GitHub](https://github.com/Section508Coordinators/BaselineTestPages/edit/master/README.md) to directly edit this file to add references. Members can also navigate to the [Baseline Test Pages repository](https://github.com/Section508Coordinators/BaselineTestPages) to add files to test. Static pages can be viewed via GitHub Pages from this repository at the following url: . Contributors do not need to be highly technical nor make a long-term commitment, although both skills and time can certainly be helpful. The ICT Baseline Alignment Working Group needs help developing and evaluating test cases. Accessibility advocates are also needed to spread the word about the Framework, develop a governance structure, participate in governance, develop and maintain the website, provide user experience and plain language expertise, and even provide legal support. Please visit our [How You Can Help](https://section508coordinators.github.io/BaselineTestPages/contributing.html#helping) and [How We Work](https://section508coordinators.github.io/BaselineTestPages/contributing.html#how-we-work) sections or contact us at for more information about getting involved. + +Ready to try your hand at creating a test case, test files, or both? Start by reading the [Guide for Developing Test Case and Test Files](https://section508coordinators.github.io/ICTTestingBaseline/testCaseGuide.html). From 135361f7deec0ee2f5c8259ebc9868132cb86a58 Mon Sep 17 00:00:00 2001 From: Bethany Letalien Date: Tue, 12 Oct 2021 09:40:50 -0400 Subject: [PATCH 2/6] Create testCaseGuide.md --- testCaseGuide.md | 46 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 46 insertions(+) create mode 100644 testCaseGuide.md diff --git a/testCaseGuide.md b/testCaseGuide.md new file mode 100644 index 00000000..3a3dd4df --- /dev/null +++ b/testCaseGuide.md @@ -0,0 +1,46 @@ +# Guide for Developing Test Case and Test Files +Test cases and their related test files will be used to demonstrate expected outcomes for Baseline test instructions. Each of these test instructions is mapped to a 508 requirement ([draft Appendix A of the Baseline for Web](https://federalist-78ccea55-7a06-447c-aabf-bd620b207b74.app.cloud.gov/preview/atbcb/icttestingbaseline/nextupdateafter301/AppendixA/)) in the ICT Testing Baseline for Web. + +A note on developer tools: some contributors use VSCode and others use notepad++, depending on what they have access to. This work can all be done in the GitHub website, but some tasks would be much easier with a code editor. + +Thank you for contributing your time and skills to this! + +## Baseline Alignment Resources +1. [Baseline for Web Alignment site](https://section508coordinators.github.io/baselinealignment/testcases.html) – Test Cases page +2. [Test Case map to Baseline Tests.xlsx](https://documents.max.gov/community-pages/_layouts/15/WopiFrame2.aspx?sourcedoc=%7b8C6CC728-95D2-4E54-826D-3CA97A7BCCA0%7d&action=edit) – list of all test cases for development on Max.gov +3. [Section508coordinators/baselinealignment](https://github.com/Section508Coordinators/baselinealignment) – Baseline Alignment GitHub repository +4. [ICT Baseline for Web](https://ictbaseline.access-board.gov/) – for reference. To request a change to the ICT Baseline for Web, please open a GitHub issue at . +5. [Contributing Test Case video play list](https://www.youtube.com/playlist?list=PLaqerowLitKmBu1MkZcJhu-VHmTBaDJho) - Youtube + +## Claim Your Test Case +1. Go to the [Test Case map to Baseline Tests.xlsx](https://documents.max.gov/community-pages/_layouts/15/WopiFrame2.aspx?sourcedoc=%7b8C6CC728-95D2-4E54-826D-3CA97A7BCCA0%7d&action=edit) to see a listing of all test cases that are needed. + - This spreadsheet is used for tracking of all test case development. + - All details for the test cases are included here, including a description of the test case and test file and filenames. +2. Enter your name (in the blank Assigned column) next to the test case you want to work on. +3. Change the status to “To Do” or “In Progress”, as appropriate. + +## Develop the Test Case and Associated Files +Go to the [Section508coordinators/baselinealignment GitHub repo](https://github.com/Section508Coordinators/baselinealignment) and create a new branch for your work. If you've never used GitHub, you may want to start with [Introduction to GitHub](https://lab.github.com/githubtraining/introduction-to-github). + +### Create the Test File +The Test File contains the code and includes HTML and any other supporting files needed. +1. Open an existing test file [in the GitHub repo](https://github.com/Section508Coordinators/baselinealignment), such as baselinealignment/testfiles/TF06/06.1-1-fail-1.html. Or create the new test file from scratch. +2. Save with a new filename, in the appropriate “testfiles” sub-folder (/TF##). (Create a new /TF## folder if necessary.) + - Obtain the filename from the spreadsheet. See the Test Case ID column and remove “TC”. + - Test files follow this naming convention: [Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence # of this test].html +3. Edit/create the code in the HTML test file. +4. Ensure that the relevant code that you want displayed in the test case is enclosed in `
`. (A script will display this code snippet in the test case’s Test Detail section.) + If you find that the relevant code cannot be enclosed in a `
`, please open an issue in the Baselinealignment github repo: (). +5. Commit your changes (i.e., save or upload your files to your branch). + +### Create the Test File +The Test Case file contains the description the Baseline’s evaluation of the test file. +1. Open the "_testcase_template.md" file in the "Templates" folder in the [GitHub repo](https://github.com/Section508Coordinators/baselinealignment). + Alternatively, you can copen a published test case file from the "testcases" folder, such as TC06.1-1-fail-1. +2. Create a copy of the file. +3. Rename the duplicated file with the filename identified in the spreadsheet in the Test Case ID column. The file should be saved in the “testcases” folder. Test cases follow this naming convention: + - TC[Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence #].md + - Please note that the test case starts with “TC” and is markdown file format. +4. Update the content in the front matter (enclosed by “---"). Do not modify the lines that start with “#” or the identifier terms that precede a colon.) + - Please do not edit the special characters, spaces, and blank lines, as these were inserted to format and build the page correctly. + - Below is a sample test case markdown file with the text that should be edited in italics and highlighted. The editable text follows the identifier term and colon (and sometimes, special character) in each section. From 05a3c8b0e5a8669e264756d4901b1303921070ee Mon Sep 17 00:00:00 2001 From: Bethany Letalien Date: Tue, 12 Oct 2021 10:21:09 -0400 Subject: [PATCH 3/6] Update testCaseGuide.md --- testCaseGuide.md | 71 ++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 71 insertions(+) diff --git a/testCaseGuide.md b/testCaseGuide.md index 3a3dd4df..59a7442c 100644 --- a/testCaseGuide.md +++ b/testCaseGuide.md @@ -44,3 +44,74 @@ The Test Case file contains the description the Baseline’s evaluation of the t 4. Update the content in the front matter (enclosed by “---"). Do not modify the lines that start with “#” or the identifier terms that precede a colon.) - Please do not edit the special characters, spaces, and blank lines, as these were inserted to format and build the page correctly. - Below is a sample test case markdown file with the text that should be edited in italics and highlighted. The editable text follows the identifier term and colon (and sometimes, special character) in each section. + + \# The layout must be 'testcase'; DO NOT Change `layout: testcase` + + `layout: testcase` + + \# Brief, descriptive title for the test case + + `title: Image - no accessible name or description` + + \# The Test Case ID should follow the pattern: + + \# TC\[Baseline Test Procedure #\]-\[Test Instruction #\]- + + \# \[Expected Result (pass/fail/dna)\]-\[example #\], e.g., TC05.1-1-fail-1 + + `tcid: TC06.1-1-fail-1` + + \# Description of the Test Case, the included code sample, test considerations, + \# and rationale for the expected result according to the applicable ICT + \# Baseline test + + `descr: |` (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your description entry on the next line.) + + `Detect existence of attributes that would contribute to the accessible name and accessible description computation and calculate the text alternative for the image.` + + `The code sample data input does not include any attributes that would contribute to accessible name or accessible description output. A successful test should identify a failure against Baseline 6. Images.` + + \#Reference and link to the applicable ICT Baseline test + + `app-baseline: |` (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your Baseline link entry on the next line.) + + `[6.1 Test Procedure for Meaningful Images](https://section508coordinators.github.io/ICTTestingBaseline/06Images.html#61-test-procedure-for-meaningful-images)` + + `**Baseline Test ID.**: 6.1-MeaningfulImage` + + `**Test Instruction.** 1` + + \# Expected result that the ICT Baseline would predict + + \# [Pass | Fail | DNA] + + `result: FAIL` + + \# Brief description of the rationale for the expected result + + `result-descr: The image in the code sample does not provide any attributes that would contribute to an accessible name or description text alternative output.` + + \# URL for the code sample + + \# In the sample code file, add id="tc_code" to the + + \# element that contains the relevant code snippet. + + \# + + \# Then upload the code sample to the 'testfiles' folder + + \# and provide the link (and only the url) below. + + sample: `/testfiles/TF06/06.1-1-fail-1.html` + + \# Table of test instructions, including the following table headers: + + \# Test Instruction #; Instruction Detail; Expected Test Case Result + + \# + + \# Include the table in the content section below + + + From 71a399be8a1cd76a1094166520a3b5e711e80cde Mon Sep 17 00:00:00 2001 From: Bethany Letalien Date: Tue, 12 Oct 2021 11:10:12 -0400 Subject: [PATCH 4/6] Update testCaseGuide.md --- testCaseGuide.md | 51 ++++++++++++++++++++++++++++++++++++------------ 1 file changed, 39 insertions(+), 12 deletions(-) diff --git a/testCaseGuide.md b/testCaseGuide.md index 59a7442c..5c1fd4b5 100644 --- a/testCaseGuide.md +++ b/testCaseGuide.md @@ -36,14 +36,14 @@ The Test File contains the code and includes HTML and any other supporting files ### Create the Test File The Test Case file contains the description the Baseline’s evaluation of the test file. 1. Open the "_testcase_template.md" file in the "Templates" folder in the [GitHub repo](https://github.com/Section508Coordinators/baselinealignment). - Alternatively, you can copen a published test case file from the "testcases" folder, such as TC06.1-1-fail-1. + Alternatively, you can open a published test case file from the "testcases" folder, such as TC06.1-1-fail-1. 2. Create a copy of the file. 3. Rename the duplicated file with the filename identified in the spreadsheet in the Test Case ID column. The file should be saved in the “testcases” folder. Test cases follow this naming convention: - TC[Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence #].md - Please note that the test case starts with “TC” and is markdown file format. 4. Update the content in the front matter (enclosed by “---"). Do not modify the lines that start with “#” or the identifier terms that precede a colon.) - Please do not edit the special characters, spaces, and blank lines, as these were inserted to format and build the page correctly. - - Below is a sample test case markdown file with the text that should be edited in italics and highlighted. The editable text follows the identifier term and colon (and sometimes, special character) in each section. + - Below is a sample test case markdown file with the *text that should be edited preceded by "edit:"*. The editable text follows the identifier term and colon (and sometimes, special character) in each section. \# The layout must be 'testcase'; DO NOT Change `layout: testcase` @@ -51,7 +51,7 @@ The Test Case file contains the description the Baseline’s evaluation of the t \# Brief, descriptive title for the test case - `title: Image - no accessible name or description` + `title: `edit: `Image - no accessible name or description` \# The Test Case ID should follow the pattern: @@ -59,7 +59,7 @@ The Test Case file contains the description the Baseline’s evaluation of the t \# \[Expected Result (pass/fail/dna)\]-\[example #\], e.g., TC05.1-1-fail-1 - `tcid: TC06.1-1-fail-1` + `tcid: `edit: `TC06.1-1-fail-1` \# Description of the Test Case, the included code sample, test considerations, \# and rationale for the expected result according to the applicable ICT @@ -67,29 +67,29 @@ The Test Case file contains the description the Baseline’s evaluation of the t `descr: |` (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your description entry on the next line.) - `Detect existence of attributes that would contribute to the accessible name and accessible description computation and calculate the text alternative for the image.` + edit: `Detect existence of attributes that would contribute to the accessible name and accessible description computation and calculate the text alternative for the image.` - `The code sample data input does not include any attributes that would contribute to accessible name or accessible description output. A successful test should identify a failure against Baseline 6. Images.` + edit: `The code sample data input does not include any attributes that would contribute to accessible name or accessible description output. A successful test should identify a failure against Baseline 6. Images.` \#Reference and link to the applicable ICT Baseline test `app-baseline: |` (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your Baseline link entry on the next line.) - `[6.1 Test Procedure for Meaningful Images](https://section508coordinators.github.io/ICTTestingBaseline/06Images.html#61-test-procedure-for-meaningful-images)` + edit: `[6.1 Test Procedure for Meaningful Images](https://section508coordinators.github.io/ICTTestingBaseline/06Images.html#61-test-procedure-for-meaningful-images)` - `**Baseline Test ID.**: 6.1-MeaningfulImage` + `**Baseline Test ID.**: `edit: `6.1-MeaningfulImage` - `**Test Instruction.** 1` + `**Test Instruction.** `edit: `1` \# Expected result that the ICT Baseline would predict \# [Pass | Fail | DNA] - `result: FAIL` + `result: `edit: `FAIL` \# Brief description of the rationale for the expected result - `result-descr: The image in the code sample does not provide any attributes that would contribute to an accessible name or description text alternative output.` + `result-descr: `edit: `The image in the code sample does not provide any attributes that would contribute to an accessible name or description text alternative output.` \# URL for the code sample @@ -103,7 +103,7 @@ The Test Case file contains the description the Baseline’s evaluation of the t \# and provide the link (and only the url) below. - sample: `/testfiles/TF06/06.1-1-fail-1.html` + sample: edit: `/testfiles/TF06/06.1-1-fail-1.html` \# Table of test instructions, including the following table headers: @@ -112,6 +112,33 @@ The Test Case file contains the description the Baseline’s evaluation of the t \# \# Include the table in the content section below + + - Enter the table information (defined in markdown format) to describe the Test File’s result for each corresponding Baseline Test instruction. **COPY & PASTE the test instruction identifier and the Instruction Detail from the [ICT Baseline for Web](https://ictbaseline.access-board.gov/).** + + - Include all test instructions up to and including the instruction that determine the test result (pass/fail/dna). For example, if the third instruction determines the result, include the first, second, and third instructions in the table. + - Do not edit the table column headers: + + `| Test Instruction | Instruction Detail | Expected Test Case Result |` + + `|------------------|--------------------|---------------------------|` + + - Edit the table data. Create additional rows as needed: + + | \*\*\[Baseline Test Instruction ID\]\*\* | \[Copy and paste from [Baseline](https://ictbaseline.access-board.gov/) instruction\] | \[describe the test file's result for this Baseline test instruction\] | + +5. Commit your changes (i.e., save or upload your files to your branch). +## Update the Test Case Index File +**This is necessary because the Test Cases page is the main navigation to all test case/files on the Alignment website.** +1. Open the “testcases.md” file in the root folder in the GitHub repo. +2. Modify the list to add a link to your new test case. +3. Commit your changes (i.e., save or upload your files to your GitHub branch). +## Open Pull Request +1. Open a pull request in [Pull requests · Section508Coordinators/baselinealignment](https://github.com/Section508Coordinators/baselinealignment/pulls) +2. Each pull request should include the + 1. test case (markdown), ex: TC06.1-1-fail-1.md + 2. test file (HTML), ex: 06.1-1-fail-1.html + 3. Test case index update: testcases.md +3. When you are ready for your pull request to be reviewed, assign Andrew (drewnielson) or Kathy (kengdoj) as reviewers. From 0bc8c9df458ba08801f981528474cef7320ee6e0 Mon Sep 17 00:00:00 2001 From: Bethany Letalien Date: Tue, 12 Oct 2021 11:13:25 -0400 Subject: [PATCH 5/6] Update testCaseGuide.md --- testCaseGuide.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/testCaseGuide.md b/testCaseGuide.md index 5c1fd4b5..63452f87 100644 --- a/testCaseGuide.md +++ b/testCaseGuide.md @@ -1,5 +1,5 @@ # Guide for Developing Test Case and Test Files -Test cases and their related test files will be used to demonstrate expected outcomes for Baseline test instructions. Each of these test instructions is mapped to a 508 requirement ([draft Appendix A of the Baseline for Web](https://federalist-78ccea55-7a06-447c-aabf-bd620b207b74.app.cloud.gov/preview/atbcb/icttestingbaseline/nextupdateafter301/AppendixA/)) in the ICT Testing Baseline for Web. +Test cases and their related test files will be used to demonstrate expected outcomes for Baseline test instructions. Each of these test instructions is mapped to a 508 requirement ([Appendix A of the Baseline for Web](https://federalist-78ccea55-7a06-447c-aabf-bd620b207b74.app.cloud.gov/preview/atbcb/icttestingbaseline/nextupdateafter301/AppendixA/)) in the ICT Testing Baseline for Web. A note on developer tools: some contributors use VSCode and others use notepad++, depending on what they have access to. This work can all be done in the GitHub website, but some tasks would be much easier with a code editor. @@ -13,7 +13,7 @@ Thank you for contributing your time and skills to this! 5. [Contributing Test Case video play list](https://www.youtube.com/playlist?list=PLaqerowLitKmBu1MkZcJhu-VHmTBaDJho) - Youtube ## Claim Your Test Case -1. Go to the [Test Case map to Baseline Tests.xlsx](https://documents.max.gov/community-pages/_layouts/15/WopiFrame2.aspx?sourcedoc=%7b8C6CC728-95D2-4E54-826D-3CA97A7BCCA0%7d&action=edit) to see a listing of all test cases that are needed. +1. Go to the [Test Case map to Baseline Tests.xlsx](https://documents.max.gov/community-pages/_layouts/15/WopiFrame2.aspx?sourcedoc=%7b8C6CC728-95D2-4E54-826D-3CA97A7BCCA0%7d&action=edit) on Max.gov to see a listing of all test cases that are needed. - This spreadsheet is used for tracking of all test case development. - All details for the test cases are included here, including a description of the test case and test file and filenames. 2. Enter your name (in the blank Assigned column) next to the test case you want to work on. From b72bd6df875725537ebe27133a82cbdea4251308 Mon Sep 17 00:00:00 2001 From: Kathy Eng Date: Wed, 10 Nov 2021 19:16:13 -0500 Subject: [PATCH 6/6] testCaseGuide in HTML --- contributing.md | 4 +- testCaseGuide.html | 151 +++++++++++++++++++++++++++++++++++++++++++++ testCaseGuide.md | 144 ------------------------------------------ 3 files changed, 152 insertions(+), 147 deletions(-) create mode 100644 testCaseGuide.html delete mode 100644 testCaseGuide.md diff --git a/contributing.md b/contributing.md index 367caa8b..6d160bbd 100644 --- a/contributing.md +++ b/contributing.md @@ -5,9 +5,7 @@ title: Contributing to the ICT Baseline Alignment Framework # Contributing to the ICT Baseline Alignment Framework ## How you can help ### Developing and Evaluating Test Cases -Need content from people doing this work. What do you need? - -I have a note about issuing templates. Does that belong bundled with this topic? +Test Cases are essential for the Baseline Alignment Framework. These will be used to determine how well a test process aligns to the [ICT Testing Baseline for Web](https://ictbaseline.access-board.gov). If you would like to contribute to the collection of [test cases](testcases.html), please take a look at the [Guide for Developing Test Case and Test Files](testCaseGuide.html). All of the work is done on GitHub. Please email [ictbaseline@gsa.gov](mailto:ictbaseline@gsa.gov) with questions. ### Planning and Conducting Outreach We need people to know about our work so they can contribute and use it! Whether you enjoy giving presentations or would prefer to remain behind the scenes writing and editing, your skills are needed. Can you help with any of the following? diff --git a/testCaseGuide.html b/testCaseGuide.html new file mode 100644 index 00000000..ae9a238a --- /dev/null +++ b/testCaseGuide.html @@ -0,0 +1,151 @@ +--- +layout: page +title: Developing Test Cases and Test Files +--- +

Guide for Developing Test Cases and Test Files

+

Test cases and their related test files will be used to demonstrate expected outcomes for Baseline test instructions. Each test instruction is mapped in to their Section 508/WCAG requirements in Appendix A of the ICT Testing Baseline for Web.

+ +

A note on developer tools: some contributors use VSCode and others use notepad++, depending on what they are comfortable using or have access to. This work can all be done in the GitHub website, but some tasks would be much easier with a code editor.

+ +

Thank you for contributing your time and skills to this! And please contact us at ictbaseline@gsa.govif you have any questions.

+ +

Baseline Alignment Resources

+
    +
  1. Baseline for Web Alignment site - Test Cases page
    2. +
  2. Test Case map to Baseline Tests.xlsx - list of all test cases for development on Max.gov
    3. +
  3. Section508coordinators/baselinealignment – Baseline Alignment GitHub repository
    4. +
  4. ICT Testing Baseline for Web – where Baseline test instructions can be found
    5. +
  5. Our Youtube playlist for Contributing Test Cases
    6. +
+ +

Claim Your Test Case

+
    +
  1. Go to the Test Case map to Baseline Tests.xlsx on Max.gov to see a listing of all test cases that are needed.
    2. +
      +
    • This spreadsheet is used for tracking of all test case development.
      • +
    • All details for the test cases are included here, including a description of the test case and test file and filenames.
      • +
    +
  2. Enter your name (in the blank Assigned column) next to the test case you want to work on.
    3. +
  3. Change the status to “To Do” or “In Progress”, as appropriate.
    4. +
+ +

Develop the Test Case and Associated Files

+

Go to the Section508coordinators/baselinealignment GitHub repo and create a new branch for your work. If you've never used GitHub, you may want to start with Introduction to GitHub.

+ +

Create the Test File

+

The Test File contains the HTML code and includes any other supporting files needed.

+
    +
  1. Open an existing test file in the Baseline Alignment GitHub repo, such as baselinealignment/testfiles/TF06/06.1-1-fail-1.html. Or create the new test file from scratch.
    2. +
  2. Save with a new filename, in the appropriate “testfiles” sub-folder (/TF##). (Create a new /TF## folder if necessary.)
    3. +
      +
    • Obtain the filename from the spreadsheet. See the Test Case ID column and remove “TC”.
      • +
    • Test files follow this naming convention: [Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence # of this test].html
      • +
    +
  3. Edit/create the code in the HTML test file.
    4. +
  4. Ensure that the relevant code that you want displayed in the test case is enclosed in <div id="tc_code">. (A script is used to display this code snippet in the test case’s Test Detail section.) If you find that the relevant code cannot be enclosed in a <div>, please open an issue in the Baselinealignment GitHub repo.
    5. +
  5. Commit your changes (i.e., save or upload your files to your branch)
    6. +
+ +

Create the Test Case

+

The Test Case file contains the description the Baseline’s evaluation of the test file.

+
    +
  1. Open the "_testcase_template.md" file in the "Templates" folder in the GitHub repo. + Alternatively, you can open a published test case file from the "testcases" folder, such as TC06.1-1-fail-1.
    2. +
  2. Create a copy of the file.
    3. +
  3. Rename the duplicated file with the filename identified in the spreadsheet in the Test Case ID column. The file should be saved in the “testcases” folder. Test cases follow this naming convention:
    4. +
      +
    • TC[Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence #].md
      • +
    • Please note that the test case starts with “TC” and is markdown file format.
      • +
    +
  4. Update the content in the front matter (enclosed by “---"). Do not modify the lines that start with “#” or the identifier terms that precede a colon.
    5. +
      +
    • Please do not edit the special characters, spaces, and blank lines, as these were inserted to format and build the page correctly.
      • +
    • Below is a sample test case markdown file. The editable text follows the identifier term and colon (and sometimes, special character) in each section.
      • + + 
      +        # The layout must be 'testcase'; DO NOT Change layout: testcase
+        layout: testcase
+
+        # Brief, descriptive title for the test case
+        title: Image - no accessible name or description
+
+        # The Test Case ID should follow the pattern: 
+        # TC[Baseline Test Procedure #]-[Test Instruction #]-[Expected Result (pass/fail/dna)]-[example #], e.g., TC05.1-1-fail-1
+        tcid: TC06.1-1-fail-1
+    
+        # Description of the Test Case, the included code sample, test considerations,
+        # and rationale for the expected result according to the applicable ICT
+        # Baseline test
+    
+        descr: | (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your description entry on the next line.)
+    
+        Detect existence of attributes that would contribute to the accessible name and accessible description computation and calculate the text alternative for the image.
+
+        The code sample data input does not include any attributes that would contribute to accessible name or accessible description output. A successful test should identify a failure against Baseline 6. Images.
+    
+        #Reference and link to the applicable ICT Baseline test
+        app-baseline: | (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your Baseline link entry on the next line.)
+
+        [6.1 Test Procedure for Meaningful Images](https://section508coordinators.github.io/ICTTestingBaseline/06Images.html#61-test-procedure-for-meaningful-images)
+    
+        **Baseline Test ID.**: 6.1-MeaningfulImage
+    
+        **Test Instruction.** 1
+    
+        # Expected result that the ICT Baseline would predict
+        # [Pass | Fail | DNA]
+        result: FAIL
+     
+        # Brief description of the rationale for the expected result
+        result-descr: The image in the code sample does not provide any attributes that would contribute to an accessible name or description text alternative output.
+         
+        # URL for the code sample
+        # In the sample code file, add id="tc_code" to the 
+        # element that contains the relevant code snippet.
+        #
+        # Then upload the code sample to the 'testfiles' folder 
+        # and provide the link (and only the url) below.
+        sample: /testfiles/TF06/06.1-1-fail-1.html
+
+        # Table of test instructions, including the following table headers:
+        # Test Instruction #; Instruction Detail; Expected Test Case Result  
+        #
+        # Include the table in the content section below
+
      +
    +
  5. To enter the test file's results for the Baseline Test instructions:
    6. +
      +
    • Please do not edit the table column headers:
      • + 
      +             | Test Instruction | Instruction Detail | Expected Test Case Result |
+             |------------------|--------------------|---------------------------|
+
      +
    • Use this table (defined in markdown format) to describe the Test File’s result for each corresponding Baseline Test instruction. COPY & PASTE the test instruction identifier and the Instruction Detail from the Web Baseline
      • +
    • Include all test instructions up to and including the instruction that determines the test result (pass/fail/dna). For example, if the third instruction determines the result, include the first, second, and third instructions in the table.
      • +
    • Create additional rows. Each row will have this general format (columns in markdown tables are created using "|"):
      • + 
      +            | [Baseline Test Instruction ID] | [Copy and paste the instructions from the Web Baseline | [describe the test file's result for this Baseline test instruction] |
+
      +
    +
  6. Commit your changes (i.e., save or upload your files to your branch).
    7. +
+

Update the Test Case Index File

+

This is necessary because the Test Cases page is the main navigation to all test case/files on the Alignment website.

+
    +
  1. Open the “testcases.md” file in the root folder in the GitHub repo.
    2. +
  2. Modify the list to add a link to your new test case.
    3. +
  3. Commit your changes (i.e., save or upload your files to your GitHub branch).
    4. +
+ +

Open a Pull Request

+
    +
  1. Open a pull request in Pull requests · Section508Coordinators/baselinealignment
    2. +
  2. Each pull request should include
    3. +
      +
    • test case (markdown), ex: TC06.1-1-fail-1.md
      • +
    • test file (HTML), ex: 06.1-1-fail-1.html
      • +
    • updated testcases.md
      • +
    +
  3. When you are ready for your pull request to be reviewed, assign Andrew (drewnielson) or Kathy (kengdoj) as reviewers.
    4. +
+ diff --git a/testCaseGuide.md b/testCaseGuide.md deleted file mode 100644 index 63452f87..00000000 --- a/testCaseGuide.md +++ /dev/null @@ -1,144 +0,0 @@ -# Guide for Developing Test Case and Test Files -Test cases and their related test files will be used to demonstrate expected outcomes for Baseline test instructions. Each of these test instructions is mapped to a 508 requirement ([Appendix A of the Baseline for Web](https://federalist-78ccea55-7a06-447c-aabf-bd620b207b74.app.cloud.gov/preview/atbcb/icttestingbaseline/nextupdateafter301/AppendixA/)) in the ICT Testing Baseline for Web. - -A note on developer tools: some contributors use VSCode and others use notepad++, depending on what they have access to. This work can all be done in the GitHub website, but some tasks would be much easier with a code editor. - -Thank you for contributing your time and skills to this! - -## Baseline Alignment Resources -1. [Baseline for Web Alignment site](https://section508coordinators.github.io/baselinealignment/testcases.html) – Test Cases page -2. [Test Case map to Baseline Tests.xlsx](https://documents.max.gov/community-pages/_layouts/15/WopiFrame2.aspx?sourcedoc=%7b8C6CC728-95D2-4E54-826D-3CA97A7BCCA0%7d&action=edit) – list of all test cases for development on Max.gov -3. [Section508coordinators/baselinealignment](https://github.com/Section508Coordinators/baselinealignment) – Baseline Alignment GitHub repository -4. [ICT Baseline for Web](https://ictbaseline.access-board.gov/) – for reference. To request a change to the ICT Baseline for Web, please open a GitHub issue at . -5. [Contributing Test Case video play list](https://www.youtube.com/playlist?list=PLaqerowLitKmBu1MkZcJhu-VHmTBaDJho) - Youtube - -## Claim Your Test Case -1. Go to the [Test Case map to Baseline Tests.xlsx](https://documents.max.gov/community-pages/_layouts/15/WopiFrame2.aspx?sourcedoc=%7b8C6CC728-95D2-4E54-826D-3CA97A7BCCA0%7d&action=edit) on Max.gov to see a listing of all test cases that are needed. - - This spreadsheet is used for tracking of all test case development. - - All details for the test cases are included here, including a description of the test case and test file and filenames. -2. Enter your name (in the blank Assigned column) next to the test case you want to work on. -3. Change the status to “To Do” or “In Progress”, as appropriate. - -## Develop the Test Case and Associated Files -Go to the [Section508coordinators/baselinealignment GitHub repo](https://github.com/Section508Coordinators/baselinealignment) and create a new branch for your work. If you've never used GitHub, you may want to start with [Introduction to GitHub](https://lab.github.com/githubtraining/introduction-to-github). - -### Create the Test File -The Test File contains the code and includes HTML and any other supporting files needed. -1. Open an existing test file [in the GitHub repo](https://github.com/Section508Coordinators/baselinealignment), such as baselinealignment/testfiles/TF06/06.1-1-fail-1.html. Or create the new test file from scratch. -2. Save with a new filename, in the appropriate “testfiles” sub-folder (/TF##). (Create a new /TF## folder if necessary.) - - Obtain the filename from the spreadsheet. See the Test Case ID column and remove “TC”. - - Test files follow this naming convention: [Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence # of this test].html -3. Edit/create the code in the HTML test file. -4. Ensure that the relevant code that you want displayed in the test case is enclosed in `
`. (A script will display this code snippet in the test case’s Test Detail section.) - If you find that the relevant code cannot be enclosed in a `
`, please open an issue in the Baselinealignment github repo: (). -5. Commit your changes (i.e., save or upload your files to your branch). - -### Create the Test File -The Test Case file contains the description the Baseline’s evaluation of the test file. -1. Open the "_testcase_template.md" file in the "Templates" folder in the [GitHub repo](https://github.com/Section508Coordinators/baselinealignment). - Alternatively, you can open a published test case file from the "testcases" folder, such as TC06.1-1-fail-1. -2. Create a copy of the file. -3. Rename the duplicated file with the filename identified in the spreadsheet in the Test Case ID column. The file should be saved in the “testcases” folder. Test cases follow this naming convention: - - TC[Baseline Test ID]-[test instruction #]-[pass/fail/dna]-[sequence #].md - - Please note that the test case starts with “TC” and is markdown file format. -4. Update the content in the front matter (enclosed by “---"). Do not modify the lines that start with “#” or the identifier terms that precede a colon.) - - Please do not edit the special characters, spaces, and blank lines, as these were inserted to format and build the page correctly. - - Below is a sample test case markdown file with the *text that should be edited preceded by "edit:"*. The editable text follows the identifier term and colon (and sometimes, special character) in each section. - - \# The layout must be 'testcase'; DO NOT Change `layout: testcase` - - `layout: testcase` - - \# Brief, descriptive title for the test case - - `title: `edit: `Image - no accessible name or description` - - \# The Test Case ID should follow the pattern: - - \# TC\[Baseline Test Procedure #\]-\[Test Instruction #\]- - - \# \[Expected Result (pass/fail/dna)\]-\[example #\], e.g., TC05.1-1-fail-1 - - `tcid: `edit: `TC06.1-1-fail-1` - - \# Description of the Test Case, the included code sample, test considerations, - \# and rationale for the expected result according to the applicable ICT - \# Baseline test - - `descr: |` (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your description entry on the next line.) - - edit: `Detect existence of attributes that would contribute to the accessible name and accessible description computation and calculate the text alternative for the image.` - - edit: `The code sample data input does not include any attributes that would contribute to accessible name or accessible description output. A successful test should identify a failure against Baseline 6. Images.` - - \#Reference and link to the applicable ICT Baseline test - - `app-baseline: |` (Developer note: please do not edit the syntax here, or your file may not render as expected. Start your Baseline link entry on the next line.) - - edit: `[6.1 Test Procedure for Meaningful Images](https://section508coordinators.github.io/ICTTestingBaseline/06Images.html#61-test-procedure-for-meaningful-images)` - - `**Baseline Test ID.**: `edit: `6.1-MeaningfulImage` - - `**Test Instruction.** `edit: `1` - - \# Expected result that the ICT Baseline would predict - - \# [Pass | Fail | DNA] - - `result: `edit: `FAIL` - - \# Brief description of the rationale for the expected result - - `result-descr: `edit: `The image in the code sample does not provide any attributes that would contribute to an accessible name or description text alternative output.` - - \# URL for the code sample - - \# In the sample code file, add id="tc_code" to the - - \# element that contains the relevant code snippet. - - \# - - \# Then upload the code sample to the 'testfiles' folder - - \# and provide the link (and only the url) below. - - sample: edit: `/testfiles/TF06/06.1-1-fail-1.html` - - \# Table of test instructions, including the following table headers: - - \# Test Instruction #; Instruction Detail; Expected Test Case Result - - \# - - \# Include the table in the content section below - - - Enter the table information (defined in markdown format) to describe the Test File’s result for each corresponding Baseline Test instruction. **COPY & PASTE the test instruction identifier and the Instruction Detail from the [ICT Baseline for Web](https://ictbaseline.access-board.gov/).** - - - Include all test instructions up to and including the instruction that determine the test result (pass/fail/dna). For example, if the third instruction determines the result, include the first, second, and third instructions in the table. - - Do not edit the table column headers: - - `| Test Instruction | Instruction Detail | Expected Test Case Result |` - - `|------------------|--------------------|---------------------------|` - - - Edit the table data. Create additional rows as needed: - - | \*\*\[Baseline Test Instruction ID\]\*\* | \[Copy and paste from [Baseline](https://ictbaseline.access-board.gov/) instruction\] | \[describe the test file's result for this Baseline test instruction\] | - -5. Commit your changes (i.e., save or upload your files to your branch). - -## Update the Test Case Index File -**This is necessary because the Test Cases page is the main navigation to all test case/files on the Alignment website.** - -1. Open the “testcases.md” file in the root folder in the GitHub repo. -2. Modify the list to add a link to your new test case. -3. Commit your changes (i.e., save or upload your files to your GitHub branch). - -## Open Pull Request -1. Open a pull request in [Pull requests · Section508Coordinators/baselinealignment](https://github.com/Section508Coordinators/baselinealignment/pulls) -2. Each pull request should include the - 1. test case (markdown), ex: TC06.1-1-fail-1.md - 2. test file (HTML), ex: 06.1-1-fail-1.html - 3. Test case index update: testcases.md -3. When you are ready for your pull request to be reviewed, assign Andrew (drewnielson) or Kathy (kengdoj) as reviewers.