Formative Evaluation
Small-Group Trial Summary
Background
The design of this Small Group Evaluation is partly based on the proposed revisions from an older small-group formative evaluation document.
Revisions that were suggested in the above-mentioned evaluation, and followed in this revised evaluation:
Please see the document below for details on the learners’ backgrounds, feedback on the instructional materials, and learning results from this evaluation.
Click on the images to access the documents.
Revisions that were suggested in the above-mentioned evaluation, and followed in this revised evaluation:
- Revised (entire) design documents
- Made the video into smaller segments (instead of speeding up parts)
- Provided access to video segments in the form of links
- Revised post-test into a checklist (instead of a rubric)
- Added information about how to decrease an image’s size
- Used a program that does not require a particular operating system (entirely online)
- Recruited 8 learners for the small group evaluation
- Recruited learners from varying age-groups
Please see the document below for details on the learners’ backgrounds, feedback on the instructional materials, and learning results from this evaluation.
Click on the images to access the documents.
Field Trial Summary
Background
The design of this Field Trial Evaluation is based on the proposed revisions from Part 1. Small Group Evaluation.
Revisions that were suggested in the above-mentioned evaluation, and followed in this revised evaluation:
Please see the documents below for details on the learners’ backgrounds, feedback on the instructional materials, and learning results from this evaluation.
Click on the images to access the documents.
Revisions that were suggested in the above-mentioned evaluation, and followed in this revised evaluation:
- Tried different strategies to get bigger graphics and close-up of video recordings
- Made it clear in the video and PDF instructions that (non-field trial) learners do not have to use PowerPoint Online if they have the Desktop version
- Showed the final thumbnail before starting video instructions in PowerPoint and PDF
- Added more details about the license features in the CC video and PDF instructions (especially about which features make a resource open and how commercial use effects it)
- Mentioned taking a screenshot in regular mode instead of full-screen in PowerPoint
- Added bigger text or sub-headings about registering for both TPT and OneDrive
- Placed the introduction video in a more visible area
Please see the documents below for details on the learners’ backgrounds, feedback on the instructional materials, and learning results from this evaluation.
Click on the images to access the documents.
Final Draft Revisions
1. Change the order of the major steps:
1. Register for a TeachersPayTeachers Seller account
2. Register for a OneDrive account
3. Take a screenshot
4. Does the learner want to design a thumbnail for the product page? (Learners in the trials had to choose YES)
5. Design a thumbnail
6. Condense the resource into one file
7. Select a Creative Commons License
8. Add a Product
2. Add having PowerPoint or presentation software experience into the design document’s entry skills
3. Have written and spoken instructions that direct learners to either: 1. Make a basic TPT product without a thumbnail or 2. Make a TPT product with a thumbnail
4. Suggest other application options for designing thumbnails
5. Optional – Include a link to the site where I get free (commercially useable) graphics OR make a separate document with directions on how to get commercially useable graphics
6. Clearly state that TPT requires the very first product upload to be FREE
7. Recommend a CC license
1. Register for a TeachersPayTeachers Seller account
2. Register for a OneDrive account
3. Take a screenshot
4. Does the learner want to design a thumbnail for the product page? (Learners in the trials had to choose YES)
5. Design a thumbnail
6. Condense the resource into one file
7. Select a Creative Commons License
8. Add a Product
2. Add having PowerPoint or presentation software experience into the design document’s entry skills
3. Have written and spoken instructions that direct learners to either: 1. Make a basic TPT product without a thumbnail or 2. Make a TPT product with a thumbnail
4. Suggest other application options for designing thumbnails
5. Optional – Include a link to the site where I get free (commercially useable) graphics OR make a separate document with directions on how to get commercially useable graphics
6. Clearly state that TPT requires the very first product upload to be FREE
7. Recommend a CC license