Product Scorecards

The Amblit Technologies scorecard is dividied into six (6) areas which follows the purchase, assembly, testing and learning of a STEM kit:

1. Evaluation and purchase
2. Inventorying of parts (15)
3. Kit assembly (25)
4. Kit testing (20)
5. Lessons and learning (40)
6. Overall experience summary

Each kit is scored on a 100 point basis, where 100 is a perfect score.  The numbers in parenthesis are the points that can be earned or lost by section.  To earn a perfect score a kit must be well made, the documentation must be clear and age appropriate, the assembly process needs to be straight forward, even if challenging, the kit must include the approriate tests at the appropriate times to insure that kit works as advertised and desired and the lesson plan and learning experience must be fun, engaging and valuable.

ChatGPT Kit Evaluation Criteria

We were curious to learn what evaluation criteria ChatGPT would use if evaluation a kit.  The ChatGPT 3.5 version responded with:

1. Functionality: The robot should be able to perform the tasks it was designed for. The robot should work as expected and be able to perform the desired actions accurately and consistently.
2. Ease of use: The robot should be easy to operate, with clear instructions for setup and use. The interface should be intuitive and user-friendly, with minimal technical knowledge required to operate the robot.
3. Durability: The robot should be able to withstand wear and tear from regular use, and should be built to last. It should be made of high-quality materials that can withstand impact, scratches, and other damage.
4. Flexibility: The robot should be versatile enough to perform a range of different tasks and activities. It should be able to be programmed or reprogrammed to perform new tasks as needed.
5. Safety: The robot should be designed with safety in mind, with appropriate safety features and safeguards in place to prevent injury or damage.
6. Affordability: The robot should be reasonably priced, with a good balance between cost and functionality. It should be priced competitively with other similar robots on the market.
7. Technical support and customer service: The company that produces the robot should provide technical support and customer service to help users troubleshoot problems and answer questions.

 ChatGPT ‘learned’ and deduced this information from information on the Internet (e.g., Wikipedia).

All of ChatGPT criteria is included in our scorecard.  The biggest difference is that our scorecard evaluates the kit as it progresses through the entire assembly-use life cycle versus creating a final summary at the end.

Lesson Plan Evaluation

We were also curious to learn ChatGPT’s recommendation of lesson plan evaluations. It responsed with:

1. Alignment with learning objectives: The lesson plan should be aligned with the learning objectives and goals of the course or curriculum.
2. Clarity and coherence: The lesson plan should be well-organized, easy to understand, and logically structured.
3. Engagement and participation: The lesson plan should incorporate strategies that engage and encourage participation from all learners.
4. Assessment and feedback: The lesson plan should include clear assessment criteria and provide opportunities for feedback to help learners understand their progress.
5. Use of technology and resources: The lesson plan should utilize appropriate technology and resources to support learning and engagement.
6. Differentiation and inclusivity: The lesson plan should be designed with the needs and abilities of diverse learners in mind and include strategies for differentiation and inclusivity.
7. Flexibility and adaptation: The lesson plan should be flexible and adaptable to accommodate changes in circumstances or learner needs.

Overall, an effective lesson plan should be learner-centered, adaptable, and focused on achieving learning objectives.

Our lesson plan evaluation includes all of the above plus:

• The manufacturer needs to lead with a clear statement and explanation of the lesson plan goals by the target student group based on age, knowledge and skill level;
• The lessons should be fun and engaging, and the manufacturer needs to solicit ways to constantly improve and expand on those lessons and lesson plan.