CMAT: The Clinical Medicine Assessment Tool

Back to Project Index | High-level Project Matrix | Project Documents

In the Design Studio, our class learned collaborative management of instructional-design projects that met demonstrated needs in real-life settings. The skills we learned included: management of time, personnel, and resources; meeting client needs and expectations; communication with team and client; information design; interaction design; and project problem solving.

In the final project, created for the instructors, Daniel Klassen and Eric Replinger, in the IT 6120: Design Studio for Project Management and Collaboration class, we met a deliverable that solved a human performance problem. Our analysis needed to show a gap between existing learner knowledge and/or skills. Our final project was an online assessment tool that provided our client with the knowledge and/or skills to help assess her student's knowledge and/or skill gap with diagnosing patient illnesses from reading abstracts that may or may not be related to the patient's illness.

This project meets the following competencies:

Reflective Practice

1. Take a systems view.

This project fulfills this competency because we were able to understand the context of our project from gathering information of our research and by analyzing the data from the needs analysis and interviews that we conducted. We were then able to create an online assessment tool to fit the client's requirements. This was a collaborative effort by the whole team and we all had input, collected information for the research and then analyzed the data to detail the needs analysis. The initial interview was conducted by myself and two other team members.

2. Use cycles of reasoning as tools for problem-solving.

This project fulfills this competency by allowing us to use the cycles of reasoning as a way to problem-solve solutions in creating the online assessment tool for the client. We performed action research by observing the physician assistants while they went through the process of diagnosing a patient and then reading an abstract and conferring with another physician on their diagnosis. Documentation for this project that details accountability for this competency includes the CMAT Design Blueprint (contains our needs assessment and instructional design plan) and the CMAT Post Project Review (combined review of the project from our group). This area was also a collaborative effort as a team. We met as a team to problem-solve and divide up the various tasks. Jim and Lisa were the project managers, but we were each individually responsible for managing our pieces of the project.

3. Promote collaboration, partnerships, and relationships for full inclusion with stakeholders, clients, subject matter experts, team members, etc.

We collaborated with our Subject Matter Expert (SME), Anita Glicken and observed actual users of her class to aid in the design of the online assessment tool. Additionally, we enlisted the help of a ColdFusion programmer to help with some of the more difficult code programming. Documentation for this project shows accountability for this competency to include the CMAT Design Blueprint (contains our needs assessment and design plan) and the CMAT Post Project Review (combined review of the project from our group). We divided this task up and each of us took turns going to the client site for interviewing, observing, and user testing. I participated in all these activities and helped to create the documents we used for interviewing, observing, and user testing.

4. Be a lifelong learner and professional.

This project fulfilled this competency by allowing me to further develop my ColdFusion skills, management skills, Instructional Design skills, and my skills for working with clients or SMEs. I have used many of the skills learned in this project in my job and my web design business.

Back to top

Planning & Analysis

5. Conduct a needs assessment for learning or performance interventions.

This project fulfills this competency because we were able to conduct a needs analysis and interviews to help us design and create the online assessment tool for the client. The needs assessment is detailed in the CMAT Design Blueprint and we also followed the proposal requirements sent by the client. We worked collaboratively on all the documents. We each took a turn starting a document. Each document had a main writer and then the rest of the team members reviewed for edits and comments.

6. Conduct a learning or performance instructional analysis.

This project fulfills this competency because we were able to conduct a needs analysis and interviews to help us create the design plan for creating the online assessment tool. The design plan is detailed in the CMAT Design Blueprint and CMAT Project Definition. I participated in giving the interviews and observing the students to help obtain data for the learning and performance instructional analysis.

Back to top

Design & Develop

8. Apply various theories/strategies and current research, and consider local needs and constraints to design activities and experiences for learning.

We used a variety of learning theories and design theories in the design of our online assessment tool. The design plan is detailed in the CMAT Design Blueprint, CMAT Project Plan and CMAT Project Definition. Our online assessment tool provided a simulated learning environment and encouraged the students to use critical thinking skills. We collaborated as a team to come up with the online tool using a web interface and a database backend to collect the data. Our design in some ways followed a software design project.

9. Design learning and performance products and resources that reflect an understanding of the diversity of learners and groups of learners.

In the design of the online assessment tool, we considered the information we gathered from the student analysis and incorporated strategies to help the diverse group of students that would be using the online assessment tool. The analysis is detailed in the CMAT Design Blueprint, our demo online assessment tool (use 345876908 as the student number to walk through the tool), and CMAT Project Definition. We collaborated as a team to determine and understand the knowledge of the students. This helped us develop a tool suited to the audience that would use the assessment tool.

10. Develop products and resources to support learning and performance.

In the design of the online assessment tool, we developed the online assessment tool (demo online assessment tool (use 345876908 as the student number to walk through the tool)), and the CMAT Access Database Job Aid to support both the student's and the client's learning and performances. As a team we each took various parts of the project to help create the final assessment tool that supported the learning and performance of the students. I wrote most of the ColdFusion code with some help from a consultant. I was the main developer of the database and had help from a team member and the consultant. This part of the project was the backbone of how the assessment tool worked.

Back to top

Evaluate & Assess

11. Evaluate effectiveness of programs, products, or practices.

Throughout the design and development of the online assessment tool, we used the client and students to help improve the design of the online assessment tool. Additionally, we planned for summative evaluation to measure how well the tool was used by the client and students, as well as testing the tool in our class. We also did a summative group evaluation the CMAT Post Project Review. We collaboratively worked to evaluate where we were with the project by allowing the client input throughout the project. I went several times for interviews and observations to help gather the evaluation data. Our team used this data to improve our assessment tool as we progressed through the project cycle.

12. Assess student/participant learning.

We created a summative evaluation to measure how well the tool was used by the client and students, as well as testing the tool in our class. Our tool was not ready in time to test the students before the semester was over. So, we provided a paper simulation pilot test to get student reaction.

13. Utilize research methods to investigate a learning or performance problem, issue, or trend.

We used the results of the summative evaluation and the testing of the tool to update and make changes to the online assessment tool. I helped to create the usability questions and tallied the evaluations into an excel spreadsheet. From these methods, we added better help instructions for the students using the assessment tool.

Back to top

Implement & Change

14. Applying theories of diffusion, adoption, and change to a local problem, develop a change strategy.

Before providing the final online assessment tool to the client, we developed Job Aid and provided a walkthrough of the tool to the client, as well as to the students. The CMAT Design Blueprint details how our tool would change the process of evaluating the student's performance with the use of the online assessment tool. Since I did the major portion of the work on the backend of the tool, I went to the client site to walk the SME through the use of the tool. I also went and provided code training to the IT person who would take over the project after we provided the tool to the client. The assessment tool when implemented will change the way the client works with her students. The client will have reports that will give instant information on her student's performance after the assessment tool has been used. Everything was done by hand before this and took many months to gather all the data in one place.

15. Participate in an implementation process or change strategy.

To ensure a successful implementation of the new online assessment tool, we walked the client through how to use the tool. There is also help documentation included in the tool, along with queries to run reports. We created a Job Aid for how to use the Access Database reports. We also walked the development team, which provides user support to the client, through an explanation of how the assessment tool works.

Back to top

Management

16. Employing effective strategies (e.g., team leadership, collaboration, accountability).

This project required several management skills including project management, and delivery of analysis and design documents. In addition, there was the delivery of the web interface, the help documentation, and the tool. Another area of management was the scheduling of my time on the parts of the project that I was assigned.

Back to top

Project Documents

CMAT Assessment Tool Prototype Website (use 345876908 as the student number to walk through the tool)

Proposal Form form Anita Glicken (PDF)

CMAT Project Definition (PDF)

CMAT JobAids (PDF)

CMAT Database Prototype (PDF)

CMAT Mock ups of Admin Screens (PDF)

CMAT Mock ups of Student Screens (PDF)

CMAT Project Plan (PDF)

CMAT Storyboards (PDF)

CMAT Use Cases (PDF)

CMAT Personal Analysis (PDF)

CMAT Design Blueprint (PDF)

CMAT Usability Tests (PDF)

CMAT Summative Evaluation Results (PDF)

CMAT Post Project Review (PDF)

CMAT Class Presentation (PDF)

Back to top