Evaluating Training and Technical Assistance

In order to effectively evaluate for changes in behavior, you will need to reconnect with training and technical assistance participants. Whether you reach out via electronic survey, email, telephone, or in-person interview, you will be looking to answer the same set of questions:

• What did you learn that you were excited to try to implement at your organization?
• How eager were you to implement these new changes?
• Were you able to successfully implement these changes? Why or why not?
• How do you plan to do things differently in the future?

Your organization may also find it beneficial to interview client staff members who regularly interact with the individual who took part in the TTA event.  These staff interviews may include colleagues, supervisors, or subordinates – anyone who might be able to provide insight into the individual’s behavior.  When interviewing client staff members, TTA providers should enquire as to whether the individual left the training or technical assistance event energized and excited to make positive changes, whether or not the individual actually made a change, and whether this change was well-received and sustainable within the client’s overall organizational climate.

Just as with level 2 evaluations, level 3 evaluations are often more informative when organizations evaluate behavior both before and after a training or technical assistance event. These pre- and post-tests or surveys provide insight into how your clients have historically performed certain processes and procedures, and how new knowledge, skills, or attitudes have impacted or changed how those processes and procedures are performed.

It takes time to observe how learning impacts behavior. Because of this, your organization will need to review the content and objectives of your training and technical assistance efforts and decide on a reasonable length of time that provides your clients an opportunity to put their new knowledge or skills to work. Furthermore, you will also want to provide your clients with sufficient time to consider these behavioral changes and formulate an opinion as to whether they think the changes were positive and sustainable.