Sunday 21 June 2015

School Research Leads - How am I doing as an evidence-informed practitioner ?

I've often wondered what goes into making an effective evidence-informed teacher.  I wish I could  tell you what are the magic ingredients for making sure your practice is evidence informed.

My trouble begins when I start thinking about what does an evidence informed practitioner actually do.  Is it reading research articles? Is it attending conferences with notable speakers? Is it about working with colleagues to try out new ideas?  Is it about enrolling on a some form of post-graduate programme of study? Is it about undertaking small-scale action research projects?

Judging from the comments I've received via Twitter over the last 12 months, it would be seem to be about all of these practices, and then some.  So as we approach the end of the academic year, how can you go about evaluating -in a non-judgmental manner - your performance as an evidence-informed practitioner.  One approach is to return to the literature on evidence-based medicine and see what evaluative tools are available for adaptation for use in a school-setting.  Fortunately Straus et al (2011) provide a range of questions which can be used for that purpose. But first, let's revisit the 5 steps which make up the practice of evidence-based medicine (and revised for education).

Step 1 - converting the need for information into an answerable question.

Step 2 - tracking down the best evidence with which to answer that question.

Step 3 - critically appraise the evidence for its validity impact and applicability.

Step 4 - integrating our critical appraisal with our teaching expertise and taking into account our pupils's values, circumstances and preferences - alongside the views of other important stakeholders.

Step 5 - evaluating our effectiveness and efficiency in executing steps 1 to 4 and seeking ways to improve next time (Adapted from Straus et al 2011, p3).

So let's now see how these questions can be used to help create a range of self-evaluative questions.

Self-evaluation 

Self-evaluation of converting the need for information into an answerable question
  1. Am I asking questions about either my teaching and/or management practice?
  2. Am I asking, by using either the PICO or CIMO technique, focused and answerable questions?
  3. How do I go about systematically identifying the gaps in both my knowledge and skills?
  4. If stuck, how do I go about 'unstuck' when asking questions?
  5. How do I go about saving my questions for future investigation.
Self-evaluation of tracking down the best evidence with which to answer that question.
  1. Am I searching at all for 'research evidence' relevant to my teaching/managerial practice?
  2. Am I searching for evidence from a range of sources - school data, pupils and other stakeholders?
  3. Do I know the best sources of evidence relevant to my teaching/managerial practice?
  4. Do I have easy access to this evidence?
  5. Am I becoming more efficient in searching for evidence?
  6. Am I making good use of google scholar or ERIC?
  7. How do my searches for evidence compare to to school librarians, school research leads, senior colleagues who are passionate using research evidence to inform their practice?
Self-evaluation critically appraising the evidence for its validity impact and applicability.
  1. Am I critically appraising evidence - be it research evidence, internal school data?
  2. Am I becoming more effective in applying 'critical appraisal techniques' (for example Wallace and Wray) when reviewing the research evidence?
  3. Am I becoming more knowledgeable about some to the key terms used in educational research, for example, effect sizes and confidence limits
  4. Am I creating summaries of critically appraised topics?
Self-evaluation in integrating our critical appraisal with our teaching expertise and taking into account our pupils's values, circumstances and preferences - alongside the views of other important stakeholders.
  1. Am I integrating critical appraisals into my teaching/managerial practice?
  2. Am I adapting the findings of my critical appraisals to meet the needs of my pupils/colleagues?
  3. Can I explain (and resolve) differences in 'what the evidence says' and my teaching and management practice?
Self-evaluation of changing teaching or management practice
  1. When the evidence suggests a change in teaching/management practice am I identifying 'inhibitors and nourishers' for this change.
  2. Have I identified a clear and deliverable action plan to implement this change?
  3. Have I evaluated the impact on pupil learning/outcomes of any changes in practice?
  4. Am I considering the sustainability of any changes I am putting into practice?  
(Adapted from Straus et al 2011, p206 - 209).
Additional questions could be devised and added to this list, questions which are more relevant to your context and the development of an evidence-informed culture within your school.  However, it is important to acknowledge this set of statements are part of a process of becoming an evidence-informed practitioner.  If this is your first year in seeking to integrate evidence to inform your practice, it may be just becoming better at devising well formulated and answerable questions is where your self-evaluation should both begin and end.  Remember, no-one is perfect and will be doing all of the above, what matters is that you are engaging in a meaningful process to improve your practice.


References
Straus, S.E., Glasziou, P., Richardson, W. S. & Haynes, B.R. (2011)  Evidence Based Medicine : How to practice and teach it, (4th edition), Churchill Livingston.

Wallace, M. and Wray, A. (2011) Critical Reading and Writing for Postgraduates (2nd edition), Sage, London






5 comments:

  1. Looking through google to find an article on action research lead me to your post and I’m glad I stopped to read it. The question of “how am I doing as an evidence-informed practitioner?” can be asked in several dimensions in life. For me, it made me stop and ask in a perspective of a leader and mentor to my employees. In class I am reading the book “The Future of Management” and in the book one sentence has stayed with me and that is “all commitments are self-commitments.” Do you feel that plays a role in your posed question?

    ReplyDelete
    Replies
    1. Absolutely - this work needs to start with yourself and your own behaviour and actions - a previous post discusses the need to be ambitious - but there is no escape from being the best possible role model you can be - and that starts with your own commitment
      http://evidencebasededucationalleadership.blogspot.com/2015/04/the-school-research-lead-definition-of.html

      Delete
  2. When the evidence suggests a change in teaching/management practice am I identifying 'inhibitors and nourishers' for this change.

    BISE DG Khan Board Matric Result 2015

    ReplyDelete
  3. The necessary ideas would lead students towards all those key essentials and the details which are indeed considered to be of utmost importance and the value. nrmp fellowship

    ReplyDelete