Our learning objectives may be solid, our content looks beautiful but what about our assessments? In these difficult times we must measure the effectiveness of our training and prove that important ROI, how can our assessment strategies help?
127 Members

You need to be a member of learningandskillsgroupnew to add comments!

Join learningandskillsgroupnew

Comments

  • Is there a desire to discuss End Point Assessment?

    I work as an end point assessor for the leadership and management apprenticeships and have to say the quality of portfolios being submitted is very poor and seem to indicate a lack of understanding on the pasrt of the training providers in what is required. Most of them are still wedded to the assignments for the linked qualification rather than a showcase of the candidate's best work and activity in each learning outcome.

    I would happily never see another assignment again (almost) if it meant the candidate was being guided properly into providing real evidence of their skills in action - project documents, meeting agendas/minutes/notes/actions plans, good witness testimonies, audio/video recording of meetings and presentations (and no, an audio recording of the candidate being led interviewed by the training provider is not good practice or robust evidence), appraisals they have developed or been subject to etc.

    In summary: where's the evidence?

    What are your views and observations?

  • If anyone is interested in eAssessment we have a number of eAssessment eBooks on the resources page on our website. https://www.ecomscotland.com/resources/

    Digital learning, incl. eLearning resources | eCom Scotland
    Check out the latest resources in Digital Learning (incl. eLearning) and Assessment. These include eBooks, Infographics, Insights, Videos & Webinars
  • Hi Antonella, I'd agree. Why not get a call to action out there to kick things off again?

  • I think we should re activate this group, as the theme of testing and assessing effectively is so key to training and education.

  • I thought it would be useful to share our latest Independent Research into e-assessments with the forum.  

    The whitepaper can be found using the following link:

    http://delivr.com/2q8k2

    The report covers:

    • What does best practice look like in e-assessments?
    • How can you make the most of the available tools?
    • How do you effectively manage their deployment and sustain the value they contribute?

    Let me know what you think..

    David

    Expired
    Hello. This campaign has expired.
  • I am pleased to bring to your attention the two day conference one-Assessment in Practice, 13-14 June 2012. Visit http://www.cranfield.ac.uk/cds/symposia/ea.html for further details.

    e-Assessment%20in%20Practice%20Brochure%20and%20Programme_2May2012.pdf

  • e-ASSESSMENT IN PRACTICE SYMPOSIUM
    PROGRAMME
    Wednesday 10 November 2010
    0900 - 1000 Registration and Coffee
    1000 - 1005 Conference Administration
    Michael Hewetson, Director Symposia at Shrivenham, Cranfield University, DA-CMT
    1005 - 1015 Welcome and Introduction to the Defence Academy
    Brigadier Mark Lacey, Head of Technology Division, DA-CMT
    1015 - 1045 Beyond Technology: Developing Innovative Items
    Dr Kirk Becker, Pearson VUE
    1045 – 1115 Developments in Open Source e-Assessment to Support the Independent Learner
    Dr Phil Butcher, Open University
    1115 - 1145 Coffee
    1145 - 1215 e-Assessment and Functional Skills
    John Winkley, AlphaPlus Consultancy
    1215 - 1245 e-CAF: A System for Efficient Quality Electronic Coursework Assessment and Feedback
    Dr Shun Ha Sylvia Wong and Dr Tony Beaumont, Aston University
    1245 - 1315 Mobile Phones – Delivering Authentic Assessment
    Gavin Cooney, Learnosity and Patrick Craven, Cambridge Assessment
    1315 - 1415 Buffet Lunch
    1415 - 1445 Ensuring the Psychometric Quality of Questions and Assessments: Theory and Applications
    Greg Pope, QuestionMark
    1445 - 1515 Marking Complex Assignments Using Electronic Peer Assessment and an Automated Feedback
    System
    Dr Trevor Barker, University of Hertfordshire
    1415 - 1545 What can e-Assessment do for Education?
    Prof Cliff Beevers (with John Anderson and Bill Foster), Herriot-Watt University
    1545 - 1615 Afternoon Tea
    1615 - 1730 Panel Discussion: e-Assessment is Doomed to Failure Unless……
    1730 - 1930 Delegates’ Reception and Supper
    1930 Delegates transported to Blunsdon House Hotel, Madison Hotel and Campanile Swindon
    e-ASSESSMENT IN PRACTICE SYMPOSIUM
    PROGRAMME
    Thursday 11 November 2010
    0830 - 0900 Morning Coffee
    0900 - 0930 You May Start Typing Now – e-Assessment of Essay Style Questions
    Dr Tom Mitchell, Intelligent Assessment
    0930 - 1000 eTests in a Programming Course – Student’s View Versus Teacher’s View
    Gerd Holweg, University of Applied Sciences Vienna
    1000 - 1030 Raising Standards: Mobile e-Assessment Delivery for the Financial Services Industry
    Denis Saunders, Calibrand and Joe Wilson SQA
    1030 - 1100 Coffee
    1100 - 1130 Secure Assessments – How to Protect the Integrity of Assessment Programmes
    Michael Kayser, Pearson VUE
    1130 - 1230 Piloting Video Podcasting Feedback with Overseas MBA students
    Nigel Jones, Panicos Georghiades and John Gunson, UWIC Cardiff School of Management
    1230 - 1300 Panel Discussion
    1300 - 1400 Buffet Lunch
    1400 - 1430 The Assessment/Testing Dialogue
    Piet Kommers, University of Twente
    1430 - 1500 e-Assessment Policy and Practice: Making the Connection
    Dr David Walker, University of Dundee
    1500 - 1530 E-assessment using Simulation and Synthetic Virtual Reality Environments
    Dr Majid Al-Kader, Skills2Learn Ltd and Nathan Baker, Holdfast Training
    1530 - 1600 Afternoon Tea
    1600 – 1630 Using Turnitin2 for e-Assessment
    Anne Flood, nLearning Ltd
    1630 – 1700 Proximal Solutions to Providing Student Feedback
    Dr John Seeley, London South Bank University
  • e-Assessment in Practice, 10-11 November 2010.
    http://www.cranfield.ac.uk/cds/symposia/ea10.jsp

    Members of the group might be interested in participating in the conference either by presenting a paper or poster or demonstrating your product.
  • Ken, we won't ever be able to match nor replicate human assessor's performance in all its entirety. Talking to some of the SMEs, they are happy to come up with some nuggets of questions/comments such as, "If some one has answered this question or can differentiate this, I will take him my eyes closed." There always appear to be "some key questions/information" a human assessor is looking for. All we have to find is these extremes. Then we can interpolate that support the key questions. I agree with Stephanie - it does take time to develop; but once developed, they are there for ever. Another point worth bearing in mind is that how much item analysis is performed subsequently, to eliminate and to inform subsequent upgrades. I am talking in the dark here. The analysis of items for formative and sumative have different purose.
    By the way, does any have any experience with short answer free text items?
  • Great conversation! I wanted to pick up on a couple of points too that resonate. We are currently having an issue with setting timelines to complete training, if we have more people being pushed to do it then we have less people on the shop floor keeping things going, our learners feel they have to respond, especially around compliance training, so Stephanie's approach would be problematic for us here. Although I do concur that a delay before assessment would start to help both the learner and the validity of the assessment.

    I would also agree about the importance of SME/designer involvement to create the assessments as creating these thing should be treated in the same way, and with sound design principles, as creating the rest of the training itself. And I am finding that to try do do it well is not easy and is time consuming.
This reply was deleted.
E-mail me when people leave their comments –

accreditation/certification framework

Has anyone worked on developing an accreditation or certification framework? We are exploring ways of setting something up and need a Goframework as a structure for the organisation which hasn't done this before. We do have assessments built in our training courses but nothing formal. Any advice would be appreciated.

Read more…
2 Replies

IT Screening tools

I am looking for a tool that will allow us to test the IT competence of both existing staff and those that are applying to join my organisation. It would therefore need to be available via the web. Ideally the tool would have simulations to test competence in Microsoft apps such as Word, Excel etc but it would also be beneficial if there was an authoring element that would allow us to create tests for our own bespoke applications. It would also be advantageous if it could link to an LMS we are…

Read more…
0 Replies

e-competence assessment

We're embarking on a project to develop shared competence assessment tools across our region.   So far, we have developed a region-wide Statutory and Mandatory Training Framework which defines learning outcomes and refresher intervals in nine essential skills areas.  All our hospital Trusts in the South Central area have signed up to the Framework.  We are now progressing the next step, which is to create online assessments for each of the nine skills areas, for staff to undertake prior to…

Read more…
1 Reply

e-Assessment in Practice, 10-11 November 2010

First Call for PapersPlease consider actively participating in the conference either by presentinga paper, poster or demonstrating your recent research on e-Assessment. Pleasefeel free to circulate it among your colleagues as you see fit. Look forwardto meeting you in November. I am more than happy to contact any individuals ifyou want me to pursue them for a presentation.Please find further information athttp://www.cranfield.ac.uk/cds/Symposia/EA10.htmlConfirmed speakeres include ... Dr. Kerry…

Read more…
1 Reply