
DISCUSSION PAPER FOR THE EDUCATION & PROGRAMME COMMITTEES
FROM GRAHAM COOPER
JUNE 2000
ABSTRACT SELECTION AND PRESENTATION MARKING FOR THE ANNUAL MEETING
Preamble:
Presentations are marked to allow awarding of prizes. There are four prizes to be awarded:
The current scoring sheet is cumbersome, there is uncertainty about the suitability of papers for the various prizes and there can be marked variations in scoring between assessors.
These problems could be overcome by using a redesigned, semi-structured scoring sheet and having written guidelines about the eligibility of papers/posters for the various prizes. An example of this follows.
A similar mechanism should be used for abstract assessment and a matrix for this is also enclosed.
I think that the final versions should be open document available on the Societys web site and brought to the attention of all presenters at the Annual Meeting.
If this format is adopted it may mean more work for assessors but will give us an open, transparent and fair system. This will I think be important as the meeting gains increasing credibility.
ABSTRACT ASSESSMENT MATRIX
|
Criteria |
0 |
1 |
2 |
3 |
4 |
|
|
Originality/relevance |
|
|
|
|
|
|
|
Design |
|
|
|
|
|
|
|
Data analysis |
|
|
|
|
|
|
|
Conclusions |
|
|
|
|
|
|
|
Total |
|
|||||
NOTES FOR ASSESSORS
CTSNet allows a score of 1 to 10 for each abstract. Originality/relevance are scored between 1 and 4 and design, data analysis and conclusions are scored between 0 and 2 to allow a total score of between 1 and 10.
The assessment matrix should be used for each abstract, an explanation of the marking criteria is given below.
The total score for each abstract should be entered on CTSNet.
MARKING CRITERIA
PRESENTATION MARKING AT THE ANNUAL MEETING
There are four prizes to be awarded:
Each session is marked by 3 members of the Society, two of these are members of the Programme Committee, one of whom acts as the lead assessor being responsible for co-opting a 3rd assessor and collating the assessment sheets at the end of the session. A standard marking sheet is used. The marks from the 3 assessors are averaged allowing papers to be ranked. The Programme Committee meets immediately after the Annual Meeting to allocate prizes, their decision is final. The following guidelines are used:
A maximum of 20 marks are available. The marking criteria are weighted so that 25% of marks are awarded for presentation and handling of questions. The marking structure is shown overleaf.
PRESENTATION MARKING FORM
|
Abstract No: |
Title: |
||||||
|
Presenter: |
|||||||
|
Criteria |
Mark |
|
|||||
|
|
1 |
2 |
3 |
4 |
5 |
|
|
|
Originality/relevance |
|
|
|
|
|
|
|
|
Design |
|
|
|
|
|
|
|
|
Data analysis |
|
|
|
|
|
|
|
|
Conclusions |
|
|
|
|
|||
|
Presentation/questions |
|
|
|
|
|
|
|
|
TOTAL MARK |
|
||||||
|
Suitable for: Edwards medal Y/N*, Cooper prize Y/N*, FACT prize Y/N* |
|||||||
NOTES
* Completed by the abstract selection committee.
Only papers in the poster session are eligible for the Parker Medal.
The lead assessor for your session will collect your assessment sheet at the end of the session and average the marks
Marking Criteria: