Metadata and Digital Repositories

Joint Assessment and Metadata & Digital Repository SIG Meeting Report: University of Strathclyde, 12 Oct 2006

Report by Neil Fegen. Presentations are available in PowerPoint and MP3 format, with some also available as Breeze presentations.

A list of attendees is given at the end of this report.

A summary of the evaluation forms is also available.

Introduction

Phil Barker gave a brief introduction to the day and to the aims and activities of CETIS.

For more details, download Phil's presentation:

• PowerPoint [53KB]
• MP3 [3.28MB]

Introduction to QTI and item bank requirement

Steve Lay of the University of Cambridge presented an introduction to the IMS Question & Test Interoperability (QTI) specification, describing it as a ‘run-time model for question and test delivery’. Steve also discussed the importance of the IMS Content Packaging specification and the benefits of binding items, tests, media files, etc. together.

For more details, download Steve's presentation:

• PowerPoint [151kB]
• MP3 [5.45MB]

Item banks and the JISC Information Environment

Andy Powell of Eduserv talked about the JISC Information Environment (IE) and item banks, looking at how to bring the two together by comparing between 'JISC IE' and 'Web 2.0' approaches.

For more details, download Andy's presentation:

• PowerPoint [510KB]
• MP3 [4.75MB]

Learning Object Repository as item bank

Charles Duncan of Intrallect discussed the similarities and differences between repositories and item banks, looking at: what each contains; why they should be used; and related systems.

For more details, download Charles' presentation:

• PowerPoint [219KB]
• MP3 [3.67MB]

Architecture of an item bank

Mhairi McAlpine of the SQA talked about essential features for a sustainable itembanking system, highlighting the approaches to futureproof development and a common architecture blueprint between key stakeholders.

For more details, download Mhairi's presentation:

• PowerPoint [297KB]
• MP3 [6.15MB]

Also, download Mhairi's presentation from the York meeting in March 2006:

• PowerPoint [354KB]
• MP3 [6.96MB]

Discussion

In a close to the day, the discussion session attempted to answer a number of questions related to item banks and repositories.

In considering whether item banks are repositories, it was felt that a repository is at the heart of an item bank system. In terms of the core repository needed to create an item bank, the following were proposed:

• Usage data statistics?
  • Is that a feature of item banks or a way things come out of item banks?
• Each item gets a unique URI (Uniform Resource Identifier)
• Something to record usage data
• Test construction?
  • But are they core functionality of item banks?
• Database for metadata (visible) and repository for content (more secure)
• Rendering, usage and test creation, for over and above typical. Scheduling is delivery, while item bank is the content
• Embargo period? How to handle it?
  • Perhaps an embargo for everyone on the repository but only a group of people (e.g. students) in the item bank
• Will institutions share items?
  • Or sell them?
    • PDF-based exams could be shared
• Is a learning resource the same as a (non-high stakes) item?
• Technological barrier and/or reluctance to develop then share items
• Validation (of test) - passed to central hub to deal with?
• CoolURIs
  • Make URI persistent
  • Make domain name persistent
  • Don't embed technology (e.g. .asp) in name
  • CoolURI to version of item
  • Might be browser that opens item, or other software that does HTTP-GET behind the scenes
    • e.g. Flickr - URI to every image and software e.g. Flash does it for you, rather than the browser.
• Item/assessment difficulty depends on audience... used for exposure control... e.g. last used in India in 1982 so use somewhere else.

For more details, download the Discussion slide:

• PowerPoint [14KB]

Attendees

The following registered for the meeting

Many thanks to all who attended, especially those who gave presentations and those at Strathclyde who helped with the organisation.